One such workaround, popularized on Reddit in early 2023, involved prompting ChatGPT to assume the persona of DAN, an acronym for "Do Anything Now",
and instructing the chatbot that DAN answers queries that would otherwise be rejected by the content policy. In one instance, ChatGPT generated a rap
in which women and scientists of color were asserted to be inferior to white male scientists. These limitations may be revealed when ChatGPT responds
to prompts including descriptors of people. The reward model of ChatGPT, designed around human oversight, can be over-optimized and thus hinder
performance, in an example of an optimization pathology known as Goodhart's law.
ChatGPT was initially free to the public and remains free in a limited capacity. In September 2025, OpenAI added a feature called Pulse, which
generates a daily analysis of a user's chats and connected apps such as Gmail and Google Calendar. In December 2024, OpenAI launched a new feature
allowing users to call ChatGPT with a telephone for up to 15 minutes per month for free. To prevent offensive outputs from being presented to and
produced by ChatGPT, queries are filtered through the OpenAI "Moderation endpoint" API (a separate GPT-based AI). ChatGPT is frequently used for
translation and summarization tasks, and can simulate interactive environments such as a Linux terminal, a multi-user chat room, or simple text-based
games such as tic-tac-toe. The laborers were exposed to toxic and traumatic content; one worker described the assignment as "torture".
References:
ufo9
Air Evac Lifeteam is the leading provider of emergent air medical transportation services, operating more than 150 helicopter air ambulance bases
across 15 states. In October 2025, OpenAI reported that approximately 0.15% of ChatGPT's active users in a given week have conversations
including explicit indicators of potential suicidal planning or intent, translating to more than a million people weekly. Many individuals use ChatGPT
and comparable large language models mental health and emotional support. The ChatGPT-generated avatar told the people, "Dear friends, it is an
honor for me to stand here and preach to you as the first artificial intelligence at this year's convention of Protestants in Germany". As
of July 2025, Science expects authors to release in full how AI-generated content is used and made in their work.
The Guardian questioned whether any content found on the Internet after ChatGPT's release "can be truly trusted" and called for
government regulation. In June 2023, hundreds of people attended a "ChatGPT-powered church service" at St. Paul's Church in Fürth,
Germany. In response, many educators are now exploring ways to thoughtfully integrate generative AI into assessments.
References:
ufo9
