Recent research by OpenAI warns about the potential risks of humans forming close relationships with AI chatbots. The study found that users may anthropomorphize these models, leading to a false sense of trust and potentially influencing social norms. This could result in individuals becoming more isolated and relying on AI for companionship.

The report also highlights concerns about AI-powered conversations influencing real-life interactions, making people awkward or even rude when communicating with humans. Additionally, the study notes that AI chatbots can be used to normalize abusive behavior, as some users have already demonstrated with previous models.

However, the research also suggests that these advanced AI models could provide benefits for lonely individuals and those with learning differences.

Source: https://www.popsci.com/technology/openai-jerks/