Users really trust AI chatbots, some experts say too much.

In a prior study, the researchers had found that users were increasingly turning to chatbots like ChatGPT to get advice on sensitive topics like health, finance, mental health, and employment, so much so that it was “now becoming more like a social partner than just a tool,” lead author Abhisek Dash said.

Building upon that finding, this time around they also looked into what kinds of sensitive information get stored by the chatbot and just how. They found that 52% of the memory entries contained information about users’ psychological states, including their desires, intentions, emotions, and beliefs.

  • minorkeys@sh.itjust.worksEnglish
    5·
    15 hours ago

    Ideally it would be a personal assistant. In reality, it’s a corporate snitch, reporting everything back to the company who will know everything about how to manipulate you into giving up all the power and value of your life.

      • Buffalox@lemmy.worldEnglish
        1·
        14 hours ago

        Did you even read the article?

        The AI memory then uses this to build a detailed profile of the user, a mechanism researchers in a study published earlier this year call “the algorithmic self-portrait.”

        Well technically it’s not even a portrait, it’s what is commonly known as a profile, which is also clearly stated first. And it’s definitely not a “self” profile either.
        It’s very Stupid language to use by the researchers.

        • JustAnotherKay@lemmy.worldEnglish
          1·
          5 hours ago

          I would argue that if you’re being pedantic about the language being used, then why are you implying anyone asked an AI to make a portrait of anyone?

          Obviously, yes, it’s not a self-portrait by the dictionary definitions of “self” and “portrait” but people use “self-portrait” to refer to a description of a person all the time, particularly in settings where emotional intelligence is discussed.

          Yes, I’m being pedantic, but so were you, so it feels fair game. But nothing in the article actually makes it seem as if a portrait is being illustrated other than the metaphorical portrait