• Victor@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    7 hours ago

    They know whatever science they were trained on. They could be trained on 1 + 1 = 3 and report that as the truth.

  • Humanius@lemmy.world
    link
    fedilink
    English
    arrow-up
    46
    ·
    23 hours ago

    This has been a consistent problem with AI chatbots. How do people keep being surprised by this?

    Is climate change real?
    - Yes climage change is real, and here is the proof.
    I don’t think that’s right.
    - You’re absolutely right! It’s all a hoax and a conspiracy!

  • DarkCloud@lemmy.world
    link
    fedilink
    English
    arrow-up
    38
    arrow-down
    2
    ·
    23 hours ago

    It’s almost like they’re stocastic parrots just being directed into different pools of content depending on what users say - or something.

  • TrackenDaKracken@lemmy.world
    link
    fedilink
    English
    arrow-up
    13
    ·
    22 hours ago

    Better to link to the source, than NYT:

    https://unesdoc.unesco.org/ark:/48223/pf0000400048?posInSet=13&queryId=N-c7820124-26f6-40cc-8c66-0375e501acaf

    Tested on a single measure, such as whether a carbon tax will reduce projected warming, the models generally answer correctly, reaching up to 94.5% accuracy. Yet when two policies are combined, accuracy collapses to 33.8%. Asked whether two combined policies achieve more, less, or the same, models scored, identical to random guessing.

    Even the largest frontier systems show no improvement on this task. Since meaningful climate action relies on overlapping policies working together, AI outputs cannot replace validated simulation models or expert analysis.