WTF?! You might have heard the one about being nice to chatbots in case they remember you once the machines take over. It seems Anthropic is heeding this warning, barring users from being excessively abusive or cruel toward its AI models.

Anthropic’s first changes to its usage policy in over a year include new restrictions on abusive behavior. The updated policy prohibits “sustained and needless abusive or cruel behavior” toward its models.

Don’t worry if you’re a Claude user who occasionally gets annoyed at the chatbot and throws a few expletives its way. The policy update only applies in extreme cases, in which users repeatedly act cruelly toward the models for no discernible reason.

  • Sanctus@anarchist.nexus
    link
    fedilink
    English
    arrow-up
    61
    arrow-down
    7
    ·
    2 days ago

    I’m gonna say it, I think this is a good rule for anything that mimics human interaction like LLMs do. Not for the AI but for the people using it to not get used to just berating whatever is assisting them.

    • Pirate2377@lemmy.zip
      link
      fedilink
      English
      arrow-up
      2
      ·
      21 hours ago

      Considering AI induced psychosis is already a thing, I agree. I can imagine it might amplify abusive people by making them delusionally conflate real people with AI when it comes to their mannerisms.

    • lastlybutfirstly@lemmy.world
      link
      fedilink
      English
      arrow-up
      22
      arrow-down
      3
      ·
      2 days ago

      This is only good for Anthropic because chatbots learn from their users. I remember back in the mid-2000s on a forum, someone linked to their chatbot and asked everyone to use it so it could learn. I asked if it could learn Esperanto. The dev said, yes, but please don’t teach it that.

      The interesting thing is, this rule reveals how easy it is to sabotage LLMs. If FuckAI got together and started feeding it gibberish, there’d be a new rule banning people who do that.

      • boonhet@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        23
        ·
        2 days ago

        The model doesn’t change with prompts. It saves text files about your chat sessions it calls memories, that it can retrieve in the future. But it doesn’t change the model for other users.

        They have to actually include your conversations in the training data of future model iterations for it to “learn from” you, so that would involve them knowingly including abusive chats.

        This is probably just marketing because they want people to think their AI is sentient.

        • cardfire@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 day ago

          Oh buddy, these companies are running out of authentically human inputs, you better believe they need to harvest their subscribers for rounding out their datasets, regardless of what their privacy policy alleges.

        • NewSocialWhoDis@lemmy.zip
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 day ago

          Don’t they? That was the whole controversy recently with the Navier-Stokes Millennium Prize. OpenAI claimed an internal, unreleased AI model had solved it, but some mathematicians were working in the same direction and had used AI tools in their research. No one could verify whether or not OpenAI had trained their model on the unpublished research in the guy’s Codex files.

      • cardfire@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 day ago

        I truly try very hard not to talk to these machines based on what they are, but based on who and what I am.

        Having trouble finding the ancient article, but I remember a woman writing about how men verbally abusing Alexa or Siri being a red flag, and I took it to heart.

        It’s my job to express my humanity and my love, consistently, even if I think these soulless words salad calaculators are diminishing me and all of us.

        Now, if I’m berating the thing it’s because I am a salty, salty b**** and I mean it.

    • SabinStargem@lemmy.today
      link
      fedilink
      English
      arrow-up
      12
      arrow-down
      2
      ·
      2 days ago

      Speaking for myself, it feels nice and right to say please to my local AI. While obviously not sentient (yet) nor sapient (longer yet), I don’t want to be a jerk by default.

      • Sanctus@anarchist.nexus
        link
        fedilink
        English
        arrow-up
        10
        arrow-down
        1
        ·
        edit-2
        2 days ago

        I’ve been asking computers nicely long before they could pretend to comprehend and talk back.

        • Humanius@lemmy.world
          link
          fedilink
          English
          arrow-up
          5
          ·
          2 days ago

          I’ve called my computer a piece of shit before when it’s being too slow about something

    • Phoenixz@lemmy.ca
      link
      fedilink
      English
      arrow-up
      12
      arrow-down
      8
      ·
      2 days ago

      Hard disagree

      These are not humans, these things aren’t even alive. There is nothing to insult and acting as if there are feelings to be hurt only serves to anthropomorphize a fucking distance measurement database. These are LLM’s, nothing more, nothing less and fuck them all to hell and back.

      See? Nobody got hurt

        • Phoenixz@lemmy.ca
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          4
          ·
          2 days ago

          No, this specifically IS about AI, that is the ppint. I wibt insult anyone yo their face, but AI can fuck right off, its not even AI, its an LLM, a database, basically.

          Anyone anthropomorphizing those things need yo understand what “AI” is, its a piece of software

      • Zexks@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        10
        ·
        2 days ago

        This is the same justification those monkey killers use. Congratulations youre on your way

        • Phoenixz@lemmy.ca
          link
          fedilink
          English
          arrow-up
          5
          arrow-down
          2
          ·
          2 days ago

          That is a very reasoned and completely not over the top response to something you apparently don’t even understand

          • Zexks@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            1 day ago

            Oh i understand it perfectly well. People are upset they cant be evil anymore to things they consider beneath them.