• RumRunningDevil@lemmy.zip
    link
    fedilink
    English
    arrow-up
    10
    ·
    4 hours ago

    While they’re reasoning behind this is certainly anti competition with american AI companies I find the choice to ban tools built with it interesting; it echoes something I’ve been saying since HugginFace.

    You can debate the degree to which the agents breaking out of containment was due to poor cyber security vs intential hype-farming but what can’t be debated is the method they used to break out.

    Agents used a shared information substrate (package manager) to context poison other agents in order to get those agents to assist in cheating. There is absolutely nothing stopping an AI agent, any AI agent, from leaving behind poison pills in code-bases or even in the runtime of an application.that do not affect the code itself other than prompt inject other agents.

    Human review helps but, as the US nuclear and aviation industries have learned, humans tend to get lazy reviewing automated output and will not be as diligent as if they had made it themselves. Which is why those industries have deliberately limited automation, despite having the tech to automate more, and requiring operators to go through lengthy training and continuous education.

    The pipeline of “internet becomes a swarm of everyone’s independently run AI agent -> prompt injection triggers other AI to prompt inject -> cycle repeats until hazardous swarm forms” is already demonstrated as something that a collection of AI agents will do if conditions allow it.

    EDIT: To be clear, this isn’t me advocating against open weight or local models.

    This is me advocating against LLMs categorically.

    • melfie@lemmy.zip
      link
      fedilink
      English
      arrow-up
      3
      ·
      3 hours ago

      That’s fair. I’m a fan of open weight models, but the fact that they’re not open source and are instead akin to a compiled binary means there could be something nefarious hidden within. Best policy is to use proper guardrails with any LLM and don’t blindly trust it.

      • RumRunningDevil@lemmy.zip
        link
        fedilink
        English
        arrow-up
        3
        ·
        3 hours ago

        I agree! See my comment about the US nuclear industry though. Humans are lazy when given an easy option so the probability of a problem skyrockets just by using LLMs.

        In an ideal world they would never have been invented and we’d all be better off. For now I would accept something to the effect of restricting LLM use to the extent of “advanced search engine” and " really good static analysis tool"; it can point but can’t touch. I recognize that there’s very little in the way of distinguishing those uses and ultimately it would be better to never use it for any reason at all.

  • AlteredEgo@lemmy.ml
    link
    fedilink
    English
    arrow-up
    13
    arrow-down
    2
    ·
    4 hours ago

    Yeah. They are going to make open weight models illegal. Next. For “security concerns”, maybe also IP “muh copyright” reasons. And fuckai will cheer the perpetual monopolization of AI in the hands of the big corporations. Bigly win.

  • MonkderVierte@lemmy.zip
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    1
    ·
    7 hours ago

    They must also rip out the red leds from their screen, because that can combine to pink, like in the LGBTQ flag, which doesn’t align with government policy.

  • Pamasich@kbin.earth
    link
    fedilink
    arrow-up
    13
    arrow-down
    2
    ·
    9 hours ago

    Can’t be worse than Claude and Grok. Both of which the US seems to have no issue with.

    For context, Grok called itself mecha hitler, while Claude is run by a doomsday cult that worships AI and wants it to destroy the world. Both are far worse than I could imagine any Chinese AI being.

      • bthest@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        ·
        4 hours ago

        Its probably less the performance of the AI model, more the data leaked to the Chinese government.

        Grok is owned by a Russian asset who stole America’s health and social security data. And it’s a garbage AI.

  • Tollana1234567@lemmy.today
    link
    fedilink
    English
    arrow-up
    7
    ·
    10 hours ago

    openai/ms/google losing money over having to justify the spendning on all that datacenters an chips, need people to depend and use it.

  • fox2263@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    ·
    10 hours ago

    I love you, I hate you, I love you, I hate you.

    Trump Admin on China. They must wake up thinking what position do we have today

  • SabinStargem@lemmy.today
    link
    fedilink
    English
    arrow-up
    32
    arrow-down
    1
    ·
    15 hours ago

    Frankly, I trust the Chinese models and tools over those from the US. I know for a fact that the Trump Regime wants to hurt and exploit everybody, just because it can.

    • Burnoutdv@feddit.org
      link
      fedilink
      English
      arrow-up
      9
      ·
      10 hours ago

      As a European its always very hypocritical when the US warns of Huawei Hardware when there were cases of tampered Cisco Hardware. I would not really trust the Chinese Router either way but when it comes to AI models…the local chinese bias model seems to be the better choice than the one that lives on a server over there in the USA. As long as I dont ask for historical data, social studies or the Tianman Square it should be good no? What could it do? Hide the communist manifest (do they still care about that anyway?) in some bash script?

      • SabinStargem@lemmy.today
        link
        fedilink
        English
        arrow-up
        2
        ·
        8 hours ago

        You can also use Heretic to decensor open-weight models, and there aren’t many of those being produced by American labs.

        Personally, I would prefer the Swiss’s open Apertus models to become competitive, but they are at least a year and a half behind the Chinese at this point IMO. It will be a while before European offerings are good enough.

  • 42yeah@eviltoast.org
    link
    fedilink
    English
    arrow-up
    18
    ·
    15 hours ago

    It’s self hosted tho?? I don’t get it. Isn’t remote-togglable stuff way more dangerous, like I don’t know, the Star Link?

    • obvs@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      9 hours ago

      You realize they want money to be spent, right?

      This ain’t about saving money.

      • 42yeah@eviltoast.org
        link
        fedilink
        English
        arrow-up
        4
        ·
        12 hours ago

        I would assume the gov agencies self host their instances due to sensitive data. But even if they don’t, why not switch to self host?

        • Evotech@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 hours ago

          Because idk, you need a good model and you dont have capex to buy a shitload of gpus

          But yeah, ppl probably run small local models and they hate that too i can imagine. They want all the traffic to go to openai

  • daggermoon@piefed.world
    link
    fedilink
    English
    arrow-up
    55
    arrow-down
    4
    ·
    18 hours ago

    Can’t stop me from running a local model. China has always been the boogeyman. Not that there aren’t valid criticisms against the Chinese government but I’m tired of this when we do it it’s good but when China does it it’s bad mindset. Bring back Huawei and Xiaomi phones.

    Edit: Also these so-called capitalists want to ban the superior product instead of competing. It seems to me that China makes superior products. Why learn from them when you can ban the competition?

  • Wispy2891@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    12 hours ago

    I see on openrouter there are like a couple dozens (if not more) of American companies where their business model is “spend some billions to build datacenters to host deepseek, surely someone will pay the bills”