• perturbedstarstuff@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    26 minutes ago

    Well duh.

    If it had any intelligence it’d be over. For better or worse.
    It’d be humanity’s last invention.

    You wouldn’t get news reports that the machine has gotten 30% smarter over the last three months or something.
    It’d be like waiting at a station platform and then getting knocked over by a gust of wind as the train disappears over the other horizon.

  • medem@lemmy.wtf
    link
    fedilink
    English
    arrow-up
    13
    ·
    6 hours ago

    Roughly citing Taleb: in a way, we have managed, indeed, to create the utopia that people and computers think alike.

    …though we didn’t manage to bring about that machines think like people, but exactly the opposite.

    • Ianthe__Tridentarius@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 hour ago

      Deep learning is an actual term, it’s not just made up nonsense. It’s “deep” because the machine learning is filtered through multiple layers between the data input and algorithm output, versus “shallow” learning, which has only one or two layers between input and output.

  • eicker@lemmy.worldOP
    link
    fedilink
    English
    arrow-up
    65
    arrow-down
    4
    ·
    12 hours ago

    AI can write a convincing essay about fire, but it has never burned a finger. Pearl’s point is less that these systems are useless and more that fluency gets mistaken for understanding. Silicon Valley saw a spectacular autocomplete and immediately started selling it as a digital philosopher. The marketing department achieved AGI first.

  • red_tomato@lemmy.world
    link
    fedilink
    English
    arrow-up
    16
    arrow-down
    7
    ·
    9 hours ago

    The quote is from 2018. Back then most neural networks were still mostly single purpose - far from today’s all-in-one package. Text generation was barely working at all.

    • Wildmimic@anarchist.nexus
      link
      fedilink
      English
      arrow-up
      29
      arrow-down
      1
      ·
      7 hours ago

      The underlying problems are still the same. Transformer models do not have an inkling of intelligence, and they still don’t have an internal model of the world around them. Creativity is also non-existent, which is a hard requirement if you want these things to actually create something new instead of rehashing what already exists.

        • Wildmimic@anarchist.nexus
          link
          fedilink
          English
          arrow-up
          9
          arrow-down
          1
          ·
          5 hours ago

          I am not a non-user. I run local models, because i am a tech enthusiast, and am watching the space closely. I will never spend a cent or use the offerings of OpenAI and Anthropic tho - i will not finance the people who are providing the tools to bind us all.

          • redballooon@lemmy.world
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            7
            ·
            4 hours ago

            Open weight models are not far behind and good enough to get software developers jobless, but there is a huge difference in what you can do with 1M context and 500token/sec or 60k context and 40token/sec.

            • Wildmimic@anarchist.nexus
              link
              fedilink
              English
              arrow-up
              6
              ·
              4 hours ago

              Sure! End the AI Bubble and i’ll go ahead and buy a bunch of H200’s.

              But for real, if you structure your tasks well, you can get by for most things with local models, and for a small business in IT, investing in dedicated hardware you own is a smart move. The employer of an acquaintance of mine bought some inference hardware for his 5 engineer business, and they rely mostly on that. Around 80% of all tasks are done by a GLM5.3 model, and while they currently still use Claude for some things, the percentage of external inference has dropped dramatically in the last months, because people have adapted on how to structure tasks for the local model.

              Noone can explain to me how Claude, OpenAI and the NeoClouds plan to become profitable businesses when you can reduce inference costs by 90% by getting your own inference - and it’s not even that hard to set up. if you already have IT staff for your inhouse stuff, they will probably manage.

              • BenevolentOne@infosec.pub
                link
                fedilink
                English
                arrow-up
                3
                arrow-down
                1
                ·
                3 hours ago

                Someone will come up with a decent accelerator eventually. Right now we’re in the pre-soundblaster days where audio sythesis is being done by the CPU but for neural networks.

                We’re repurposing graphics hardware, these are primitive times.

                Also, there, I explained it for you.

                • Wildmimic@anarchist.nexus
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  3 hours ago

                  I have to disagree here. We are on the absolute edge of current physics regarding miniaturization - without a massive breakthrough in quantum physics on how we can use subatomic particles for transistors we are nearing the maximum we can shrink these circuits. These are already optimized for exactly this kind of math - a Vera Rubin will never be able to render a game. Also, the mathematical basis (a ton of matrix multiplication) does not give much hope that we can replace all this math with something simpler. Maybe a radical redesign taking a completely different approach can help, but i wouldn’t count on that - it would mean reinventing the whole damn thing on a completely new base.

                  I can’t really see any explanation when i take the above into account.

      • robert@piefed.ca
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        19
        ·
        edit-2
        6 hours ago

        LLMs have made a number of significant mathematical discoveries in the past year. Some of them were problems that had significant prize money attached and were considered some of the biggest open problems in mathematics. This has been so disruptive that Terrance Tao, who is widely considered to be the worlds greatest living mathematician, has spent considerable time publicly grappling with how the field of mathematics should proceed now that AI is in the picture (for example, he thinks less importance should be placed on discovery, since that is now trivial, and more emphasis should be placed on understanding).

        I am sympathetic to criticisms of LLMs, but these criticisms need to be grounded in reality. We can’t just put our head in the sand. To say that AI has “not an inkling of intelligence” is just factually inaccurate at this point.

        • Wildmimic@anarchist.nexus
          link
          fedilink
          English
          arrow-up
          17
          arrow-down
          4
          ·
          6 hours ago

          And we will never learn how many of these discoveries are born out of simple theft.

          Statistics do not have intelligence.

          • robert@piefed.ca
            link
            fedilink
            English
            arrow-up
            8
            arrow-down
            21
            ·
            6 hours ago

            You do not simply steal groundbreaking mathematical theorems. These are open problems that haven’t been solved, so prior to these AI proofs no solution had been discovered, so there was nothing there to steal.

            • emmy5482@quokk.au
              link
              fedilink
              English
              arrow-up
              12
              arrow-down
              2
              ·
              6 hours ago

              Dunno about that. Cause they did steal them. Assuming their solutions are even correct, cause nobody has done peer review on them, because LLMs can’t publish and anthropic or whoever refuses to engage with the academic community.

              All this and there’s a lot of talk about stealing results among maths academics right now. Including a lack of attribution.

              So yeah. They probably did steal that shit

              • red_tomato@lemmy.world
                link
                fedilink
                English
                arrow-up
                6
                arrow-down
                11
                ·
                6 hours ago

                I doubt they stole the results of quasi Riemann hypothesis, unique games conjecture and exponential time hypothesis.

                • emmy5482@quokk.au
                  link
                  fedilink
                  English
                  arrow-up
                  9
                  arrow-down
                  2
                  ·
                  6 hours ago

                  Doubt all you like. But the idea a company stole something is hardly controversial or unlikely.

                • Wildmimic@anarchist.nexus
                  link
                  fedilink
                  English
                  arrow-up
                  5
                  arrow-down
                  2
                  ·
                  edit-2
                  5 hours ago

                  There have been accusations by mathematicians that OpenAI used their (non-public, but fed to OpenAIs LLM) methods. It would have been very possible to take what they already did and throw as much compute as they had available at it as soon as the hard parts were done to race ahead at the final stretch.

                  LLMs fail badly at trying to do original research. There was a study where 4 not-yet published papers were used - they gave the LLM all the data the researchers had at the beginning of the study. The LLMs were not successful at reproducing anything of it.

                  These things are not intelligent. Just because they can remix existing content does not mean they have creativity. And they miss the entire “physicality”-aspect of human existence, which is a central part of how intelligence develops - by interacting with the world and creating an internal model of how it works. They do not have a sense of self - a bunch of matrix multiplication will never achieve this.

                  They can’t be creative, because for creativity (and therefor intelligence - these two things go hand in hand) you must be able to have thoughts that have never been thought in a specific context. All these transformer models do is to remix existing thoughts - this looks a bit like intelligence, but the contained data can never be expanded outside of training a new model at a large expense. Intelligence also means to be able to learn and adapt - outside of creating a text file where LLMs can store their non-original output and reading it again, they do not have this capability, especially the “adaptation” part.

                  Do not humanize these mathematical constructs. This thinking is what got us into the current mess to begin with.

                  I personally like the technology aspect of Transformer Models a lot! But what is done with it is not in the interest of humanity - at all. Just this morning we all were able to read in the news that Anthropic uses its LLM to do a “Minority Report” and contact the police when their LLM, which is being used to scrape socials and categorize people depending on how much “Threat” they pose, tells them someone might do something illegal in the future.

                  This is the real usage of this technology. We are nearing a future where our every step, action, word, and even thoughts in some cases (through the wonders of profiling) are ingested by one of these things, and we will get sorted into bins according to threat level and how much money we can provide them with. Tip your toe over the line by saying that this sucks ass, and find yourself in your friendly neighbourhood reeducation gulag.

        • bthest@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          5
          ·
          4 hours ago

          LLMs have made a number of significant mathematical discoveries in the past year.

          No.

          • Feathercrown@lemmy.world
            link
            fedilink
            English
            arrow-up
            5
            arrow-down
            1
            ·
            3 hours ago

            Come on now. You can hate AI like most of us on lemmy but if you do not align your views with reality you will gradually slide into delusion.

    • technocrit@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      2 hours ago

      There’s been no qualitative change ever. Computers are computing today just like in 2018 and like 1960.

  • baltakatei@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    1
    arrow-down
    2
    ·
    9 hours ago

    My conclusion is that they’re auto-indexing books capable of rapidly temporarily integrating and regurgitating knowledge they store if you inject electricity into them, but still just books in the end after you cut their power.