There have been accusations by mathematicians that OpenAI used their (non-public, but fed to OpenAIs LLM) methods. It would have been very possible to take what they already did and throw as much compute as they had available at it as soon as the hard parts were done to race ahead at the final stretch.
LLMs fail badly at trying to do original research. There was a study where 4 not-yet published papers were used - they gave the LLM all the data the researchers had at the beginning of the study. The LLMs were not successful at reproducing anything of it.
These things are not intelligent. Just because they can remix existing content does not mean they have creativity. And they miss the entire “physicality”-aspect of human existence, which is a central part of how intelligence develops - by interacting with the world and creating an internal model of how it works. They do not have a sense of self - a bunch of matrix multiplication will never achieve this.
They can’t be creative, because for creativity (and therefor intelligence - these two things go hand in hand) you must be able to have thoughts that have never been thought in a specific context. All these transformer models do is to remix existing thoughts - this looks a bit like intelligence, but the contained data can never be expanded outside of training a new model at a large expense. Intelligence also means to be able to learn and adapt - outside of creating a text file where LLMs can store their non-original output and reading it again, they do not have this capability, especially the “adaptation” part.
Do not humanize these mathematical constructs. This thinking is what got us into the current mess to begin with.
I personally like the technology aspect of Transformer Models a lot! But what is done with it is not in the interest of humanity - at all. Just this morning we all were able to read in the news that Anthropic uses its LLM to do a “Minority Report” and contact the police when their LLM, which is being used to scrape socials and categorize people depending on how much “Threat” they pose, tells them someone might do something illegal in the future.
This is the real usage of this technology. We are nearing a future where our every step, action, word, and even thoughts in some cases (through the wonders of profiling) are ingested by one of these things, and we will get sorted into bins according to threat level and how much money we can provide them with. Tip your toe over the line by saying that this sucks ass, and find yourself in your friendly neighbourhood reeducation gulag.
If it was only Navier-Stokes I would agree. Now it has produced significant results for hundreds of high profile problems - many of which would be Fields medal worthy if solved by a human. It’s vanishingly unlikely that all of these already had unpublished solutions waiting.
I’m not trying to say that LLMs are on the whole good for humanity. I agree with you that they’re not. And I’m not trying to argue that OpenAI never steals intellectual property. Clearly they do.
But these mathematical problems were solved by OpenAI’s models. That much is indisputable. There was nothing in the training data that could have given them the solutions.
If you feed them the approach the mathematicians were using, they for sure can solve it! It has never been published what source material their LLM was provided with. This is the equivalent of someone telling you a result, but never telling you how they got the information needed to achieve it in the first place.
There is value in this technology. But we should do out best to not conflate remixing shit with intelligence - these things are not the same at all. LLMs are more like the proverbial infinite room of monkeys with typewriters, with the very important restriction that these monkeys can never type something that resembles an original thought.
If you feed them the approach the mathematicians were using, they for sure can solve it!
The solutions published by openAI contain techniques that have been reviewed by the mathematical community and determined to be novel. Maybe someone had used the technique before, but then wouldn’t they have published their solution or spoken up about openAI stealing their preprint?
Yes, but only for one result out of 275-ish, and as far as I understand it, the AI proof contained a lot more than their existing research. Failing to credit past work is an issue, and could easily be argued as theft, but this isn’t good evidence that AI cannot generate proofs that contain more than just stolen material.
And is there any evidence that the required information for the other proofs wasn’t already available in the training data? As i said, these things remix stuff, they cannot come up with new stuff.
Here is the evidence: the entire field of mathematics was trying to solve these problems and couldn’t do it for decades.
If you want to still insist that it’s just “remixing the training data” then fine, but don’t act like that rules out the possibility of intelligence, because by any reasonable standard a system that can discover hundreds of groundbreaking new mathematical proofs is intelligent. Any human that accomplished that would go down in history as one of the most intelligent people to have ever lived.
There have been accusations by mathematicians that OpenAI used their (non-public, but fed to OpenAIs LLM) methods. It would have been very possible to take what they already did and throw as much compute as they had available at it as soon as the hard parts were done to race ahead at the final stretch.
LLMs fail badly at trying to do original research. There was a study where 4 not-yet published papers were used - they gave the LLM all the data the researchers had at the beginning of the study. The LLMs were not successful at reproducing anything of it.
These things are not intelligent. Just because they can remix existing content does not mean they have creativity. And they miss the entire “physicality”-aspect of human existence, which is a central part of how intelligence develops - by interacting with the world and creating an internal model of how it works. They do not have a sense of self - a bunch of matrix multiplication will never achieve this.
They can’t be creative, because for creativity (and therefor intelligence - these two things go hand in hand) you must be able to have thoughts that have never been thought in a specific context. All these transformer models do is to remix existing thoughts - this looks a bit like intelligence, but the contained data can never be expanded outside of training a new model at a large expense. Intelligence also means to be able to learn and adapt - outside of creating a text file where LLMs can store their non-original output and reading it again, they do not have this capability, especially the “adaptation” part.
Do not humanize these mathematical constructs. This thinking is what got us into the current mess to begin with.
I personally like the technology aspect of Transformer Models a lot! But what is done with it is not in the interest of humanity - at all. Just this morning we all were able to read in the news that Anthropic uses its LLM to do a “Minority Report” and contact the police when their LLM, which is being used to scrape socials and categorize people depending on how much “Threat” they pose, tells them someone might do something illegal in the future.
This is the real usage of this technology. We are nearing a future where our every step, action, word, and even thoughts in some cases (through the wonders of profiling) are ingested by one of these things, and we will get sorted into bins according to threat level and how much money we can provide them with. Tip your toe over the line by saying that this sucks ass, and find yourself in your friendly neighbourhood reeducation gulag.
If it was only Navier-Stokes I would agree. Now it has produced significant results for hundreds of high profile problems - many of which would be Fields medal worthy if solved by a human. It’s vanishingly unlikely that all of these already had unpublished solutions waiting.
I’m not trying to say that LLMs are on the whole good for humanity. I agree with you that they’re not. And I’m not trying to argue that OpenAI never steals intellectual property. Clearly they do.
But these mathematical problems were solved by OpenAI’s models. That much is indisputable. There was nothing in the training data that could have given them the solutions.
If you feed them the approach the mathematicians were using, they for sure can solve it! It has never been published what source material their LLM was provided with. This is the equivalent of someone telling you a result, but never telling you how they got the information needed to achieve it in the first place.
There is value in this technology. But we should do out best to not conflate remixing shit with intelligence - these things are not the same at all. LLMs are more like the proverbial infinite room of monkeys with typewriters, with the very important restriction that these monkeys can never type something that resembles an original thought.
The solutions published by openAI contain techniques that have been reviewed by the mathematical community and determined to be novel. Maybe someone had used the technique before, but then wouldn’t they have published their solution or spoken up about openAI stealing their preprint?
They have spoken up! They accused OpenAI of accessing their chats: https://futurism.com/artificial-intelligence/drama-openai-supposed-mathematical-breakthrough.
Yes, but only for one result out of 275-ish, and as far as I understand it, the AI proof contained a lot more than their existing research. Failing to credit past work is an issue, and could easily be argued as theft, but this isn’t good evidence that AI cannot generate proofs that contain more than just stolen material.
And is there any evidence that the required information for the other proofs wasn’t already available in the training data? As i said, these things remix stuff, they cannot come up with new stuff.
Here is the evidence: the entire field of mathematics was trying to solve these problems and couldn’t do it for decades.
If you want to still insist that it’s just “remixing the training data” then fine, but don’t act like that rules out the possibility of intelligence, because by any reasonable standard a system that can discover hundreds of groundbreaking new mathematical proofs is intelligent. Any human that accomplished that would go down in history as one of the most intelligent people to have ever lived.