The AI pre-training age will soon come to an end — OpenAI co-founder

As a researcher with a background in artificial intelligence and machine learning, I find myself intrigued by the predictions of Ilya Sutskever at the NeurIPS 2024 conference. The concept of AI superintelligence is not new, but his argument about data being the fossil fuel of AI is an interesting perspective that resonates with my experiences in this field.

At the NeurIPS 2024 conference held in Vancouver, Canada, OpenAI co-founder Ilya Sutskever presented a talk suggesting that the era of artificially intelligent systems being pre-trained is coming to an end, and predicting the emergence of an AI superintelligence.

According to Sutskever, increasing computing power through better hardware, software, and machine-learning algorithms outpaces the total amount of data available for AI model training. The AI researcher likened data to fossil fuels, which will eventually run out. Sutskever said:

“Data is not growing because we have but one internet. You could even say that data is the fossil fuel of AI. It was created somehow, and now we use it, and we’ve achieved peak data, and there will be no more — we have to deal with the data that we have.”

According to a co-founder of OpenAI, it’s expected that advanced AI capabilities like agentic AI, synthetically generated data, and quick computation based on inference times are the future developments in artificial intelligence. These advancements could ultimately lead to the emergence of an intelligent AI system surpassing human intelligence.

AI agents take the crypto world by storm

AI agents surpass typical chatbot capabilities, taking independent decisions and are gaining prominence in the cryptocurrency world, particularly with the emergence of AI-themed meme coins and advanced language models such as Truth Terminal.

Truth Terminal gained widespread popularity when it started endorsing a meme-based cryptocurrency called Goatseus Maximus (GOAT). This digital coin garnered significant interest, leading to a market value of approximately $1 billion, capturing the attention of both individual investors and venture capitalists.

Google’s DeepMind research facility recently introduced Gemini 2.0 – a sophisticated AI model designed to operate AI-controlled entities.

As per Google’s information, agents constructed using the Gemini 2.0 structure are expected to aid in intricate duties like managing interactions across multiple websites and making logical deductions.

Progress in AI systems capable of autonomous action and thinking will pave the way for AI to surpass the issue of data misinterpretations, more simply put as data hallucinations.

AI hallucinations may stem from faulty data sources, as well as the practice of employing previously trained language models (LLMs) to educate newer ones. This approach can eventually lead to a decrease in performance quality over time.

Read More

2024-12-15 23:16