Can AI predict crypto prices? We tested an open model 120 times
Also in: Nederlands Français Español Português Deutsch Türkçe Bahasa Indonesia
Not reliably. In our test of 120 past moments, the open-source Kronos model got the 24-hour direction right 68 times (57%). A coin flip gets 50%. And simply guessing "the price stays the same" was closer on average than the AI.
Ads for "AI trading bots" promise a lot. We wanted a fair test you can check yourself, so we used a real research model and only forecast moments from the past, where we already know what happened.
How the test works
- We take public hourly price data (no account, no keys) for six coins: BTC, ETH, SOL, DOGE, XRP and PEPE.
- We pick 20 moments per coin. The model sees the 360 hours before each moment and nothing after it.
- Kronos-small, an open model trained on charts from many exchanges, writes the next 24 hours, six times.
- We compare its middle guess with what really happened, and with a lazy "no change" guess.
The result
- Direction right: 68 of 120 moments (57%).
- Average miss of the AI: about 4.4% of the price after 24 hours.
- Average miss of "no change": about 2.9%. The lazy guess won.
- The numbers move a little every week, because a script runs the test again with fresh moments.
Why this matters
57% sounds like an edge, but on 120 moments it can easily be luck, and trading fees eat small edges fast. Markets react to news that is not in any chart. Anyone selling a sure AI prediction is selling a story.
Try to beat the AI yourself
In the Kronos Lab you see a real past chart, you guess higher or lower first, then the model guesses, then you see what really happened. Want to learn to read the chart yourself? Start with Chart School.
Past moments only. No live forecasts, no signals, never about $MAIGA. Not financial advice.
Questions
Did the AI beat a coin flip?
Slightly: 57% right on direction versus 50% for a coin flip. On only 120 moments that can be luck.
Which model was used?
Kronos-small, an open-source model by Shi Yu and colleagues (MIT license), run on CPU in GitHub Actions.
Can I see the raw results?
Yes. The Kronos Lab page shows every moment, the forecast band and the real price, per coin.