xAI Grok at a glance
xAI's first assistant drew on real-time information from X and ran on Grok-1, which xAI said beat GPT-3.5 and LLaMA 2 70B on MMLU, HumanEval, GSM8k and MATH.
What changed with xAI Grok
xAI announced Grok on November 3, 2023, as an early beta for a limited number of US users through a waitlist. Its distinguishing feature was real-time knowledge of the world through the X platform.
The assistant ran on Grok-1, which xAI said it developed over about four months. xAI reported 73.0% on MMLU and 63.2% on HumanEval, ahead of GPT-3.5 and LLaMA 2 70B on its chosen benchmarks but behind GPT-4. An earlier 33B prototype, Grok-0, had come first.
Where to compare xAI Grok
Independent leaderboards and official resources for comparing this model yourself. Rankings change often; each site shows its own current data.
General leaderboards
Official resources
Why xAI Grok matters for businesses
For businesses, Grok was mostly a signal at launch: another well-funded lab had entered the frontier race. Its value for brand and trend monitoring came from the live X data, which also meant answers needed fact-checking.
Sources for this story
- Announcing Grok (opens in a new tab)Official
xAI · x.ai
- Grok-1 model page (opens in a new tab)Benchmark
Artificial Analysis · artificialanalysis.ai
Last verified: . IA Compa summarizes public announcements for business readers. We are not affiliated with the companies mentioned. Always confirm details, pricing, and availability with the official source.
- #llm
- #xai
- #grok
