xAI Launches Grok 4 to Enhance Reasoning and Multimodal Understanding

xAI has launched Grok 4, its most advanced artificial intelligence model, to SuperGrok and Premium+ subscribers and via its API. The company refined Grok’s reasoning abilities using Colossus, a 200,000-GPU cluster, achieving a six-fold increase in training compute efficiency. The Grok 4 API features a 256,000-context window and integrates real-time data search across X, the web, and news sources, alongside enterprise-grade security certifications, including SOC 2 Type 2, GDPR, and CCPA.

Model Scaling and Architecture

Scaling efforts with Grok 3 involved scaling next-token prediction pretraining to unprecedented levels, resulting in a model with exceptional world knowledge and performance. This work culminated in Grok 3 Reasoning, trained using reinforcement learning to enhance problem-solving accuracy through extended reasoning processes. Observations during its development indicated the potential for substantial scaling of reinforcement learning training.

For Grok 4, this potential was realised through the utilisation of Colossus, xAI’s 200,000 GPU cluster, to refine Grok’s reasoning abilities at pretraining scale. This was facilitated by infrastructure improvements and algorithmic enhancements that increased training compute efficiency by a factor of six, alongside a substantial expansion of verifiable training data beyond mathematics and coding to encompass a broader range of domains. The resulting training run demonstrated consistent performance gains while utilising an order of magnitude more compute than previous iterations.

The Grok 4 API empowers developers with frontier-level multimodal understanding, a 256,000 context window, and advanced reasoning capabilities, supporting the development of AI business applications. It integrates real-time data search across X, the web, and news sources via a newly launched live search API, enabling up-to-date and accurate responses through native tool use. The API offers enterprise-grade security and compliance, including SOC 2 Type 2, GDPR, and CCPA certifications, ensuring robust data protection.

Grok 4 is soon to be available to hyperscaler partners, simplifying enterprise deployment for innovative AI solutions. xAI intends to continue scaling reinforcement learning to unprecedented levels, building on Grok 4’s advancements. Future development will focus on expanding the scope from verifiable rewards in controlled environments to tackling complex, real-world problems, enabling models to learn and adapt in dynamic settings. Ongoing improvements to multimodal capabilities will integrate vision, audio, and other modalities for more intuitive interactions.

Enhanced Capabilities and API Access

The Grok 4 API provides developers with frontier-level multimodal understanding, a 256,000 context window, and advanced reasoning capabilities. It integrates real-time data search across X, the web, and news sources via a newly launched live search API, enabling up-to-date and accurate responses through native tool use.

The API offers enterprise-grade security and compliance, including SOC 2 Type 2, GDPR, and CCPA certifications, ensuring robust data protection. Grok 4 is soon to be available to hyperscaler partners, simplifying enterprise deployment for innovative AI solutions.

Future development will focus on expanding the scope of reinforcement learning from verifiable rewards in controlled environments to tackling complex, real-world problems, enabling models to learn and adapt in dynamic settings. Ongoing improvements to multimodal capabilities will integrate vision, audio, and other modalities for more intuitive interactions, with a continued focus on creating smarter, faster, and more efficient models.