The Industry Reacts to Grok-3 - SPEED is all you need
Grock 3 Release and Industry Reactions
Overview of Grock's Mission
- Grock 3 has been released, receiving strong reactions in the AI industry, currently ranking as the number one model on LM Arena leaderboards based on human ratings.
- The mission of xAI, inspired by Elon Musk's vision from "The Hitchhiker's Guide to the Galaxy," is to understand profound questions about the universe, including lifeβs meaning and its end.
Impressive Capabilities of Grock 3
- An example shared shows Grock creating a simplified version of the game "Portal," demonstrating impressive capabilities in game design.
- The Colossus supercomputer was set up in just 122 days using 100 H100 Nvidia GPUs, showcasing significant powerβ10 times that of Grock 2.
Technical Achievements
- The data center housing these GPUs is notable for being water-cooled rather than air-cooled, which is uncommon for systems of this size.
- External generators were installed to quickly power up the system due to time constraints.
Early Access Feedback
- Andre Karpathy provided feedback after early access to Grock 3, noting it performed well on various tasks but struggled with more complex challenges compared to top models like OpenAIβs strongest offerings.
- He highlighted that while Grock could solve some problems effectively, it failed at others where competitors excelled.
Comparative Analysis and Pricing
- Karpathy summarized that Grock 3 feels competitive with OpenAI's models but is priced significantly lower at $40 per month compared to $200 for OpenAIβs strongest model.
- Despite starting from scratch a year ago, Grock has made remarkable progress in performance and capability.
Additional Features and User Interaction
- A prompt example demonstrated how users can create visual simulations using p5.js through Grockβs capabilities.
Grock 3 and AI Advancements
Voice Mode Anticipation
- Elon Musk mentions the upcoming feature "voice mode," which is expected to be available soon. The anticipation for this feature highlights its potential impact on user interaction with AI models.
- Lex Fridman, who has early access, discusses three versions of AI models: Grock 3, Grock 3 Mini, and Claude 3.5, indicating a competitive landscape in AI development.
Performance Comparison
- A performance comparison reveals that Grock 3 does not perform well in a physics simulation test due to the absence of a ball in the middle. In contrast, Claude 3.5 shows better results.
- Robert Scoble emphasizes the importance of learning speed in AI, noting that XAI (Explainable AI) is advancing faster than other models.
Industry Recognition
- The CEO of Replit praises Grock 3 as state-of-the-art for free models, highlighting its rapid development and impressive data center capabilities within just one year.
- Alexander Wang from Scale AI expresses optimism about future partnerships with Grock 4 and beyond, while Beth Jos commends the dedicated team behind Grock 3's success.
Scaling Laws Validation