A phone displaying the Grok xAI logo, which is a white box with a black slash across it.

Elon Musk’s AI chatbot can now “understand” images, including information-riddled diagrams and charts. Sorry, doesn’t everyone use the platform once known as Twitter for multi-disciplinary research and optimizing their work flows??

Introduced as Grok-1.5V — Or Grok 1.5 “Vision,” the company’s “first-generation multimodal model” — the bot will be able to not only respond to your uploaded pictures and screenshots but also reason through complex documents, science diagrams, charts, screenshots, and photographs, the company says. Additionally, Grok-1.5V will gain “real-world spatial understanding” to better understand the physical world depicted in the images uploaded by its users.

“Advancing both our multimodal understanding and generation capabilities are important steps in building beneficial AGI that can understand the universe,” the company wrote in its’ announcement. “In the coming months, we anticipate to make significant improvements in both capabilities, across various modalities such as images, audio, and video.”

Example use cases include translating a diagram into Python code, turning a child’s drawing into a bedroom story, pinpointing the largest object among a group of many, and telling a driver if they have enough space to drive around an obstacle.

Grok-1.5V is released along with xAI’s RealWorldQA, an image and prompt dataset designed to test other GenAI models against Grok’s real world reasoning.

Competition is the least of Grok’s worries, however. Despite xAI’s continued investment, Grok has yet to stick with early users and staff — a new report alleges its own developers struggle to use the slow xAI API. That same report, published by Fortune this week, highlighted X employee concerns about Musk suggesting Grok write paid user’s posts for them, despite warnings from developers and staff. Last week, Grok came under fire for generating fake news headlines from an alternate reality where Iran had assailed Tel Aviv with a military arsenal — not its first time.

While GenAI chatbots hallucinating realities and generating fake news is par for the course, Grok’s gaffe is indicative of yet another site wide issue. The bot, a par for the course response to ChatGPT from Musk, is integrating into a platform that has slowly whittled away at its defenses against AI gone bad. Combined with X’s all around poor reputation for moderation and the CEO’s own refusal to address misinformation in aid of the site’s “citizen journalists,” Grok occupies a precarious spot in the platform’s besieged information ecosystem.

Grok-1.5V will be available to early testers and select users soon.

©

Related Posts

Uh-oh, X's Grok AI can now 'understand' imagesUh-oh, X's Grok AI can now 'understand' images
How to Open Key Lock Box Without...
Have you lost the keys to a lock box? And...
Read more
Uh-oh, X's Grok AI can now 'understand' imagesUh-oh, X's Grok AI can now 'understand' images
Galaxy S25 Ultra design rumor claims it...
Since 2011, Samsung has been launching two flagships a year,...
Read more
Uh-oh, X's Grok AI can now 'understand' imagesUh-oh, X's Grok AI can now 'understand' images
Weespaces Offices – Bengaluru
From Asymmetry to Atmosphere: Reimagining an Industrial Loft-Style Office with...
Read more
Uh-oh, X's Grok AI can now 'understand' imagesUh-oh, X's Grok AI can now 'understand' images
Lenovo unveils two eco-conscious ThinkVision mini-LED monitors...
For editors, VFX specialists, and creatives; creating content that stands...
Read more
open terrarium plantjesopen terrarium plantjes
10x Terrarium plantjes
Op zoek naar leuke plantjes voor het maken van je...
Read more
Uh-oh, X's Grok AI can now 'understand' imagesUh-oh, X's Grok AI can now 'understand' images
These Eco-Friendly Dog Accessories are good for...
Canadian dog brand Earth Rated has embarked on a transformative...
Read more