A phone displaying the Grok xAI logo, which is a white box with a black slash across it.

Elon Musk’s AI chatbot can now “understand” images, including information-riddled diagrams and charts. Sorry, doesn’t everyone use the platform once known as Twitter for multi-disciplinary research and optimizing their work flows??

Introduced as Grok-1.5V — Or Grok 1.5 “Vision,” the company’s “first-generation multimodal model” — the bot will be able to not only respond to your uploaded pictures and screenshots but also reason through complex documents, science diagrams, charts, screenshots, and photographs, the company says. Additionally, Grok-1.5V will gain “real-world spatial understanding” to better understand the physical world depicted in the images uploaded by its users.

“Advancing both our multimodal understanding and generation capabilities are important steps in building beneficial AGI that can understand the universe,” the company wrote in its’ announcement. “In the coming months, we anticipate to make significant improvements in both capabilities, across various modalities such as images, audio, and video.”

Example use cases include translating a diagram into Python code, turning a child’s drawing into a bedroom story, pinpointing the largest object among a group of many, and telling a driver if they have enough space to drive around an obstacle.

Grok-1.5V is released along with xAI’s RealWorldQA, an image and prompt dataset designed to test other GenAI models against Grok’s real world reasoning.

Competition is the least of Grok’s worries, however. Despite xAI’s continued investment, Grok has yet to stick with early users and staff — a new report alleges its own developers struggle to use the slow xAI API. That same report, published by Fortune this week, highlighted X employee concerns about Musk suggesting Grok write paid user’s posts for them, despite warnings from developers and staff. Last week, Grok came under fire for generating fake news headlines from an alternate reality where Iran had assailed Tel Aviv with a military arsenal — not its first time.

While GenAI chatbots hallucinating realities and generating fake news is par for the course, Grok’s gaffe is indicative of yet another site wide issue. The bot, a par for the course response to ChatGPT from Musk, is integrating into a platform that has slowly whittled away at its defenses against AI gone bad. Combined with X’s all around poor reputation for moderation and the CEO’s own refusal to address misinformation in aid of the site’s “citizen journalists,” Grok occupies a precarious spot in the platform’s besieged information ecosystem.

Grok-1.5V will be available to early testers and select users soon.

©

Related Posts

Uh-oh, X's Grok AI can now 'understand' imagesUh-oh, X's Grok AI can now 'understand' images
Hand-Dyed Paper Seeds Flow Through Sculptural Landscapes...
“Run” (2021), 132 x 164 x 13 centimeters. All images...
Read more
Uh-oh, X's Grok AI can now 'understand' imagesUh-oh, X's Grok AI can now 'understand' images
Finally, a Compass That Works Without Opening...
Anyone who has wandered around an unfamiliar neighborhood searching for...
Read more
Uh-oh, X's Grok AI can now 'understand' imagesUh-oh, X's Grok AI can now 'understand' images
This DIY Cyberdeck With a 12-Inch Screen...
Most cyberdecks sit somewhere between prop and prototype, fun to...
Read more
Wearing Chairs While Sitting on Pants by Hansol Kim | YellowtraceWearing Chairs While Sitting on Pants by Hansol Kim | Yellowtrace
Wearing Chairs While Sitting on Pants by...
  Korea-born, Netherlands-based artist Hansol Kim uses collected items of clothing...
Read more
Uh-oh, X's Grok AI can now 'understand' imagesUh-oh, X's Grok AI can now 'understand' images
NYC’s Floating, Self-Filtering Pool Brings Clean Swimming...
After more than a decade of anticipation, New York’s East...
Read more
Uh-oh, X's Grok AI can now 'understand' imagesUh-oh, X's Grok AI can now 'understand' images
The 8 Best EDC Designs of October...
The most useful thing in your bag is often the...
Read more