36 stories tagged Multimodal · page 2 of 2
Researchers developed AITP, an AI system that uses Multimodal Large Language Models to analyze traffic accidents and assign responsibility based on legal knowledge. This advancement could revolutionize accident investigations and insurance claims.
Researchers have introduced the first benchmark for extracting claims from multimodal social media posts, addressing a gap in automated fact-checking. The dataset includes text combined with images like memes and screenshots, challenging traditional methods.
Researchers introduce CFMS, the first fine-grained multimodal sarcasm dataset for Chinese social media. It includes 2,796 image-text pairs with triple-level annotations, advancing research in sarcasm detection.
Researchers introduce GIST, a new model that enhances spatial grounding in densely packed environments. The model addresses challenges faced by Vision-Language Models (VLMs) in cluttered spaces like retail stores and hospitals.
Hugging Face has published a comprehensive guide on training and fine-tuning multimodal embedding and reranker models using Sentence Transformers. This resource is aimed at developers looking to enhance their multimodal applications with state-of-the-art techniques.
Researchers introduce a dynamic data curation pipeline to better evaluate how LVLMs handle conflicts between visual and textual evidence. The study underscores the importance of models admitting when they lack knowledge.
TII has released Falcon Perception, a multimodal model combining text and vision capabilities. This open-source model sets a new standard for accessibility in AI.
Google's MedGemma 1.5 4B model now integrates high-dimensional medical imaging, anatomical localization, and multi-timepoint analysis within a single architecture. This update significantly expands capabilities to include CT/MRI volumes, histopathology, and complex EHR document understanding.
IBM has released Granite 4.0 3B Vision, a compact open-source model designed to analyze enterprise documents with high efficiency. This release bridges the gap between heavy multimodal models and the need for fast, local document processing.
Hugging Face has released new multimodal embedding and reranker models via Sentence Transformers. These models enable advanced cross-modal retrieval and ranking capabilities.
Gemma 4 is a new multimodal intelligence model. It runs on devices, enabling local AI processing.
OpenAI's new Realtime Video API lets developers pipe live camera streams directly to GPT-5V, enabling sub-second visual understanding for robotics, accessibility tools, and consumer apps.