BTC
ETH
SOL
XRP
BNB
TON
DOT
LTC
POL
HBAR
NEAR
ARB
UNI
An AI model that can take in or produce more than one kind of data, such as text, images, audio and video.
AI Drafted with AI help · Reviewed by Keshav Aggarwal · Updated
In simple words
You understand the world by reading, looking and listening, all at once. Older AI could only read.
A multimodal AI can read, look at pictures and listen too.
The technical side
Multimodal models handle several input or output types in one model. OpenAI’s GPT-4o (May 2024) took text, images and audio; Google’s Gemini was built multimodal from the start; Claude and many open models read images and documents.
Uses include describing photos, reading charts and scanned pages, voice assistants and understanding video. Image inputs are billed as tokens too.
Multimodal AI kya hai?
Multimodal AI sirf text nahi, photo, awaaz aur video bhi samajh sakta hai, jaise insaan dekh-sun ke samajhta hai.
Related terms
- LLM (Large Language Model)AIAn AI model trained on huge amounts of text so it can read and write language, like the models behind ChatGPT, Claude and Gemini.
- TransformerAIThe neural network design behind today’s language models. It reads all the words of a text at once and works out which ones matter to each other.