BTC
ETH
SOL
XRP
BNB
TON
DOT
LTC
POL
HBAR
NEAR
ARB
UNIA small piece of text, often part of a word, that an AI model reads and writes. AI APIs charge by the number of tokens.
AI Reviewed by Keshav Aggarwal · Updated
In simple words
Think of a sentence as a train. An AI does not read the whole train at once. It reads one carriage at a time. Each carriage is a token.
Some carriages are a full word, some are only half a word.
The technical side
Models split text into tokens with a tokenizer before processing it. In English, one token is about four characters, or roughly three quarters of a word, so 1,000 tokens is about 750 words. Other languages, code and numbers often need more tokens for the same meaning.
API prices are quoted per million tokens, with input (what you send) and output (what the model writes) priced separately. See today’s rates on our LLM API prices page.
Token kya hai?
Token text ka ek chhota tukda hota hai, kabhi poora shabd, kabhi aadha. AI isi hisaab se padhta aur likhta hai, aur API ka bill bhi token ginke banta hai.