📄
Drop your file here
📎
Token Visualizer
Advanced tokenization analysis and visualization
Mistral Small 3
Gemma 3 27B
Deepseek R1
QWQ 32B
Llama 3.3 70B
Gemma 2 2B
Bert Large Uncased
GPT-2
Analyze Text
Token Visualization
Note: Showing preview of first 8096 characters. Stats are calculated on the full file.
Show More
Note: Only showing first 50,000 tokens. Total token count:
0
Total Tokens
0
0 unique
(
0
%)
Token Types
0
special tokens
Whitespace
0
spaces:
0
, newlines:
0
Token Length
0
median:
0
, ±
0
std
Compression
0
characters per token