Zip2Zip Tokenizer
Zip2Zip Config
Text Example
The quick brown fox jumps over the lazy dog. The quick brown fox jumps over the lazy dog.
Simulate LLM Generation
Original tokens
0
Compressed tokens
0
Show Codebook (0 entries)
Stacked
Original Tokens
Loading tokenizer...
Compressed Tokens
No compressed tokens yet...