Home/FAQ & Glossary/Tokens & Tokens per Second (t/s or tok/s)
GLOSSARY DEFINITIONMetrics
← Back to FAQ & Glossary

Tokens & Tokens per Second (t/s or tok/s)

AI models do not read or write whole words the way humans do; they break text down into chunks called tokens. In English, one token equals roughly ¾ of a word (so 100 tokens is around 75 words). Common short words are single tokens, while long technical terms, punctuation, and code indentation get split into multiple pieces.

Tokens per second (t/s or tok/s) is the primary speedometer for local AI hardware, measuring how fast a rig spits out a response:

  • Under 5 t/s: Painfully slow. You watch words trickle onto the screen one by one, making long coding tasks or back-and-forth edits frustrating.
  • 10–15 t/s: Comfortable reading speed. Text appears slightly faster than the average person reads, which feels totally usable for everyday chat and drafting.
  • 30+ t/s: Instantaneous. Paragraphs snap onto the screen almost immediately, matching the snappy feel of paid cloud services.

Looking for verified hardware rigs?

Check our real-time £/GB VRAM index to find systems optimized for local model inference.

Explore VRAM Index →
Rent Cloud GPU Power

Not Ready to Buy a Full Rig?

Don't want to spend £3,500+ upfront? Rent the GPU power instead.

Buying a dedicated AI workstation is a serious investment—and if you aren't ready to spend that much right now, you don't have to. Renting cloud GPUs gives you instant access to high-VRAM hardware like RTX 4090s and H100s on demand. Spin up an instance for fine-tuning or running massive 70B+ models, pay strictly for the minutes you use, and avoid the upfront hardware cost, electricity bills, and maintenance.

Vast.ai Global GPU Marketplace

Lowest $/hr
Unbeatable $/hr rates on community-hosted RTX 4090 & 3090 rigs
Deploy Pod →

RunPod Community & Secure Cloud

Community & Secure Cloud
RTX 4090 from $0.34/hr • H100 SXM from $1.99/hr (Billed in USD)
Deploy Pod →

FindBestRig independently benchmarks cloud GPU providers to compare rental economics against physical hardware.