Home/FAQ & Glossary/What software do I need to actually use these models?
FREQUENTLY ASKED QUESTIONsoftware
← Back to FAQ & Glossary

What software do I need to actually use these models?

You don't need to write code or deal with complicated setup to run local AI. The most popular tools are free and run across Windows, Mac, and Linux. Which one makes sense comes down to how you want to use it:

  • All-in-One Desktop Apps (Best for Beginners): Tools like LM Studio and Jan give you a familiar, ChatGPT-style window. Open the app, search the built-in catalog, click Download, and start chatting. LM Studio even checks your hardware first and warns you if a model won't fit in your computer's memory before you bother downloading it.
  • Document & Knowledge-Base Apps: If you want to ask questions against your own PDFs, notes, or local folders without uploading them anywhere, apps like AnythingLLM or GPT4All pair a local AI runner with built-in document search.
  • Developer Engines & Web Interfaces: Ollama runs quietly in the background as a lightweight local engine. Developers use it to wire local models into editors like VS Code or Cursor, or pair it with Open WebUI for a ChatGPT-style interface in the browser.

Under the hood, almost all of these apps rely on the same open-source inference engine (llama.cpp), so a model will generate text at roughly the same speed no matter which one you pick. Nothing stops you from installing both LM Studio and Ollama on the same machine to see which workflow sticks.

Looking for verified hardware rigs?

Check our real-time £/GB VRAM index to find systems optimized for local model inference.

Explore VRAM Index →
Rent Cloud GPU Power

Not Ready to Buy a Full Rig?

Don't want to spend £3,500+ upfront? Rent the GPU power instead.

Buying a dedicated AI workstation is a serious investment—and if you aren't ready to spend that much right now, you don't have to. Renting cloud GPUs gives you instant access to high-VRAM hardware like RTX 4090s and H100s on demand. Spin up an instance for fine-tuning or running massive 70B+ models, pay strictly for the minutes you use, and avoid the upfront hardware cost, electricity bills, and maintenance.

Vast.ai Global GPU Marketplace

Lowest $/hr
Unbeatable $/hr rates on community-hosted RTX 4090 & 3090 rigs
Deploy Pod →

RunPod Community & Secure Cloud

Community & Secure Cloud
RTX 4090 from $0.34/hr • H100 SXM from $1.99/hr (Billed in USD)
Deploy Pod →

FindBestRig independently benchmarks cloud GPU providers to compare rental economics against physical hardware.