EliteTestEngineering LLM token speeds

We post videos of local language model chat tokens speeds on DGX Spark, Mac Studio, and PC GPUs.

Speeds at visual when you ask a model questions using a browser front-end like openwebui. These are different from benchmark speeds like vllm benchmark which are usually higher and are agentic tasks rather than chat.

Enjoy