Skip to main content
Article

Community benchmarks: HartsyInference on real GPUs

Hartsy 1 min read
comments, jump to the thread 43 views

HartsyInference runs on whatever GPU the community brings. This page shows the results that have passed review: decode speed, time to first token, peak VRAM, and how far the numbers spread across machines. Every row links to the evidence bundle it came from.

Run the benchmark on your own GPU with the benchmark guide. A result appears here only after it is reviewed, and it refreshes weekly, so a withdrawn result can stay up for up to a week.

Community benchmarks

Reviewed results from community GPUs, produced with the HartsyInference benchmark runner. Each row is one GPU, the median of its sessions. This page refreshes weekly, so a withdrawn result can stay up for up to a week.

sd15-f16-512

GPU Backend Engine Median (ms) Throughput Peak VRAM Machines 95% interval Evidence
NVIDIA GeForce RTX 2060 SUPER cuda 06e9de65 5780 289 ms/step 4.2 GiB 1 one machine, no interval bundle 1

Comments

Your avatar