What runs on your machine

26 of the 38 models BenchClub runs fit in 13 GB

$ uv tool install "https://github.com/holaboss-ai/holaOS/archive/adf785fefd3008ef884b3e84400bdc8c8a1a47ff.tar.gz#subdirectory=packages/benchclub"
ModelMemory neededArena · Instructions
gemma-3-12b-itGoogle12 GB1299
granite-4.2-8bIBM Granite8 GB1299
granite-4.2-3bIBM Granite8 GB1272
gemma-3n-E4B-itGoogle13 GB1255
gemma-3-4b-itGoogle8 GB1239
phi-4Microsoft13 GB1201
Llama-3.1-8B-InstructMeta Llama8 GB1159
Llama-3.2-3B-InstructMeta Llama8 GB1089
Mistral-7B-Instruct-v0.2Mistral AI8 GB1060
Llama-3.2-1B-InstructMeta Llama8 GB1031
Qwen3-0.6BQwen8 GB—
Qwen3-14BQwen13 GB—
Qwen2.5-7B-InstructQwen8 GB—
Qwen3-8BQwen8 GB—
Qwen3.5-2BQwen8 GB—
Qwen3-4BQwen8 GB—
Qwen3-1.7BQwen8 GB—
Qwen3-4B-Instruct-2507Qwen8 GB—
NVIDIA-Nemotron-3-Nano-4B-BF16NVIDIA8 GB—
Qwen2.5-Coder-14B-InstructQwen13 GB—
Qwen2.5-Coder-7B-InstructQwen8 GB—
MiniCPM5-2BOpenBMB8 GB—
DeepSeek-R1-Distill-Qwen-1.5BDeepSeek8 GB—
Phi-3.5-mini-instructMicrosoft8 GB—
gemma-3-1b-itGoogle8 GB—
LFM3-1.7BLiquid AI8 GB—
Compare the top 3

Needs more than 13 GB