| 1 | Q Qwen3.8-27BQwen | 27.8B | 1437 | 794 | 485 | 52 | 120 | Qwen3.8-27B-GPTQ-Int4-sym-G128-MTP-BF16SergiioB · 133.3K downloads |
| 2 | L Llama-3.2-1B-InstructMeta Llama | 1.2B | 1055 | 251 | 11 | 10 | 35 | Llama-3.2-1B-Instruct-GGUFISTA-DASLab · 189 downloads |
| 3 | L Llama-3.1-8B-InstructMeta Llama | 8.0B | 1187 | 489 | 12 | 16 | 31 | Meta-Llama-3.1-8B-Instruct-quantized.w4a16RedHatAI · 15.8K downloads |
| 4 | Q Qwen3-8BQwen | 8.2B | — | 268 | 39 | 29 | 30 | Qwen3-8B-GPTQ-Int4JunHowie · 945 downloads |
| 5 | L Llama-3.1-8BMeta Llama | 8.0B | — | 216 | 5 | 13 | 27 | meta-llama_Llama-3.1-8B-auto_gptq-int4-gs64-asymfbaldassarri · 64 downloads |
| 6 | L Llama-3.2-3B-InstructMeta Llama | 3.2B | 1110 | 394 | 14 | 11 | 26 | meta-llama_Llama-3.2-3B-Instruct-auto_round-int4-gs128-asymfbaldassarri · 365 downloads |
| 7 | Q Qwen3-1.7BQwen | 2.0B | — | 258 | 40 | 11 | 19 | Qwen3-1.7B-GPTQ-Int8Qwen · 1.1K downloads |
| 8 | S SmolLM2-135MHugging Face | 135M | — | 32 | 2 | 2 | 18 | SmolLM2-135M-Instruct-GPTQlilmeaty · 8.9K downloads |
| 9 | L Llama-3.2-1BMeta Llama | 1.2B | — | 166 | 1 | 7 | 18 | meta-llama_Llama-3.2-1B-auto_gptq-int8-gs128-asymfbaldassarri · 28 downloads |
| 10 | L Llama-3.2-3BMeta Llama | 3.2B | — | 95 | 8 | 4 | 15 | meta-llama_Llama-3.2-3B-auto_gptq-int8-gs128-symfbaldassarri · 25 downloads |
| 11 | Q Qwen2.5-1.5B-InstructQwen | 1.5B | — | 239 | 31 | 9 | 14 | Qwen2.5-1.5B-Instruct-GPTQ-Int4Qwen · 2K downloads |
| 12 | Q Qwen3-0.6BQwen | 752M | — | 331 | 50 | 4 | 13 | Qwen3-0.6B-GPTQ-Int8Qwen · 1K downloads |
| 13 | Q Qwen3-32BQwen | 32.8B | 1340 | 57 | 14 | 16 | 13 | Qwen3-32B-GPTQ-Int4JunHowie · 823 downloads |
| 14 | Q Qwen3-Coder-30B-A3B-InstructQwen | 30.5B | — | 99 | 31 | 5 | 12 | Qwen3-Coder-30B-A3B-Instruct-GPTQ-Int8QuantTrio · 71.6K downloads |
| 15 | Q Qwen3.5-35B-A3BQwen | 36.0B | 1395 | 176 | 62 | 10 | 12 | Qwen3.5-35B-A3B-GPTQ-Int4Qwen · 322.7K downloads |
| 16 | Q Qwen3-30B-A3B-Instruct-2507Qwen | 30.5B | 1384 | 59 | 23 | 2 | 12 | Qwen3-30B-A3B-Instruct-2507-GPTQ-Int4JunHowie · 642 downloads |
| 17 | M Muse-Glimmer-30Bmeta-models | 29.8B | 1389 | 72 | 53 | — | 12 | Muse-Glimmer-30B-VL-gptq-mlx-jangroman220220 · 386 downloads |
| 18 | Q Qwen3-4B-Instruct-2507Qwen | 4.0B | — | 242 | 40 | 7 | 11 | Qwen3-4B-Instruct-2507-GPTQ-Int8JunHowie · 2.6K downloads |
| 19 | M Meta-Llama-3-8B-InstructMeta Llama | 8.0B | 1166 | 164 | 1 | 5 | 11 | Meta-Llama-3-8B-Instruct-GPTQMaziyarPanahi · 93 downloads |
| 20 | O Ornith-1.5-35B-A3BOrnith | 36.0B | — | 84 | 88 | 2 | 11 | Ornith-1.5-35B-A3B-int4-AutoRound-GPTQ-XPUwiesion · 182 downloads |
| 21 | Q Qwen2.5-72B-InstructQwen | 72.7B | 1269 | 22 | 5 | 5 | 11 | Qwen2.5-72B-Instruct-GPTQ-Int4Qwen · 6.7K downloads |
| 22 | Q Qwen3-4BQwen | 4.0B | — | 207 | 30 | 8 | 10 | Qwen3-4B-GPTQ-Int4JunHowie · 235 downloads |
| 23 | P pythia-160mEleutherAI | 213M | — | 7 | — | 4 | 10 | EleutherAI_pythia-160m-autoround-int4-gs128-symfbaldassarri · 39 downloads |
| 24 | P phi-4Microsoft | 14.7B | 1217 | 103 | 13 | 8 | 10 | Microsoft-phi-4-Instruct-AutoRound-GPTQ-4bitSatwik11 · 94 downloads |
| 25 | Q Qwen3-14BQwen | 14.8B | — | 118 | 17 | 16 | 9 | Qwen3-14B-GPTQ-Int4JunHowie · 2.7K downloads |
| 26 | D DeepSeek-R1-Distill-Qwen-32BDeepSeek | 32.8B | — | 80 | 16 | 10 | 9 | DeepSeek-R1-Distill-Qwen-32B-gptq-4bitempirischtech · 1.1K downloads |
| 27 | M Mistral-Small-24B-Instruct-2501Mistral AI | 23.6B | 1234 | 55 | 9 | 4 | 9 | mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int4-gs128-asymfbaldassarri · 14 downloads |
| 28 | L LFM2.5-24B-A2BLiquid AI | 24.0B | — | 38 | 30 | — | 9 | LFM2.5-24B-A2B-PollardPollardWeights · 3.7K downloads |
| 29 | Q Qwen2.5-7B-InstructQwen | 7.6B | — | 276 | 47 | 15 | 8 | Qwen2.5-7B-Instruct-GPTQ-Int4Qwen · 17.8K downloads |
| 30 | P pythia-70m-dedupedEleutherAI | 96M | — | 3 | — | 5 | 8 | EleutherAI_pythia-70m-deduped-autogptq-int4-gs128-symfbaldassarri · 31 downloads |
| 31 | L Llama-2-7b-chat-hfMeta Llama | 6.7B | 1053 | 59 | 1 | 4 | 8 | Llama-2-7B-Chat-GPTQTheBloke · 4.7K downloads |
| 32 | G gemma-4-31B-itGoogle | 31.3B | 1443 | 152 | 65 | 7 | 7 | google_gemma-4-31B-it-ingest-best-gptqpositron-ai · 683 downloads |
| 33 | Q Qwen2.5-0.5B-InstructQwen | 494M | — | 239 | 31 | 8 | 7 | Qwen2.5-0.5B-Instruct-GPTQ-Int4Qwen · 2.6K downloads |
| 34 | Q Qwen2.5-3B-InstructQwen | 3.1B | — | 250 | 37 | 5 | 7 | Qwen2.5-3B-Instruct-GPTQ-Int4Qwen · 2K downloads |
| 35 | Q Qwen3.5-27BQwen | 27.8B | 1409 | 94 | 48 | 12 | 7 | Qwen3.5-27B-quantized.w4a16apolo13x · 1K downloads |
| 36 | G gemma-2-9b-itGoogle | 9.2B | 1207 | 125 | 8 | 8 | 7 | kgl_lmsys_pref_classifwath5 · 33 downloads |
| 37 | M Meta-Llama-3-8BMeta Llama | 8.0B | — | 163 | 6 | 7 | 7 | Llama-3-8B-GPTQ-4-Bitastronomer · 57 downloads |
| 38 | Q QwQ-32BQwen | 32.8B | 1329 | 64 | 29 | 6 | 7 | QwQ-32B-gptqmodel-4bit-vortex-v1ModelCloud · 24 downloads |
| 39 | G gemma-4-26B-A4B-itGoogle | 25.8B | 1434 | 216 | 88 | 9 | 6 | google_gemma-4-26B-A4B-it-ingest-best-gptqpositron-ai · 695 downloads |
| 40 | Q Qwen2.5-Coder-32B-InstructQwen | 32.8B | 1230 | 71 | 23 | 4 | 6 | Qwen2.5-Coder-32B-Instruct-GPTQ-Int8Qwen · 30.5K downloads |
| 41 | M Mistral-7B-v0.1Mistral AI | 7.2B | — | 83 | 9 | 7 | 6 | Mistral-7B-v0.1-GPTQTheBloke · 195 downloads |
| 42 | F flintRecursiveSI | 39.8B | — | 40 | 50 | 2 | 6 | Flint-abliterated-GGUForcarouter · 7.3K downloads |
| 43 | Q Qwen3.5-2BQwen | 2.3B | — | 189 | 56 | 3 | 5 | Qwen3.5-2B-W4A16-HGPTQnchapman · 164 downloads |
| 44 | N Nanbeige4.3-33BNanbeige | 33.1B | — | 33 | 30 | 3 | 5 | Nanbeige4.3-33B-W4A16-AutoRoundTech2wild · 470 downloads |
| 45 | Q QwQ-32B-PreviewQwen | 32.8B | 1162 | 36 | 31 | 3 | 5 | QwQ-32B-Preview-gguf-vortex-v1ModelCloud · 40 downloads |
| 46 | Q Qwen3-30B-A3BQwen | 30.5B | 1317 | 57 | 16 | 6 | 4 | Qwen3-30B-A3B-GPTQ-Int4Qwen · 18.5K downloads |
| 47 | H Hy3Tencent | 299B | 1439 | 19 | 26 | — | 4 | Hy3-GPTQ-Int4AngelSlim · 246 downloads |
| 48 | N NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16NVIDIA | 32.9B | 1329 | 47 | 51 | — | 4 | nemotron-30b-a3b-gptq-jang-componentroman220220 · 125 downloads |
| 49 | T TinyLlama-1.1B-Chat-v1.0TinyLlama | 1.1B | — | 99 | 14 | 3 | 4 | TinyLlama-1.1B-Chat-v1.0-marlinRedHatAI · 2.5K downloads |
| 50 | D DeepSeek-R1-Distill-Qwen-1.5BDeepSeek | 1.8B | — | 197 | 17 | 4 | 4 | DeepSeek-R1-Distill-Qwen-1.5B_GPTQ-int4jakiAJK · 28 downloads |
| 51 | M Mixtral-8x7B-Instruct-v0.1Mistral AI | 46.7B | 1132 | 25 | 2 | 3 | 4 | Mixtral-8x7B-Instruct-v0.1-GPTQTheBloke · 781 downloads |
| 52 | Q Qwen3-235B-A22BQwen | 235B | 1394 | 16 | 8 | 1 | 4 | Qwen3-235B-A22B-GPTQ-Int4Qwen · 1.5K downloads |
| 53 | P Phi-3.5-mini-instructMicrosoft | 3.8B | — | 134 | 12 | 3 | 4 | Phi-3.5-mini-instruct-Autoround-Safetensorssimaai · 28 downloads |
| 54 | L Llama-2-7b-hfMeta Llama | 6.7B | — | 30 | 1 | 5 | 4 | Llama-2-7B-GPTQTheBloke · 1.8K downloads |
| 55 | D DeepSeek-R1-0528DeepSeek | 685B | 1428 | 22 | 4 | 3 | 4 | DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-MediumQuantTrio · 162 downloads |
| 56 | L LFM3-1.7BLiquid AI | 1.7B | — | 87 | 37 | — | 4 | LFM3-1.7B-NVFP4-GGUFBennyDaBall · 764 downloads |
| 57 | D DeepSeek-R1DeepSeek | 684B | 1373 | 26 | 7 | 4 | 3 | DeepSeek-R1-int4-gptq-sym-incOPEA · 189 downloads |
| 58 | Q Qwen2.5-Coder-14B-InstructQwen | 14.8B | — | 88 | 21 | 3 | 3 | Qwen2.5-Coder-14B-Instruct-GPTQ-Int4Qwen · 4.7K downloads |
| 59 | G GLM-4.5-AirZ.ai | 110B | 1384 | 22 | 18 | — | 3 | GLM-4.5-Air-GPTQMODEL-W4A16avtc · 145 downloads |
| 60 | M Mistral-7B-Instruct-v0.2Mistral AI | 7.2B | 1090 | 74 | 1 | 8 | 3 | Mistral-7B-Instruct-v0.2-GPTQTheBloke · 832 downloads |
| 61 | G gemma-3-4b-itGoogle | 4.3B | 1291 | 181 | 15 | 4 | 3 | gemma-3-4b-it-text-int4-gptqdongchengli · 3.8K downloads |
| 62 | M MiniCPM5-2BOpenBMB | 2.5B | — | 59 | 35 | 2 | 3 | MiniCPM5-2B-NVFP4Ttimms · 253 downloads |
| 63 | Q Qwen3.5-122B-A10BQwen | 125B | 1417 | 70 | 54 | 3 | 3 | Qwen3.5-122B-A10B-int4-AutoRound-ECshieldstar · 100 downloads |
| 64 | Q Qwen2.5-32B-InstructQwen | 32.8B | — | 68 | 9 | 7 | 3 | Qwen2.5-32B-Instruct-GPTQ-Int4Qwen · 380.4K downloads |
| 65 | L Llama-3.3-70B-InstructMeta Llama | 70.6B | 1274 | 45 | 9 | 12 | 3 | Llama-3.3-70B-Instruct-AutoRound-GPTQ-4bitSatwik11 · 14 downloads |
| 66 | G gemma-3-27b-itGoogle | 27.4B | 1358 | 92 | 5 | 4 | 3 | google_gemma-3-27b-it-ingest-best-gptqpositron-ai · 960 downloads |
| 67 | P phi-2Microsoft | 2.8B | — | 32 | 6 | — | 3 | phi-2-GPTQTheBloke · 162 downloads |
| 68 | L Llama-2-13b-chat-hfMeta Llama | 13.0B | 1084 | 11 | — | 2 | 3 | Llama-2-13B-chat-GPTQTheBloke · 906 downloads |
| 69 | S SOLAR-10.7B-Instruct-v1.0Upstage | 10.7B | 1083 | 14 | — | 3 | 3 | SOLAR-10.7B-Instruct-v1.0-GPTQTheBloke · 48 downloads |
| 70 | G GLM-4.6Z.ai | 357B | 1440 | 16 | 7 | 1 | 3 | GLM-4.6-GPTQMODEL-W4A16-v2ModelCloud · 54 downloads |
| 71 | Q Qwen2-72B-InstructQwen | 72.7B | 1203 | 13 | — | 1 | 3 | Qwen2-72B-Instruct-GPTQ-Int4Qwen · 338 downloads |
| 72 | L Llama-2-70b-chat-hfMeta Llama | 69.0B | 1115 | 1 | — | 3 | 3 | Llama-2-70B-Chat-GPTQTheBloke · 846 downloads |
| 73 | G GLM-5.3-FlashZ.ai | 321B | 1472 | 86 | 48 | 1 | 2 | GLM-5.3-Flash-W4A16-MTPcanada-quant · 2.9K downloads |
| 74 | D DeepSeek-V4-Flash-0731DeepSeek | 304B | — | 100 | 29 | 1 | 2 | DeepSeek-V4-Flash-0731-GPTQ-Int4-V1sokada4 · 154 downloads |
| 75 | G GLM-5.3Z.ai | 753B | 1475 | 12 | 14 | — | 2 | GLM-5.3-Int4-Int8Mix-Pollard-GPTQbot-lab-21 · 73 downloads |
| 76 | D DeepSeek-V4.1-FlashDeepSeek | 763B | 1464 | 24 | 14 | — | 2 | DeepSeek-V4.1-Flash-W4A16-Engram-AutoRoundINCModel3 · 169 downloads |
| 77 | Q Qwen2.5-Coder-7B-InstructQwen | 7.6B | — | 207 | 31 | 5 | 2 | Qwen2.5-Coder-7B-Instruct-GPTQ-Int4Qwen · 432.7K downloads |
| 78 | D DeepSeek-V3DeepSeek | 684B | 1333 | 4 | 4 | 3 | 2 | DeepSeek-V3-int4-sym-gptq-incOPEA · 195 downloads |
| 79 | D DeepSeek-V4-FlashDeepSeek | 291B | 1432 | 65 | 26 | — | 2 | DeepSeek-V4-Flash-W4A16-FP8-MTPcanada-quant · 218 downloads |
| 80 | Q Qwen3.5-397B-A17BQwen | 403B | 1438 | 22 | 23 | 2 | 2 | Qwen3.5-397B-A17B-GPTQ-Int4Qwen · 5.2K downloads |
| 81 | O Ornith-1.5-122BOrnith | 125B | — | 18 | 26 | — | 2 | Ornith-1.5-122B-UNCENSORED-NVFP4dealignai · 2.3K downloads |
| 82 | Q Qwen3-Coder-NextQwen | 79.7B | — | 29 | 53 | 4 | 2 | Qwen3-Coder-Next-GPTQ-4bitbtbtyler09 · 824 downloads |
| 83 | G GLM-5.2Z.ai | 753B | 1469 | 43 | 22 | — | 2 | GLM-5.2-W4A16-MTPcanada-quant · 118 downloads |
| 84 | G gemma-2-2b-itGoogle | 2.6B | 1156 | 153 | 18 | 1 | 2 | Gemma-2-2B-it-Autoround-Safetensorssimaai · 12 downloads |
| 85 | M MiniMax-M3MiniMax | 427B | 1428 | 16 | 11 | 1 | 2 | MiniMax-M3-W4A16-GPTQSebesky · 2.6K downloads |
| 86 | M MiniMax-M2MiniMax | 229B | 1340 | 16 | 8 | 2 | 2 | MiniMax-M2-GPTQMODEL-W4A16ModelCloud · 26 downloads |
| 87 | L Llama-3.1-70B-InstructMeta Llama | 70.6B | 1261 | 37 | 1 | 2 | 2 | Meta-Llama-3.1-70B-Instruct-quantized.w4a16RedHatAI · 3.5K downloads |
| 88 | G GLM-4.7Z.ai | 358B | 1435 | 15 | 7 | 2 | 2 | GLM-4.7-REAP-30-W4A16Jon-Nielsen · 75 downloads |
| 89 | M Meta-Llama-3-70B-InstructMeta Llama | 70.6B | 1221 | 16 | — | 1 | 2 | Meta-Llama-3-70B-Instruct-GPTQMaziyarPanahi · 76 downloads |
| 90 | G granite-4.2-3bIBM Granite | 3.7B | 1292 | 26 | 30 | — | 2 | granite-4.2-3b-MXFP4A16-GPTQquark75 · 592 downloads |
| 91 | S Spark-X2.6-4BXHToken | 4.1B | — | 32 | 21 | — | 2 | spark-x2.6-4b-gptq4-mlxJakevin · 316 downloads |
| 92 | S Spark-X2.5-4BXHToken | 4.1B | — | 34 | 11 | — | 2 | Spark-X2.5-4B-NVFP4Ttimms · 78 downloads |
| 93 | D deepseek-llm-67b-chatDeepSeek | 67.0B | 1105 | 3 | — | 1 | 2 | deepseek-llm-67b-chat-GPTQTheBloke · 53 downloads |
| 94 | O openchat_3.5openchat | — | — | 10 | — | 1 | 2 | openchat_3.5-GPTQTheBloke · 57 downloads |
| 95 | G gpt2OpenAI (community) | 137M | — | 48 | 2 | — | 1 | GPT2-GPTQ-int4Joseph200105 · 34 downloads |
| 96 | G gpt-oss-20bOpenAI | 20.9B | 1288 | 101 | 64 | — | 1 | openai_gpt-oss-20b-ingest-best-gptqpositron-ai · 43 downloads |
| 97 | G gpt-oss-120bOpenAI | 117B | 1366 | 49 | 41 | — | 1 | openai_gpt-oss-120b-ingest-best-gptqpositron-ai · 48 downloads |
| 98 | N NVIDIA-Nemotron-3-Nano-4B-BF16NVIDIA | 4.0B | — | 35 | 12 | — | 1 | Nemotron-3-Nano-4B-W4A16aleada · 55 downloads |
| 99 | O Ornith-1.0-35BOrnith | 35.1B | — | 17 | 85 | 1 | 1 | Ornith-1.0-35B-GPTQ-Pro-FOEM-4bit-g128-ns256XReyRobert · 55 downloads |
| 100 | N NVIDIA-Nemotron-3-Nano-30B-A3B-BF16NVIDIA | 31.6B | 1348 | 38 | 12 | 2 | 1 | Nemotron-3-Nano-30B-A3B-GPTQTevunahAi · 31 downloads |