Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

28,810

Base only

Active filters: imatrix

mradermacher/Gemma-4-21B-i1-GGUF

21B • Updated 2 days ago • 1.2k • 2

pinklily69/DeepSeek-V4-Flash-IQ3_S-GGUF

284B • Updated 1 day ago • 115 • 2

bartowski/Llama-3-8B-LexiFun-Uncensored-V1-GGUF

Text Generation • 8B • Updated May 1, 2024 • 2.24k • 8

bartowski/Yi-1.5-34B-Chat-GGUF

Text Generation • 34B • Updated May 12, 2024 • 847 • 26

mradermacher/Ninja-v1-NSFW-RP-i1-GGUF

7B • Updated Dec 16, 2024 • 990 • 4

lmstudio-community/deepseek-coder-6.7B-kexer-GGUF

Text Generation • 7B • Updated May 25, 2024 • 2.31k • 5

lmstudio-community/deepseek-coder-1.3B-kexer-GGUF

Text Generation • 1B • Updated May 25, 2024 • 1.13k • 5

legraphista/DeepSeek-V2-Lite-IMat-GGUF

Text Generation • 16B • Updated May 26, 2024 • 1.29k • 2

mmnga/umiyuki-Umievo-itr012-Gleipnir-7B-gguf

7B • Updated May 29, 2024 • 586 • 9

lmstudio-community/Phi-3.1-mini-4k-instruct-GGUF

Text Generation • 4B • Updated Aug 1, 2024 • 3.7k • 24

mradermacher/L3-Umbral-Mind-RP-v3.0-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 795 • 18

mradermacher/deepseek-coder-1.3b-instruct-i1-GGUF

1B • Updated Sep 3, 2024 • 271 • 2

kaetemi/Qwen2.5-7B-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 24, 2024 • 224 • 1

legraphista/Llama-3.2-1B-Instruct-IMat-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 1.36k • 1

mradermacher/Qwen2.5-14B-Instruct-i1-GGUF

15B • Updated Feb 3, 2025 • 776 • 2

bartowski/Llama-3.1-WhiteRabbitNeo-2-70B-GGUF

Text Generation • 71B • Updated Oct 5, 2024 • 2.27k • 8

mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF

22B • Updated Oct 14, 2024 • 349 • 7

maicog/Llama-3.2-3B-Instruct-abliterated-Q4_K_M-GGUF

4B • Updated Oct 17, 2024 • 169 • 1

unsloth/Llama-3.3-70B-Instruct-GGUF

71B • Updated May 10, 2025 • 67.2k • 114

mradermacher/Aura-4B-i1-GGUF

5B • Updated Dec 13, 2024 • 2.18k • 4

mradermacher/32B-Qwen2.5-Kunou-v1-i1-GGUF

33B • Updated Dec 31, 2024 • 300 • 4

mradermacher/Mistral-Small-24B-Instruct-2501-i1-GGUF

24B • Updated Jul 25, 2025 • 568 • 6

bartowski/cognitivecomputations_Dolphin3.0-Mistral-24B-GGUF

Text Generation • 24B • Updated Feb 7, 2025 • 5.68k • 18

bartowski/simplescaling_s1.1-32B-GGUF

Text Generation • 33B • Updated Feb 11, 2025 • 1.17k • 6

bartowski/microsoft_Phi-4-mini-instruct-GGUF

Text Generation • 4B • Updated Feb 28, 2025 • 11.2k • 41

mradermacher/jais-family-13b-chat-i1-GGUF

13B • Updated Mar 6, 2025 • 385 • 1

bartowski/huihui-ai_QwQ-32B-abliterated-GGUF

Text Generation • 33B • Updated Mar 7, 2025 • 4.97k • 80

mradermacher/bitnet_b1_58-large-i1-GGUF

0.7B • Updated Mar 13, 2025 • 123 • 1

mradermacher/Qwen2-Boundless-i1-GGUF

2B • Updated Jul 11, 2025 • 314 • 1

Mungert/Qwen2.5-VL-7B-Instruct-GGUF

Image-Text-to-Text • 8B • Updated Sep 24, 2025 • 3.7k • 22