Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,504

Full-text search

Active filters: llama.cpp

TeichAI/GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill-GGUF

30B • Updated 17 days ago • 92.8k • 455

LiquidAI/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated 22 days ago • 26k • 106

TeichAI/Qwen3.5-27B-Claude-Opus-4.6-Distill-GGUF

27B • Updated 7 days ago • 10.4k • 21

avalon2244/Qwen3.5-4B-Claude-Opus-4.6-Distilled-GGUF

4B • Updated 5 days ago • 2.89k • 9

jinaai/jina-embeddings-v5-text-small-retrieval

Sentence Similarity • 0.6B • Updated 9 days ago • 159k • 16

Ex0bit/Qwen3.5-122B-A10B-PRISM-PRO-GGUF

Image-Text-to-Text • 122B • Updated 9 days ago • 148 • 17

Ex0bit/Qwen3.5-122B-A10B-PRISM-LITE-GGUF

Image-Text-to-Text • 122B • Updated 11 days ago • 2.95k • 11

jinaai/jina-embeddings-v5-text-small-text-matching

Sentence Similarity • 0.6B • Updated 9 days ago • 15.4k • 8

Andycurrent/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-GGUF

Text Generation • 12B • Updated 7 days ago • 4.37k • 5

Ex0bit/Qwen3.5-PRISM-Dynamic-Quant-GGUF

Text Generation • 0.8B • Updated 8 days ago • 2.99k • 7

avalon2244/Qwen3.5-4B-Claude-Opus-4.6-Distilled

5B • Updated 5 days ago • 671 • 3

LiquidAI/LFM2.5-1.2B-Instruct-GGUF

Text Generation • 1B • Updated Jan 5 • 58.1k • 139

seanbailey518/Step3-VL-10B-GGUF

8B • Updated Jan 30 • 3.58k • 8

TeichAI/Devstral-Small-2505-Deepseek-V3.2-Speciale-Distill-GGUF

24B • Updated Feb 4 • 2.01k • 7

jinaai/jina-embeddings-v5-text-small-clustering

Feature Extraction • 0.6B • Updated 9 days ago • 13.8k • 5

prithivMLmods/Qwen3-VL-4B-Instruct-Unredacted-MAX-GGUF

Image-Text-to-Image • 4B • Updated 24 days ago • 2.79k • 5

sokann/Qwen3.5-27B-GGUF-4.165bpw

27B • Updated 11 days ago • 1.12k • 4

marksverdhei/LCO-Embedding-Omni-7B-GGUF

Feature Extraction • 8B • Updated 7 days ago • 712 • 3

Mustafaege/Qwen3.5-0.8B-GGUF-q4_k_m

Image-Text-to-Text • 0.8B • Updated 6 days ago • 930 • 2

khazarai/Qwen3-4B-Gemini-3.1-Pro-Reasoning-Distilled

Text Generation • 4B • Updated about 15 hours ago • 541 • 2

google/gemma-2b-it-GGUF

3B • Updated Jun 27, 2024 • 134 • 20

LiquidAI/LFM2-350M-GGUF

Text Generation • 0.4B • Updated Dec 5, 2025 • 44k • 55

mistralai/Magistral-Small-2509-GGUF

24B • Updated Sep 18, 2025 • 1.21k • 70

LiquidAI/LFM2-Audio-1.5B-GGUF

0.3B • Updated Dec 5, 2025 • 1.26k • 29

LiquidAI/LFM2-VL-3B-GGUF

Image-Text-to-Text • 3B • Updated Dec 5, 2025 • 79.4k • 34

geoffmunn/Qwen3-30B-A3B-Thinking-2507

Text Generation • 31B • Updated Nov 13, 2025 • 228 • 2

prithivMLmods/Qwen3-VL-8B-Instruct-abliterated-v2-GGUF

Image-Text-to-Text • 8B • Updated Dec 15, 2025 • 13.7k • 19

LiteMind/YutaLM-GGUF

Text Generation • 0.4B • Updated Dec 28, 2025 • 57 • 2

LiquidAI/LFM2.5-VL-1.6B-GGUF

Image-Text-to-Text • 1B • Updated 26 days ago • 152k • 66

LiquidAI/LFM2.5-1.2B-JP-GGUF

Text Generation • 1B • Updated Jan 6 • 39.3k • 29