Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,574

Base only

Active filters: gptq

LordNeel/DeepSeek-V4-Flash-Acti-MTP-W4A16-FP8

Text Generation • 44B • Updated 21 days ago • 2.3k • 9

XReyRobert/Qwopus3.6-27B-v2-GPTQ-Pro-v1

Text Generation • 27B • Updated 7 days ago • 505 • 4

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 56 • 319

TheBloke/dolphin-2.1-mistral-7B-GPTQ

Text Generation • 7B • Updated Oct 11, 2023 • 40 • 36

openbmb/MiniCPM-2B-sft-int4

Text Generation • 3B • Updated Sep 7, 2024 • 89 • 24

openbmb/MiniCPM-2B-dpo-int4

Text Generation • 3B • Updated Sep 7, 2024 • 77 • 5

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • 33B • Updated Oct 9, 2024 • 78.6k • 14

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int8

Text Generation • 33B • Updated Nov 18, 2024 • 762 • 22

sitatech/Qwen3-VL-8B-Instruct-GPTQ-Int4

Image-Text-to-Text • 9B • Updated Feb 6 • 367 • 1

Qwen/Qwen3.5-397B-A17B-GPTQ-Int4

Image-Text-to-Text • Updated Apr 24 • 41.2k • 29

Qwen/Qwen3.5-27B-GPTQ-Int4

Image-Text-to-Text • 28B • Updated Apr 24 • 442k • 55

dataslab/DLM-2.0-14B-GPTQ

Text Generation • 3B • Updated Apr 30 • 7 • 2

dataslab/DLM-2.1-14B-GPTQ

Text Generation • 3B • Updated Apr 30 • 5 • 2

groxaxo/lukey03-Qwen3.5-9B-abliterated-gptq-pro-w4g128

Text Generation • 9B • Updated Mar 23 • 109 • 2

caiovicentino1/Qwopus3.5-27B-v3-HLWQ-v7-GPTQ

Text Generation • 27B • Updated Apr 13 • 6 • 6

Vishva007/gemma-4-E4B-it-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 4B • Updated 22 days ago • 53.3k • 4

0xSero/Qwen3.5-264B-W4A16

Text Generation • 37B • Updated 2 days ago • 396 • 11

0xSero/GLM-5.1-555B-W4A16

Text Generation • 78B • Updated 2 days ago • 901 • 8

shieldstar/Qwen3.6-35B-A3B-int4-AutoRound-EC

Image-Text-to-Text • 6B • Updated Apr 23 • 12.7k • 7

onnx-community/PaddleOCR-VL-1.5-ONNX

Updated 26 days ago • 297 • 3

llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved-GPTQ-Int4

Image-Text-to-Text • 36B • Updated 23 days ago • 8.11k • 3

AxisQuant/Qwen3.6-27b-gptq-int4

Text Generation • 27B • Updated 3 days ago • 13.1k • 3

Reza2kn/mega-asr-onnx

Automatic Speech Recognition • Updated 10 days ago • 199 • 3

shinigamiRaj/Llama-3.2-1B-Instruct-gptqmodel-4bit

1B • Updated about 21 hours ago • 1

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 13 • 40

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 20 • 68

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 15 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 17 • 121

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 7 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 8 • 2