Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

118

Base only

Active filters: 7-bit

Dracones/Merged-RP-Stew-V2-34B_exl2_7.0bpw

Text Generation • Updated Apr 11, 2024 • 1

Dracones/c4ai-command-r-v01_exl2_7.0bpw

Text Generation • Updated Apr 12, 2024 • 2

Dracones/c4ai-command-r-v01_exl2_7.0bpw-rpcal

Text Generation • Updated Apr 12, 2024 • 1

Dracones/miqu-1-70b-sf_exl2_7.0bpw

Text Generation • Updated Apr 11, 2024 • 1

Dracones/c4ai-command-r-plus_exl2_7.0bpw

Text Generation • Updated Apr 13, 2024 • 3

Dracones/mixtral-8x22b-instruct-oh_exl2_7.0bpw

Text Generation • Updated Apr 14, 2024 • 4

bdambrosio/dbrx-instruct-7.0bpw-h8-exl2

Text Generation • Updated Apr 15, 2024 • 6

Dracones/WizardLM-2-8x22B_exl2_7.0bpw

Text Generation • Updated Apr 16, 2024 • 2

Dracones/CodeQwen1.5-7B-Chat_exl2_7.0bpw

Text Generation • Updated Apr 16, 2024 • 1

Dracones/CodeQwen1.5-7B_exl2_7.0bpw

Text Generation • Updated Apr 16, 2024 • 2

Dracones/Llama-3-Lumimaid-70B-v0.1_exl2_7.0bpw

Text Generation • Updated May 4, 2024 • 1

FuturisticVibes/Coomand-R-35B-v1-7.0bpw-h8-exl2

Text Generation • Updated May 12, 2024 • 1

FuturisticVibes/L3-Arcania-4x8b-7.0bpw-h8-exl2

Text Generation • Updated May 14, 2024 • 1

SicariusSicariiStuff/CalderaAI_Foredoomed-9B_EXL-7.0

Updated May 18, 2024 • 1

BigHuggyD/jukofyork_miquplus-midnight-70b_exl2_7.0bpw

Text Generation • Updated Jun 6, 2024 • 3

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_7.0bpw_h8

Text Generation • Updated Jun 19, 2024 • 4

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_RP_Soup_EXL2_7.0bpw

Text Generation • Updated Jul 25, 2025 • 5

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_7.0bpw

Text Generation • Updated Jul 25, 2025 • 7

BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_7.0bpw_h8

Text Generation • Updated Jun 25, 2024 • 5

BigHuggyD/alpindale_magnum-72b-v1_exl2_7.0bpw_h8

Text Generation • Updated Jun 26, 2024 • 2

BigHuggyD/cohereforai_c4ai-command-r-plus_exl2_7.0bpw_h8

Text Generation • Updated Jun 28, 2024 • 4

bigstorm/Hermes-2-Theta-Llama-3-70B-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 2

bigstorm/Qwen2-72B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 3

bigstorm/firefunction-v2-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 6

bigstorm/Llama-3-Groq-70B-Tool-Use-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 3

DrNicefellow/Mistral-Nemo-Instruct-2407-exl2-7bpw-h8

Text Generation • Updated Jul 18, 2024 • 6

bigstorm/Meta-Llama-3.1-70B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Jul 24, 2024 • 3

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_7.0bpw_h8

Text Generation • Updated Aug 14, 2024 • 5

BigHuggyD/NeverSleep_Lumimaid-v0.2-123B_exl2_7.0bpw_h8

Text Generation • Updated Jul 30, 2024 • 4

SicariusSicariiStuff/2B_or_not_2B-EXL2-7.0bpw

Text Generation • Updated Jul 25, 2025 • 5