Hugging Face's logo

fedora-copr
/
Mistral-7B-Instruct-v0.3-GGUF

Text Generation
GGUF
English
quantized
4-bit precision
5-bit
6-bit
8-bit precision
conversational
Model card Files
xet
Community

Model Card for fedora-copr/Mistral-7B-Instruct-v0.3-GGUF

Quants of Mistral-7B-instruct-v0.3 for use in local Log Detective inference.

Downloads last month
27
GGUF
Model size
7B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

6-bit

8-bit

16-bit

Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for fedora-copr/Mistral-7B-Instruct-v0.3-GGUF

Base model

mistralai/Mistral-7B-v0.3
Finetuned
mistralai/Mistral-7B-Instruct-v0.3
Quantized
(222)
this model