These are quantizations of the model openPangu-Embedded-7B-V1.1

Original model: https://huggingface.co/FreedomIntelligence/openPangu-Embedded-7B-V1.1

Download the latest llama.cpp to use them.

Downloads last month
16
GGUF
Model size
8B params
Architecture
pangu-embedded
Hardware compatibility
Log In to add your hardware

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for noctrex/openPangu-Embedded-7B-V1.1-GGUF

Quantized
(4)
this model