Hugging Face's logo

smdesai
/
granite-3.3-2b-instruct-4bit-DWQ

Text Generation
MLX
Safetensors
granite
language
granite-3.3
conversational
4-bit precision
Model card Files
xet
Community
README.md exists but content is empty.
Downloads last month
10
Safetensors
Model size
0.4B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for smdesai/granite-3.3-2b-instruct-4bit-DWQ

Base model

ibm-granite/granite-3.3-2b-base
Finetuned
ibm-granite/granite-3.3-2b-instruct
Quantized
(48)
this model