Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

3.5bpw EXL2 quant of https://huggingface.co/MarsupialAI/Monstral-123B

Default settings and dataset utilized for measurements.

Downloads last month
1
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support