cyankiwi

/

Devstral-Small-2-24B-Instruct-2512-AWQ-4bit

like 5

Follow

cyankiwi 85

Happy to contribute to the community. Apriel and Devstral 123B are in the makings :)

Thanks for 4 bit, if possible please also add 8 bit.

Thanks for 4 bit, if possible please also add 8 bit.

Seconded. I'd really appreciate AWQ 8 bit for Ampere.