REAP has been redone/fixed

#1
by JeroenAdam - opened

FYI, an update: https://huggingface.co/datasets/0xSero/minimax-m2.1-reap-observations
REAP-20 Deprecated
REAP-30 Fixed
REAP-40 Fixed
REAP-50 Deprecated

Would be interesting to have the new GGUFs.

Can you please link what exact model you want us to quantize? https://huggingface.co/0xSero/MiniMax-M2.1-REAP-50-REPAIR-IN-PROGRESS no longer exists so we can't requantize it.

We already did static quants for booth of them: https://huggingface.co/mradermacher/MiniMax-M2.1-REAP-30-GGUF and https://huggingface.co/mradermacher/MiniMax-M2.1-REAP-40-GGUF

Their weighted/imatrix quants are currently waiting for me to manually provide BF16 GGUFs as the F32 one is too large to run on 512 GiB of RAM. Please follow its status under hf.tst.eu/status.html

Many thanks!

Sign up or log in to comment