ValueError: Model type kimi_linear not supported.
#1
by
x-polyglot-x
- opened
Hey all,
I am not sure how to run this. It fails in both mlx_lm.server command and also with LM Studio due to the model type not being supported.
Any help is appreciated!
There's no official mlx-lm release yet, but you can check out the main branch from the github repository: https://github.com/ml-explore/mlx-lm
Also make sure you have the latest model updates 757f137 (re-download if you're unsure)
Just downloaded:
🥲 Failed to load the model
Failed to load model
Error when loading model: AttributeError: 'NoneType' object has no attribute 'from_pretrained'
MLX version info:
- mlx-engine==57634af
- mlx==0.30.3
- mlx-lm==0.30.5
- mlx-vlm==0.3.10
Hi,
This is an LMStudio issue. You can report it to their issue tracker or you can run the model in mlx-lm directly using https://github.com/ml-explore/mlx-lm