Only 4k context window?

#1
by do-me - opened

Loading the model on recent LM Studio 0.3.31 only allows for max 4k context window:

image

MLX Community org
edited 18 days ago

This model uses model_max_length instead of max_position_embeddings, so I'm guessing its a config parsing issue. You may want to file an issue @ https://github.com/lmstudio-ai/lmstudio-bug-tracker

Sign up or log in to comment