Best Quant For Mac

#2
by isr431 - opened

Hi there! I want to run models on my macbook using Ollama, and was wondering which quant would be best for mac/arm? From the write-up it sounds like IQ4_NL is good but I'm unsure. Thanks!

Sign up or log in to comment