Hi there! I want to run models on my macbook using Ollama, and was wondering which quant would be best for mac/arm? From the write-up it sounds like IQ4_NL is good but I'm unsure. Thanks!
· Sign up or log in to comment