Turkish-LLM-7B-Instruct-GGUF

GGUF quantizations of Turkish-LLM-7B-Instruct.

Quantizations

File Use Case
Q4_K_M Best for most users
Q5_K_M Higher quality
Q8_0 Near-original

Ollama

\n

Downloads last month
58
GGUF
Model size
7B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

4-bit

5-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ogulcanaydogan/Turkish-LLM-7B-Instruct-GGUF

Collection including ogulcanaydogan/Turkish-LLM-7B-Instruct-GGUF