Hugging Face's logo

waltgrace
/
llama-cpp-expert-sniper

Text Generation
GGUF
Mixture of Experts
expert-prefetch
madvise
llama-cpp
apple-silicon
cuda
on-device
Model card Files
xet
 Community
1
llama-cpp-expert-sniper
320 kB
  • 1 contributor
 History: 14 commits
waltgrace's picture
waltgrace
Q8 result: thrashes on 16 GB (CPU_REPACK doubles memory)
8270847 verified