mradermacher
/

InfLLM-V2-Short-Dense-Base-GGUF

dense-attention

Model card Files Files and versions

InfLLM-V2-Short-Dense-Base-GGUF

72.6 GB

1 contributor

History: 17 commits

mradermacher's picture

auto-patch README.md

18459f8 verified about 1 month ago

.gitattributes

2.41 kB

uploaded from marco about 1 month ago
InfLLM-V2-Short-Dense-Base.IQ4_XS.gguf

4.49 GB
xet

uploaded from marco about 1 month ago
InfLLM-V2-Short-Dense-Base.Q2_K.gguf

3.12 GB
xet

uploaded from marco about 1 month ago
InfLLM-V2-Short-Dense-Base.Q3_K_L.gguf

4.34 GB
xet

uploaded from marco about 1 month ago
InfLLM-V2-Short-Dense-Base.Q3_K_M.gguf

4.02 GB
xet

uploaded from marco about 1 month ago
InfLLM-V2-Short-Dense-Base.Q3_K_S.gguf

3.64 GB
xet

uploaded from marco about 1 month ago
InfLLM-V2-Short-Dense-Base.Q4_K_M.gguf

4.97 GB
xet

uploaded from marco about 1 month ago
InfLLM-V2-Short-Dense-Base.Q4_K_S.gguf

4.72 GB
xet

uploaded from marco about 1 month ago
InfLLM-V2-Short-Dense-Base.Q5_K_M.gguf

5.81 GB
xet

uploaded from marco about 1 month ago
InfLLM-V2-Short-Dense-Base.Q5_K_S.gguf

5.67 GB
xet

uploaded from marco about 1 month ago
InfLLM-V2-Short-Dense-Base.Q6_K.gguf

6.72 GB
xet

uploaded from marco about 1 month ago
InfLLM-V2-Short-Dense-Base.Q8_0.gguf

8.7 GB
xet

uploaded from marco about 1 month ago
InfLLM-V2-Short-Dense-Base.f16.gguf

16.4 GB
xet

uploaded from marco about 1 month ago
README.md

3.84 kB

auto-patch README.md about 1 month ago