Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
QuantTrio
/
DeepSeek-V3.1-AWQ-Lite
like
3
Follow
QuantTrio
145
Text Generation
Transformers
Safetensors
Chinese
English
deepseek_v3
vLLM
AWQ
conversational
custom_code
text-generation-inference
4-bit precision
awq
arxiv:
2412.19437
License:
mit
Model card
Files
Files and versions
xet
Community
2
Deploy
Use this model
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (1)
Sort: Recently created
ooof this fits in 4x96gb can we get this for the new 3.2 Speciale ase well please :)
16
#2 opened 9 days ago by
Fernanda24