Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
QuantTrio
/
DeepSeek-V3.1-AWQ-Lite
like
3
Follow
QuantTrio
148
Text Generation
Transformers
Safetensors
Chinese
English
deepseek_v3
vLLM
AWQ
conversational
custom_code
text-generation-inference
4-bit precision
awq
arxiv:
2412.19437
License:
mit
Model card
Files
Files and versions
xet
Community
4
Deploy
Use this model
main
DeepSeek-V3.1-AWQ-Lite
/
awq_marlin.py
Commit History
Add files using upload-large-folder tool
b6a20ff
verified
JunHowie
commited on
Aug 29