Reinforcement Learning
Transformers
Safetensors
qwen2
text-generation
code-generation
software-engineering
long-context
quantized
awq
4-bit precision
72b
swe-bench
lmdeploy
text-generation-inference
Instructions to use twhitworth/KAT-Dev-72B-Exp-AWQ-INT4-noct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use twhitworth/KAT-Dev-72B-Exp-AWQ-INT4-noct with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForMultimodalLM tokenizer = AutoTokenizer.from_pretrained("twhitworth/KAT-Dev-72B-Exp-AWQ-INT4-noct") model = AutoModelForMultimodalLM.from_pretrained("twhitworth/KAT-Dev-72B-Exp-AWQ-INT4-noct") - Notebooks
- Google Colab
- Kaggle
File size: 133 Bytes
89daf7c | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
size 11421896
|