meta-llama
/

Llama-3.2-1B

Text Generation

text-generation-inference

Model card Files Files and versions

Instructions to use meta-llama/Llama-3.2-1B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use meta-llama/Llama-3.2-1B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="meta-llama/Llama-3.2-1B")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-3.2-1B")
model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.2-1B")

Inference
Notebooks
Google Colab
Kaggle
Local Apps

How to use meta-llama/Llama-3.2-1B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "meta-llama/Llama-3.2-1B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "meta-llama/Llama-3.2-1B",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/meta-llama/Llama-3.2-1B

How to use meta-llama/Llama-3.2-1B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "meta-llama/Llama-3.2-1B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "meta-llama/Llama-3.2-1B",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "meta-llama/Llama-3.2-1B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "meta-llama/Llama-3.2-1B",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use meta-llama/Llama-3.2-1B with Docker Model Runner:
```
docker model run hf.co/meta-llama/Llama-3.2-1B
```

Resources

View closed (43)

Access request rejected – could you please reset my request?

#359 opened 15 days ago by

Mine Gating Group Collection approvals on Hugging Face is still pending.

#358 opened 16 days ago by

Access request rejected – please reset

#357 opened about 1 month ago by

Access Request

#356 opened about 1 month ago by

[Apply for reset the access request which has been rejected]

#355 opened about 1 month ago by deleted

Access Request

#354 opened about 1 month ago by

Access Request

#352 opened about 2 months ago by

Access Request

#351 opened 2 months ago by

Access request

#350 opened 2 months ago by

course-project

#348 opened 2 months ago by

Access-Request (National Taiwan University)

#347 opened 2 months ago by

fix: set `clean_up_tokenization_spaces` to `false`

#346 opened 2 months ago by

Access Request

#345 opened 2 months ago by

Access Request

#344 opened 3 months ago by

Access request

#343 opened 3 months ago by

Install & run meta-llama/Llama-3.2-1B easily using llmpm

#342 opened 3 months ago by

Access Request

#341 opened 3 months ago by

Access Request

#340 opened 3 months ago by

testing

#339 opened 3 months ago by

Terminator-2026

Access Request

#338 opened 3 months ago by

limingwanggrant

Access request was rejected, accidentally not filling the "affiliate" section

#337 opened 3 months ago by

Access Application Re-review Request

#336 opened 3 months ago by

Access Rejection Reconsideration

#335 opened 3 months ago by

Discussion with empty pull_request parameter test

#333 opened 4 months ago by

Reject

#332 opened 4 months ago by

Request: DOI

#331 opened 4 months ago by

wanderingnomadd

Request Denied

#329 opened 6 months ago by

Reject

#328 opened 6 months ago by

Request access for llama3.2 models

#327 opened 6 months ago by

Request reject

#326 opened 6 months ago by

Request Rejected

#325 opened 6 months ago by

Request: DOI

#324 opened 6 months ago by

request for help of access approval

#323 opened 6 months ago by

Request for access after rejected

#322 opened 7 months ago by

Request Access

#321 opened 7 months ago by

Model access

#320 opened 7 months ago by

request the access permission

#319 opened 7 months ago by

Request Access

#318 opened 7 months ago by

testing

#317 opened 7 months ago by

Add link to Neuron-optimized version

#316 opened 7 months ago by

Request access

#315 opened 7 months ago by

Request: DOI

#314 opened 8 months ago by

Request: DOI

#313 opened 8 months ago by

Request to revoke my access to the model

#312 opened 8 months ago by deleted

Your request to access model meta-llama/Llama-3.2-1B has been rejected by the repo's authors.

#311 opened 8 months ago by

Could you please help me grant pull permissions?

#310 opened 8 months ago by

llama_3.2

#309 opened 8 months ago by

Request: DOI

#308 opened 8 months ago by

Access Token?

#307 opened 8 months ago by

Re-request rejected access

#306 opened 8 months ago by