HF-Quantization
/

Llama-3.2-1B-TORCHAO-W4

Model card Files Files and versions

Llama-3.2-1B-TORCHAO-W4

1.06 GB

Ctrl+K

Ctrl+K

1 contributor

History: 4 commits

medmekk's picture

Upload README.md with huggingface_hub

4cbb468 verified over 1 year ago

.gitattributes

1.57 kB
Upload tokenizer over 1 year ago
README.md

1 kB
Upload README.md with huggingface_hub over 1 year ago
config.json

1.08 kB
Upload LlamaForCausalLM over 1 year ago
generation_config.json

185 Bytes
Upload LlamaForCausalLM over 1 year ago
pytorch_model.bin
Detected Pickle imports (14)
- "torch.serialization._get_layout",
- "torchao.dtypes.affine_quantized_tensor.AffineQuantizedTensor",
- "torch.bfloat16",
- "torch.int32",
- "torchao.dtypes.uintx.tensor_core_tiled_layout.TensorCoreTiledLayout",
- "torch.BFloat16Storage",
- "torch.IntStorage",
- "torch._utils._rebuild_wrapper_subclass",
- "collections.OrderedDict",
- "torchao.dtypes.uintx.tensor_core_tiled_layout.TensorCoreTiledAQTTensorImpl",
- "torchao.quantization.quant_primitives.ZeroPointDomain",
- "torch.device",
- "torch._utils._rebuild_tensor_v2",
- "torch._tensor._rebuild_from_type_v2"
How to fix it?
1.04 GB
xet

Upload LlamaForCausalLM over 1 year ago
special_tokens_map.json

301 Bytes
Upload tokenizer over 1 year ago
tokenizer.json

17.2 MB
xet

Upload tokenizer over 1 year ago
tokenizer_config.json

50.5 kB
Upload tokenizer over 1 year ago