Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
193.2
TFLOPS
6
37
189
Matthew Douglas
PRO
mdouglas
Follow
Realpat's profile picture
TylerHilbert's profile picture
ror's profile picture
74 followers
·
67 following
mattkdouglas
matthewdouglas
mkdouglas
AI & ML interests
LLMs, quantization, NLP, embeddings, hardware, DevEx
Organizations
mdouglas
's activity
All
Models
Datasets
Spaces
Papers
Collections
Community
Posts
Upvotes
Likes
Articles
New activity in
hugging-quants/Meta-Llama-3.1-405B-BNB-NF4-BF16
about 1 year ago
update the config.json and the weights
1
#1 opened over 1 year ago by
Rudra-ai
New activity in
google/gemma-2-27b-it
over 1 year ago
4 bit and 8 bit bnb quants only generate empty strings or one token repeated endlessly
2
#32 opened over 1 year ago by
nicorinn-google
4bit-quantized gemma-2-27b-it generates only pad tokens, like '<pad><pad><pad><pad><pad><pad><pad><pad><pad>'.
6
#29 opened over 1 year ago by
kshinoda
New activity in
hugging-quants/Meta-Llama-3.1-8B-BNB-NF4
over 1 year ago
Update `license`
#1 opened over 1 year ago by
alvarobartt
New activity in
mdouglas/guanamyra-small
about 2 years ago
Adding `safetensors` variant of this model
#1 opened about 2 years ago by
SFconvertbot