meta-llama
/

Llama-3.1-405B-FP8

Text Generation

text-generation-inference

Model card Files Files and versions

Resources

View closed (15)

Access request FAQ

#13 opened over 1 year ago by

Need access

#20 opened about 1 year ago by

inference api no longer working

#18 opened over 1 year ago by

Config KV Heads should be 8 now?

#16 opened over 1 year ago by

Updated eos_token to include multiple IDs

#14 opened over 1 year ago by