Firworks's picture

Firworks

Firworks

·

firworksyt

AI & ML interests

Local Inference, Fine Tunes, & NVFP4 Quantization

Recent Activity

new activity about 3 hours ago

Firworks/NVIDIA-Nemotron-3-Nano-30B-A3B-nvfp4:"NotImplementedError: is_act_and_mul=False" Error

new activity about 12 hours ago

Firworks/IQuest-Coder-V1-40B-Instruct-nvfp4:Loop instruct version?

liked a model about 12 hours ago

Elias-Schwegler/IQuest-Coder-V1-40B-Loop-Instruct-NVFP4

View all activity

Organizations

None yet

New activity in Firworks/NVIDIA-Nemotron-3-Nano-30B-A3B-nvfp4 about 3 hours ago

"NotImplementedError: is_act_and_mul=False" Error

#1 opened 27 days ago by

New activity in Firworks/IQuest-Coder-V1-40B-Instruct-nvfp4 about 12 hours ago

Loop instruct version?

#3 opened about 12 hours ago by

pathosethoslogos

New activity in Firworks/IQuest-Coder-V1-40B-Instruct-nvfp4 5 days ago

A little confused about model card

#2 opened 5 days ago by

pathosethoslogos

New activity in mradermacher/model_requests 8 days ago

Firworks/Qwen2.5-3B-Instruct-Reticent

#1675 opened 8 days ago by

New activity in Firworks/MiniMax-M2.1-nvfp4 12 days ago

Model request

#1 opened 13 days ago by

pathosethoslogos

how to run the model on vllm

#2 opened 13 days ago by

New activity in Firworks/Llama-3.3-70B-Joyous-nvfp4 14 days ago

nvFP4 script

#1 opened 14 days ago by

New activity in MiniMaxAI/MiniMax-M2.1 17 days ago

NVFP4?

#2 opened 19 days ago by

New activity in Firworks/Qwen3-Coder-REAP-25B-A3B-nvfp4 17 days ago

It works!

#1 opened 18 days ago by

New activity in Firworks/Qwen3-VL-32B-Thinking-nvfp4 17 days ago

Fix trailing comma in config.json

#2 opened 17 days ago by

New activity in cerebras/Qwen3-Coder-REAP-25B-A3B 19 days ago

NVFP4?

#9 opened 19 days ago by

New activity in Firworks/Ministral-3-14B-Instruct-2512-nvfp4 24 days ago

Issues while running the model within vLLMs nightly docker build as given in the readme

#1 opened 25 days ago by

New activity in zai-org/GLM-4.6V-Flash 27 days ago

vLLM error

#8 opened about 1 month ago by

New activity in Firworks/Cydonia-24B-v4.3-nvfp4 27 days ago

Need more info about your quant

#1 opened 27 days ago by

New activity in google/gemma-3-270m-it 29 days ago

Delete config.json

#14 opened 29 days ago by

Delete model.safetensors

#13 opened 29 days ago by

New activity in Firworks/INTELLECT-3-nvfp4 about 1 month ago

does not appear to have a file named configuration_glm4_moe.py

#7 opened about 1 month ago by

New activity in cerebras/MiniMax-M2-REAP-139B-A10B about 1 month ago

NVFP4 version

#2 opened about 1 month ago by

New activity in Firworks/KAT-Dev-72B-Exp-nvfp4 about 1 month ago

What tok/sec do you get on a PRO 6000 Blackwell?

#3 opened about 1 month ago by

New activity in Firworks/Devstral-Small-2-24B-Instruct-2512-nvfp4 about 1 month ago

What problem are you having? I might be able to help.

#2 opened about 1 month ago by