VideoX Fun

Does it work with ComfyUI?

#1
by pip-nov - opened

Hi,
I wanted to try it out in ComfyUI, but I get an error:
"ERROR: controlnet file is invalid and does not contain a valid controlnet model."

Is it compatible with ComfyUI? Thanks in advance!

same here

What workflow did you use?
Wasn't able to find controlnet workflow for Flux.2

Same here...there is a ControlNet for the new Zimage. Comfyui had to create some nodes to make that work. Probably the same situation. Looks like Zimage is getting all the attention.

Same here:
File "/home/user/app/ComfyUI/nodes.py", line 815, in load_controlnet
raise RuntimeError("ERROR: controlnet file is invalid and does not contain a valid controlnet model.")
RuntimeError: ERROR: controlnet file is invalid and does not contain a valid controlnet model.

I'm working on it,
image
but it comes out kind of wrong...
Flux2_00096_
It should look like this...
00000001

Try to use ReferenceLatent node and place it:

  1. after 'Apply VideoX ControlNet' and before 'BasicGuider'
  2. after 'FluxGuidance' and before 'Apply VideoX ControlNet'
    nodes to see what will happen

I've about got it. I'm going to clean it up and get it in GitHub after verifying it with more control images and pinpointing is verified. But it's looking good, I think.

image

pinpointing! Thanks, Apple, I typed INPAINTING!

VAE patchify and RoPE worked out:
image

Canny seems to work well too
canny

Flux2_00121_

Thank Claude, I more or less vibe-coded this shiz. It seems to work as expected, though.

where do you get the VideoX controlNet Loader _V2

From me. When it finally works I'll share a link.

Sign up or log in to comment