Please upload a "merged" version.
#1
by michaelfeil - opened
Hey there,
I would love to support this model in infinity. Is it possible to have this model runnable without Peft? There should be some additional free performance gains by absorbing the weights.
Hey @michaelfeil , i uploaded it via PR to test for now: https://huggingface.co/nomic-ai/nomic-embed-multimodal-7b/discussions/2
are you able to run the model from the PR? If so, I can go ahead and merge this assuming it doesn't break existing integrations with ColPali
ok cool, ideally i’d like to have everything in one place. it looks like the only thing the PR adds is new model weights and doesn’t update anything so it should be safe to run but I’ll double check tomorrow. Can you confirm it runs as expected?