No Chat Template

#1
by dipta007 - opened

I am getting this warning

No chat template is set for this processor, falling back to a default class-level template. This is very error-prone, because models are often trained with templates different from the class default! Default chat templates are a legacy feature and will be removed in Transformers v4.43, at which point any code depending on them will stop working. We recommend setting a valid chat template before then to ensure that this model continues working without issues.

Is it intentional?

TIGER-Lab org

I think it's a warning due to the new features of transformers. It's not intentional by us. The code to run Mantis-8B-Idefics2 shall be the same as the original Idefics2. If you can get this warning running Mantis-8B-Idefics2, then I guess you can also get this warning running the original Idefics2.

Not actually, there is no warning on the HuggingFaceM4/idefics2-8b model.
When I print the processor of mantis model, the chat template is null.
For immediate solution, I just loaded both of the processor and assigned the mantis one to the idefics2 one.

Not actually, there is no warning on the HuggingFaceM4/idefics2-8b model.
When I print the processor of mantis model, the chat template is null.
For immediate solution, I just loaded both of the processor and assigned the mantis one to the idefics2 one.

Yeah, I encounter the same issue here.

TIGER-Lab org

I have updated the processor, and now it shall be working with

processor = AutoProcessor.from_pretrained("TIGER-Lab/Mantis-8B-Idefics2")
DongfuJiang changed discussion status to closed

Sign up or log in to comment