How to set stopping criteria in model.generate() when a certain word appears The word I need to stop the generation when found is : [/SENTENCE] But the model doesn’t generate the word itself, instead, it generates the subwords [ [/,SEN,TE,NC,E] ] like this. corresponding IDs from the tokenizer …

Imho if you are fine tuning the model to stop generation at encountering [/sentence] token and it’s generating subwords, you should probably train it for a few more epochs. You could include the prediction generated during training in the evaluation loop and see when the complete eos token is being…

@Sandy1857 so why we don’t solve this problem by using the transformers.StoppingCriteriaList() class inside model.generate() function

How to set stopping criteria in model.generate() when a certain word appears

🤗Transformers

berkecr February 18, 2024, 11:01am 4

@Pradeep1995 this may be a good solution.

Topic		Replies	Views
Implimentation of Stopping Criteria List Beginners	24	31301	January 24, 2025
Implementing StoppingCriteria for Code Generating Transformers 🤗Transformers	2	3186	January 4, 2024
How to stop after generating "###" in transformers? Beginners	0	888	May 3, 2023
Generate function and stopping criteria - stop when generated entire word (continue if subtoken merely part of word) Beginners	0	2203	March 3, 2023
StoppingCriteria not working Beginners	0	239	November 30, 2023

How to set stopping criteria in model.generate() when a certain word appears

Related topics