In inference, take sequence length from the model shape #51
Description
Currently, it is hardcoded. In that part of the workflow, it is irrelevant what the cli defaults say, the sequence length is the shape of the input in the model.
{{ message }}
Currently, it is hardcoded. In that part of the workflow, it is irrelevant what the cli defaults say, the sequence length is the shape of the input in the model.