Skip to content

why block size 4 is pretty slow? #35

@gydpku

Description

@gydpku

Thanks for your great work.

When I change the block_length in eval_llada_mini.sh from 32 to 4, the generation rate becomes pretty slow (e.g., 90 minutes for gsm8k_cot). Can you tell me why?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions