I'd like to understand how you obtained the final dataset 4526 during the data processing stage. I used data/data_files/all_vsr_validated_data.jsonl and followed your code, ultimately getting 6011. So I'm wondering if my .jsonl file is incorrect or if there are other elements I haven't set up properly.
I'd like to understand how you obtained the final dataset 4526 during the data processing stage. I used data/data_files/all_vsr_validated_data.jsonl and followed your code, ultimately getting 6011. So I'm wondering if my .jsonl file is incorrect or if there are other elements I haven't set up properly.