Create evaluation data set for focused scenarios

[ddlliu]

Current Status:
Xlsx-lookup (single table)​ | 121 queries
Xlsx-aggregation (single table)​ | 34 queries
Xlsx-lookup (multiple tables)​ | 10 queries
Xlsx-aggregation (multiple tables)​ | 10 queries
PDF-lookup (single table)​ | 77 queries
DOCX-lookup (single table)​ | 43 queries
PPTX-lookup (single table)​ | 0 queries
file generation​ | 8 queries

Strategy
files + manually crafted few shot examples --> synthetic question and answers --> run code interpreter --> questions and code interpreter generated answers --> manual filtering --> manual labeling --> curated q/a pairs

Pointer of more details

[eholk]

Did you open this on the right repo? This doesn't seem related to this project.

[ddlliu]

Should be fixed

[andyzengmath]

Synthetic data generation v2's data creation process document
and data generated (combined) and folder