Hi John
Thank you for your script on how scrape the MLB pitch-specific data into a format I can use for my MySQL retrosheet database. I’ve been looking for a reliable way to do this for some time, and am happy I came across your instructions. Your script worked for me to create the two csv files. I used your "mysql_table_creator.sql" file to create the tables "atbats" and "pitches" in my retrosheet database; In particular, I imported the file from within Sequel Pro. Once the tables were created, I was also able to import the .csv files into their respective tables in the database using Sequel Pro. However, I wonder if you can help me with the following errors that I get once it finishes importing:
"There were errors"
[ERROR in row 485678] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485679] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485680] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485681] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485682] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485683] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485684] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485685] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485686] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485687] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485688] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485689] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485690] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485691] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485692] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485693] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485694] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485695] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485696] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485697] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485698] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485699] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485700] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485701] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485702] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485703] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485704] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485705] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485706] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485707] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485708] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485709] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485710] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485711] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485712] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485713] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485714] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485715] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485716] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485717] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485718] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485719] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485720] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485721] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485722] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485723] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485724] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485725] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485726] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485727] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485728] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485729] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485730] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485731] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485732] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485733] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485734] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485735] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485736] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485737] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485738] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485739] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485740] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485741] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485742] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485743] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485744] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485745] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485746] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485747] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485748] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485749] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485750] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485751] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485752] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485753] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485754] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485755] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485756] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485757] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485758] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485759] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485760] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485761] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485762] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485763] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485764] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485765] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485766] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485767] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485768] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485769] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485770] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485771] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485772] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485773] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485774] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485775] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485776] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485777] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485778] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485779] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485780] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485781] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485782] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485783] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485784] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485785] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485786] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485787] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485788] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485789] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485790] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485791] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485792] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485793] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485794] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485795] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485796] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485797] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485798] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485799] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485800] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485801] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485802] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485803] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485804] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485805] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485806] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485807] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485808] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485809] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485810] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485811] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485812] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485813] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485814] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485815] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485816] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485817] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485818] Data too long for column ‘pitch_seq’ at row 1
Is there something I need to change in your "mysql_table_creator.sql" file to not get the errors?
Thank you in advance.
Lee
Hi John
Thank you for your script on how scrape the MLB pitch-specific data into a format I can use for my MySQL retrosheet database. I’ve been looking for a reliable way to do this for some time, and am happy I came across your instructions. Your script worked for me to create the two csv files. I used your "mysql_table_creator.sql" file to create the tables "atbats" and "pitches" in my retrosheet database; In particular, I imported the file from within Sequel Pro. Once the tables were created, I was also able to import the .csv files into their respective tables in the database using Sequel Pro. However, I wonder if you can help me with the following errors that I get once it finishes importing:
"There were errors"
[ERROR in row 485678] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485679] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485680] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485681] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485682] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485683] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485684] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485685] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485686] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485687] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485688] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485689] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485690] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485691] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485692] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485693] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485694] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485695] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485696] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485697] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485698] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485699] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485700] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485701] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485702] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485703] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485704] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485705] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485706] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485707] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485708] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485709] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485710] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485711] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485712] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485713] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485714] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485715] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485716] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485717] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485718] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485719] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485720] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485721] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485722] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485723] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485724] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485725] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485726] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485727] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485728] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485729] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485730] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485731] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485732] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485733] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485734] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485735] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485736] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485737] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485738] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485739] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485740] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485741] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485742] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485743] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485744] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485745] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485746] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485747] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485748] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485749] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485750] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485751] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485752] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485753] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485754] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485755] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485756] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485757] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485758] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485759] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485760] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485761] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485762] Data too long for column ‘pitch_type_seq’ at row 1
[ERROR in row 485763] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485764] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485765] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485766] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485767] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485768] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485769] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485770] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485771] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485772] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485773] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485774] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485775] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485776] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485777] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485778] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485779] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485780] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485781] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485782] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485783] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485784] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485785] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485786] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485787] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485788] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485789] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485790] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485791] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485792] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485793] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485794] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485795] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485796] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485797] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485798] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485799] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485800] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485801] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485802] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485803] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485804] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485805] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485806] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485807] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485808] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485809] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485810] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485811] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485812] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485813] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485814] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485815] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485816] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485817] Data too long for column ‘pitch_seq’ at row 1
[ERROR in row 485818] Data too long for column ‘pitch_seq’ at row 1
Is there something I need to change in your "mysql_table_creator.sql" file to not get the errors?
Thank you in advance.
Lee