Improve memory efficiency when reading packet files #185
Description
In generators/utils.py::_read_packet_file, if a user passes in a str path, Path, or PathLike (e.g. an S3Path), we read the entire binary file into memory before passing it to the generator object. This is not ideal for memory usage, though it does provide better performance than requiring the generator to repeatedly read from disk.
To support users who want to pass in gigantic files that don't fit in memory using PathLike objects, we can ...
@greglucas can you fill in the blank?