Currently, when listing large directories, the file list needs to be buffered in memory. This is fine for ~50K files but likely won't work well for ~1M files (in a single directory).
Unfortunately, ipfs ls accepts multiple arguments. If we want to stream back results, we'll have to somehow group them by directory (hopefully without sending too much extra data).
Currently, when listing large directories, the file list needs to be buffered in memory. This is fine for ~50K files but likely won't work well for ~1M files (in a single directory).
Unfortunately,
ipfs lsaccepts multiple arguments. If we want to stream back results, we'll have to somehow group them by directory (hopefully without sending too much extra data).