EDIT: sorted hahah but the error mentioned at the bottom is still worthwhile looking at, so I rename this to
ignore and continue: STOPPED ('The read operation timed out',)
old:
for each retweet, the image is redownloaded. And some of the #devcon tweets are retweeted dozens of times, so I have tons of duplicate images now.
Do you have any idea how to prevent that? Perhaps keep some sqlite of which tweet's image is already downloaded, and then ignore that image for all of its retweets?
For my one task, all the #devcon3 images, I will now just be patient, and I hope it won't stop prematurely with the error (*) described below; and then I use a photo sorting program to remove duplicates. But for the general usefulness, it would be nice to have a switch -noretweeetimages which does prints the tweet texts, but does not download the image again.
But hey - great tool, I am very very happy.
mentioned error (*)
BobSummerwill: RT @slockitproject: USN Architecture Diagram - want to work with us? info@slock.it. #devcon #ethereum #blockchain https://t.co/7hjpKUbjHU
Sun Nov 05 09:12:39 +0000 2017
*** STOPPED ('The read operation timed out',)
probably the gps lookup failed?
in most cases, we would like to (perhaps retry once, then) simply catch-and-ignore that exception; so I am waiting for it to happen again, to see which exact exception to catch: drandreaskrueger@0deb046
EDIT: sorted hahah but the error mentioned at the bottom is still worthwhile looking at, so I rename this to
ignore and continue: STOPPED ('The read operation timed out',)
old:
for each retweet, the image is redownloaded. And some of the #devcon tweets are retweeted dozens of times, so I have tons of duplicate images now.
Do you have any idea how to prevent that? Perhaps keep some sqlite of which tweet's image is already downloaded, and then ignore that image for all of its retweets?
For my one task, all the #devcon3 images, I will now just be patient, and I hope it won't stop prematurely with the error (*) described below; and then I use a photo sorting program to remove duplicates. But for the general usefulness, it would be nice to have a switch
-noretweeetimageswhich does prints the tweet texts, but does not download the image again.But hey - great tool, I am very very happy.
mentioned error (*)
probably the gps lookup failed?
in most cases, we would like to (perhaps retry once, then) simply catch-and-ignore that exception; so I am waiting for it to happen again, to see which exact exception to catch: drandreaskrueger@0deb046