Summary
extract_accomplishments navigates 8 LinkedIn sub-pages without calling the rate-limit detection function, causing silent empty results when LinkedIn rate-limits the scraper.
Location
- File:
src/scrapers/person.rs
- Line(s): 501–558
Severity
Medium
Details
extract_accomplishments calls self.base.navigate(&detail_url).await for each of 8 sub-pages (certifications, honors, publications, etc.) without calling detect_rate_limit. Unlike navigate_and_wait in utils.rs, these navigation calls silently return empty data when receiving rate-limit or CAPTCHA pages, without surfacing ScraperError::RateLimit.
Suggested Fix
Replace self.base.navigate calls with utils::navigate_and_wait (which includes rate-limit detection), or call self.base.check_rate_limit().await? after each navigation.
Automated finding by repo-monitor
Summary
extract_accomplishmentsnavigates 8 LinkedIn sub-pages without calling the rate-limit detection function, causing silent empty results when LinkedIn rate-limits the scraper.Location
src/scrapers/person.rsSeverity
Medium
Details
extract_accomplishmentscallsself.base.navigate(&detail_url).awaitfor each of 8 sub-pages (certifications, honors, publications, etc.) without callingdetect_rate_limit. Unlikenavigate_and_waitinutils.rs, these navigation calls silently return empty data when receiving rate-limit or CAPTCHA pages, without surfacingScraperError::RateLimit.Suggested Fix
Replace
self.base.navigatecalls withutils::navigate_and_wait(which includes rate-limit detection), or callself.base.check_rate_limit().await?after each navigation.Automated finding by repo-monitor