Joseph H Sadove
1 min readAug 4, 2020

--

BeautifulSoup is definitely fun and "easy" to use.... but only if you study the web page structure and only if that structure does not change.

And, you have to build your own execution and navigation infrastructure, etc.

For doing real scraping you need something like Nutch/Solr or Sparkler.

--

--

No responses yet