You are viewing a single comment's thread from:

RE: Scrapy - extracting the data you need from websites

in #steemhunt7 years ago

It's been useful actually, but i believe that many sites actually are blocking the accesses from those APIs. You may need to use it with VPN. Also im not sure if react-based websites nowadays would be working well with these types of scraping tools because they generate html tags after the server call (or only in a client page).