AI Experiments is live.
— Google (@Google) November 16, 2016
There’s a bunch of amazing experiments on the site; but this one below is the one I spend the most time with during its early development phase.
Honestly; I never felt more out of my depth on a project than at the beginning of this one. Sat in the kickoffs with Alex, Kyle and Yotam who were deep in the weeds talking about t-SNE, dimensionality reduction, hi-dimensional space, convolutional neural networks, and supervised vs un-supervised learning. Was a full-on nose-bleed, crash course, in ML. But so worth it. Do not fear this stuff. It’s a different world to start; but after a few weeks it starts to take. So please enjoy….
The Infinite Drum Machine
— Google (@Google) November 18, 2016
Sounds are complex and vary widely. This experiment uses machine learning to organize thousands of everyday sounds. The computer wasn’t given any descriptions or tags – only the audio. Using a technique called t-SNE, the computer placed similar sounds closer together. You can use the map to explore neighborhoods of similar sounds and even make beats using the drum sequencer.
Here’s the explainer video:
For an extra sneak peak into the development process; here’s a video showing an earlier prototype. This one has around ~40k short samples from Freesound! For the final version we licensed ~17k.
This is one of the last projects I started working on in New York, so it’s great to see it out in the real world. Mad props to Alex, Catherine, Manny, Yotam, Eric, Jonas, Kyle, Gene and bunch of other very smart people.
And yea…. what Kyle said.
— Kyle McDonald (@kcimc) November 16, 2016
AI Experiments website: