Sign In

Communications of the ACM

ACM TechNews

'Audeo' Teaches AI to Play the Piano

View as: Print Mobile App Share: Send by email Share on reddit Share on StumbleUpon Share on Hacker News Share on Tweeter Share on Facebook
Learning to play the piano.

University of Washington researchers used machine learning to create a system that creates audio from silent piano performances.

Credit: Patrick Tomasso

University of Washington (UW) researchers have developed a system that generates audio from silent piano performances.

UW's Eli Shlizerman explained the goal of the research “was to see if artificial intelligence could generate music that was played by a pianist in a video recording."

Audeo decodes what transpires in the video and translates it into music, by first detecting which keys are pressed in each frame to produce a diagram; it then converts the diagram into something a music synthesizer would recognize as a sound a piano would make.

This step de-noises the data and adds more information, like how strongly each key is pressed and for how long.

When the UW team tested Audeo's compositions with music-recognition applications like SoundHound, the apps correctly identified the piece with about 86% accuracy.

Said Shlizerman, “We hope that our study enables novel ways to interact with music.”

From UW News
View Full Article


Abstracts Copyright © 2021 SmithBucklin, Washington, DC, USA


No entries found

Sign In for Full Access
» Forgot Password? » Create an ACM Web Account
ACM Resources