Georgia Tech Launches HearMe, A Free AI Music App

Drumming News :


Georgia Tech Releases HearMe, a Free AI Music App Built on the Idea That Music Should Be Played, Not Prompted

Developed by the Robotic Musicianship group at the Georgia Tech Center for Music Technology (GTCMT) , HearMe turns audio and midi recording into songs with editable notation and coaching feedback, and lets users make music with Shaia, a robotic musical partner

Georgia Tech Center for Music Technology (GTCMT)  today released HearMe, a free AI music app based on the premise that music should be played, not prompted. HearMe collaborates with users in creating songs that are generated based on their own musical input from any source – keyboard, guitar, voice, beats, etc. – generating song variations for users to explore, learn, and experiment with.  

Unlike other music generation applications, HearMe also provides active educational experiences based on the generated songs. These include play-along with musical notation, drumming exercises, chords and structural analysis, and a number of animated visualizations of the song.

Led by Professor Gil Weinberg, the Founding Director of GTCMT, HearMe places emphasis on the known benefits of active music making, turning AI supported song creation into a rewarding, personalized learning experience where users can practice and improve their musical skills, theory and composition as part of the process of writing original songs.

Weinberg’s team based the features of HearMe around research that links active music-making to brain development, psychological well-being, cognitive and academic performance, and social connectedness, as well as perseverance, self-identity and creativity. HearMe puts active musical engagement at the core of the experience, encouraging users to play instruments, sing, and learn theory and composition as part of the songwriting process.

What sets HearMe apart from prompt-based apps:

  • Creative control. HearMe is built around acoustic and electronic instruments and the voice, so users are actively and musically engaged in creating their songs.
  • Editing and visibility. HearMe converts the generated song into an editable piano notation and chord transcriptions, allowing users to improve their musical skills through drumming and keyboard playing feedback.
  • A robotic musical partner. With Shaia, a robotic feature built into HearMe, users can experiment with embodied and physical music making.

There are three ways to input a musical idea into HearMe: Record, Upload, or Play. Record lets you use the microphone in your computer or phone to input music, Upload lets you add a file (mp3 or .wav) and Play allows you to play MIDI keyboard (connected or on screen). You can also upload a MIDI file. Onboard instrument sounds (piano, guitar, percussion, organ, etc) allow you to hear the MIDI sounds input into the app.

Musical ideas you create can be saved in a Library and used to Generate versions of the song based on the musical ideas that were recorded, uploaded or played. Once generated, a Piano Roll and Chord display allow you to see the structure of the song.

A versatile Lyric section allows you to input your own lyrics, with options for HearMe to suggest alternate words and phrases based on syllable count and rhyme scheme. Collections of words can be saved and dragged to the Lyrics section to build the lyrics as you go.

Other features include: a Playground section that allows you to practice tapping to the song in different beat patterns; opportunity to practice your piano skills and receive feedback on playing the song; interactive improvisation with an animated version of Shaia the musical robot; and the ability to share your songs with others in the HearMe community.

Weinberg, an accomplished jazz pianist, put the app to the test on his own music: his new album, also titled HearMe, was created using the app and is available now on Spotify, Apple Music, Bandcamp and other streaming platforms under the artist name Gil W.

“Generative Musical AI, which uses typed prompts to make music instead of instruments and voices, risks undermining human agency and creativity,” says Weinberg. “But we can still control the narrative about the many benefits of active music making. HearMe demonstrates that we can build systems that restore artistry, elevate skills, and deepen musical understanding that helps build a creative future, not threaten it. Because music should be played, not prompted.”

HearMe is available free as a web-based app at www.hearme.music as well as on the iPhone store under HearMe Music..