人工智能让你的歌声不再跑调

Listening to your friends butcher your favorite songs during karaoke could become a thing of the past, thanks to software created by scientists.

Their AI* system can bring your pitch closer to the original artist’s intentions, without making your voice sound robotic or artificial.

That means nuances* in your voice are kept and that intentional vocal flourishes aren’t completely erased.

The software does this by shifting the pitch of individual sung notes to align them more closely with the accompanying music.

Sanna Wager, a Ph.D. candidate and main author of the study at Indiana University, said: “When looking at how to correct the current note, we look at what the singer did over the past few seconds.”

The current tool must be applied to recordings after they have been made, but the end product could be used to make changes on the fly*.

Her paper, published on Arxiv.org, contains audio samples of how a voice altered by the commercial version of the product could sound.

To create the system, researchers at Indiana University Bloomington used 4,702 amateur voice recordings from the online karaoke platform Smule to “train” their AI algorithm* to recognize and correct off-key notes.

The team selected 500 tracks that were performed in-tune and split the tracks into separate files, one for voice and one for the accompanying music. They then intentionally created an out-of-tune version of the voice track by randomly shifting notes up to a semitone* higher, while the accompaniment music was kept the same. The AI learnt to predict the amount that each voice note needed to be adjusted in order to stay in-pitch with the instrumental accompaniment.

This modulation* was then applied to all the off-key notes in each solo voice recording to correct the entire voice track.

(SD-Agencies)