basic-pitch icon indicating copy to clipboard operation
basic-pitch copied to clipboard

Feature Suggestion: Extract clean and pleasant MIDI files like MelodyScanner's Arrangement Mode.

Open evan8686 opened this issue 6 months ago • 1 comments

Tools like Basic Pitch currently focus on transcribing notes directly from an audio source. The resulting MIDI is often noisy and cluttered with extraneous notes, making it musically unpleasant to listen to. Even with significant parameter tuning, it is difficult to achieve a clean, high-quality result.

I would like to suggest an evolution of the core functionality to achieve results similar to the "Arrangement Mode" found in MelodyScanner (powered by Klangio's technology). This mode provides the best results of any tool I have tried—the quality is stunning. It is also extremely user-friendly, requiring almost no technical knowledge to operate.

The "Arrangement Mode" functions as if an AI with deep music theory knowledge listens to the entire song and then re-arranges it into a new musical score based on its understanding.

Key features of this mode are:

It accepts audio uploads or direct YouTube links as input.

After selecting "Arrangement Mode," it offers further options for the arrangement's complexity, such as: Piano (Easy), Piano (Intermediate), and Piano (Full). In my testing, They all work great. The "Piano (Intermediate)" option is the most optimal.

It almost perfectly reproduces the clean vocal melody, as well as the instrumental melody during sections without lyrics. The resulting score is exceptionally clean, with virtually no noisy discordant notes. It is musically pleasant and generates a score that is immediately playable without needing further adjustments or optimization.

It supports exporting to MIDI, MusicXML, and printable PDF sheet music.

Unfortunately, generating a full song with this service requires a costly subscription. It would be incredible if Spotify could develop a similar feature and offer it for free to the community.

(If such a feature could be provided. I would be perfectly willing to use my local computer's processing power for this task, rather than consuming Spotify's cloud resources.)

The following video is a comparison(Includes Basic Pitch, Melody Scanner's Arrangement Mode, and the same part of the original song): https://www.youtube.com/watch?v=CE5G1yPT2Bw&ab_channel=%E5%9F%83%E6%96%87%E5%85%88%E7%94%9F

Once you've seen it, you'll know what a difference it makes.

evan8686 avatar Jul 01 '25 11:07 evan8686

You're proposing that someone magically come up equivalent of "Arrangement mode" so this could have the same functionality as commercial product.

romanr avatar Aug 16 '25 18:08 romanr