[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"project-79151":3},{"id":4,"name":5,"fullName":6,"owner":7,"repo":5,"description":8,"homepage":9,"htmlUrl":10,"language":11,"languages":9,"totalLinesOfCode":9,"stars":12,"forks":13,"watchers":14,"openIssues":15,"contributorsCount":9,"subscribersCount":16,"size":16,"stars1d":17,"stars7d":18,"stars30d":19,"stars90d":16,"forks30d":16,"starsTrendScore":20,"compositeScore":21,"rankGlobal":9,"rankLanguage":9,"license":9,"archived":22,"fork":22,"defaultBranch":23,"hasWiki":22,"hasPages":22,"topics":24,"createdAt":9,"pushedAt":9,"updatedAt":31,"readmeContent":32,"aiSummary":33,"trendingCount":16,"starSnapshotCount":16,"syncStatus":34,"lastSyncTime":35,"discoverSource":36},79151,"NeuralNote","DamRsn\u002FNeuralNote","DamRsn","Audio Plugin for Audio to MIDI transcription using deep learning.",null,"https:\u002F\u002Fgithub.com\u002FDamRsn\u002FNeuralNote","C++",2741,175,62,20,0,12,23,41,36,28.74,false,"main",[25,26,27,28,29,30],"audio","audio-plugin","juce-framework","machine-learning","midi","vst","2026-06-12 02:03:49","# NeuralNote \u003Cimg style=\"float: right;\" src=\"NeuralNote\u002FAssets\u002Flogo.png\" width=\"100\" \u002F>\n\nNeuralNote is the audio plugin that brings **state-of-the-art Audio to MIDI conversion** into\nyour favorite Digital Audio Workstation.\n\n- Works with any tonal instrument (voice included)\n- Supports polyphonic transcription\n- Supports pitch bend detection\n- Lightweight and very fast transcription\n- Allows to adjust the parameters while listening to the transcription\n- Allows to scale and time quantize transcribed MIDI directly in the plugin\n\n## Install NeuralNote\n\nDownload the latest release for your platform [here](https:\u002F\u002Fgithub.com\u002FDamRsn\u002FNeuralNote\u002Freleases) (Windows, macOS (\nUniversal) and Linux supported)!\n\nInstallers are available for both Windows and Mac, including Standalone, VST3, and AU (Mac only) versions. The\ninstallers allow users to select which format(s) they want to install. On macOS, the code is signed, while on Windows,\nit is not. This means you may need to take a few additional steps to use NeuralNote on Windows.\n\nFor Linux, raw binaries are provided for VST3 and Standalone. You can install them by copying the files to the\nappropriate locations.\n\n## Usage\n\n![UI](NeuralNote_UI.png)\n\nNeuralNote comes as a simple AudioFX plugin (VST3\u002FAU\u002FStandalone app) to be applied on the track to transcribe.\n\nThe workflow is very simple:\n\n- Gather some audio\n    - Click record. Works when recording for real or when playing the track in a DAW.\n    - Or drop an audio file on the plugin. (.wav, .aiff, .flac, .mp3 and .ogg (vorbis) supported)\n- The MIDI transcription instantly appears in the piano roll section.\n- Listen to the result by clicking the play button.\n    - Play with the different settings to adjust the transcription, even while listening to it\n    - Individually adjust the level of the source audio and of the synthesized transcription\n- Once you're satisfied, export the MIDI transcription with a simple drag and drop from the plugin to a MIDI track.\n\n**Watch our presentation video for the Neural Audio Plugin\ncompetition [here](https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=6_MC0_aG_DQ)**.\n\nNeuralNote uses internally the model from Spotify's [basic-pitch](https:\u002F\u002Fgithub.com\u002Fspotify\u002Fbasic-pitch). See\ntheir [blogpost](https:\u002F\u002Fengineering.atspotify.com\u002F2022\u002F06\u002Fmeet-basic-pitch\u002F)\nand [paper](https:\u002F\u002Farxiv.org\u002Fabs\u002F2203.09893) for more information. In NeuralNote, basic-pitch is run\nusing [RTNeural](https:\u002F\u002Fgithub.com\u002Fjatinchowdhury18\u002FRTNeural) for the CNN part\nand [ONNXRuntime](https:\u002F\u002Fgithub.com\u002Fmicrosoft\u002Fonnxruntime) for the feature part (Constant-Q transform calculation +\nHarmonic Stacking).\nAs part of this project, [we contributed to RTNeural](https:\u002F\u002Fgithub.com\u002Fjatinchowdhury18\u002FRTNeural\u002Fpull\u002F89) to add 2D\nconvolution support.\n\n## Build from source\n\nRequirements are: `git`, `cmake`, and your OS's preferred compiler suite.\n\nUse this when cloning:\n\n```\ngit clone --recurse-submodules --shallow-submodules https:\u002F\u002Fgithub.com\u002FDamRsn\u002FNeuralNote\n ```\n\nThe following OS-specific build scripts have to be executed at least once before being able to use the project as a\nnormal CMake project. The script downloads onnxruntime static library (that we created\nwith [ort-builder](https:\u002F\u002Fgithub.com\u002Folilarkin\u002Fort-builder)) before calling CMake.\n\n#### macOS\n\n```\n$ .\u002Fbuild.sh\n```\n\n#### Windows\n\nDue to [a known issue](https:\u002F\u002Fgithub.com\u002FDamRsn\u002FNeuralNote\u002Fissues\u002F21), if you're not using Visual Studio 2022 (MSVC\nversion: 19.35.x, check `cl` output), then you'll need to manually build onnxruntime.lib like so:\n\n1. Ensure you have Python installed; if not, download at https:\u002F\u002Fwww.python.org\u002Fdownloads\u002Fwindows\u002F (this does not\n   currently work with Python 3.11, prefer Python 3.10).\n\n2. Execute each of the following lines in a command prompt:\n\n```\ngit clone --depth 1 --recurse-submodules --shallow-submodules https:\u002F\u002Fgithub.com\u002Ftiborvass\u002Flibonnxruntime-neuralnote ThirdParty\\onnxruntime\ncd ThirdParty\\onnxruntime\npython3 -m venv venv\n.\\venv\\Scripts\\activate.bat\npip install -r requirements.txt\n.\\convert-model-to-ort.bat model.onnx\n.\\build-win.bat model.required_operators_and_types.with_runtime_opt.config\ncopy model.with_runtime_opt.ort ..\\..\\Lib\\ModelData\\features_model.ort\ncd ..\\..\n```\n\nNow you can get back to building NeuralNote as follows:\n\n```\n> .\\build.bat\n```\n\n#### IDEs\n\nOnce the build script has been executed at least once, you can load this project in your favorite IDE\n(CLion\u002FVisual Studio\u002FVSCode\u002Fetc) and click 'build' for one of the targets.\n\n## Reuse code from NeuralNote’s transcription engine\n\nAll the code to perform the transcription is in `Lib\u002FModel` and all the model weights are in `Lib\u002FModelData\u002F`. Feel free\nto use only this part of the code in your own project! We'll try to isolate it more from the rest of the repo in the\nfuture and make it a library.\n\nThe code to generate the files in `Lib\u002FModelData\u002F` is not currently available as it required a lot of manual operations.\nBut here's a description of the process we followed to create those files:\n\n- `features_model.onnx` was generated by converting a keras model containing only the CQT + Harmonic Stacking part of\n  the full basic-pitch graph using `tf2onnx` (with manually added weights for batch normalization).\n- the `.json` files containing the weights of the basic-pitch cnn were generated from the tensorflow-js model available\n  in the [basic-pitch-ts repository](https:\u002F\u002Fgithub.com\u002Fspotify\u002Fbasic-pitch-ts), then converted to onnx with `tf2onnx`.\n  Finally, the weights were gathered manually to `.npy` thanks to [Netron](https:\u002F\u002Fnetron.app\u002F) and finally applied to a\n  split keras model created with [basic-pitch](https:\u002F\u002Fgithub.com\u002Fspotify\u002Fbasic-pitch) code.\n\nThe original basic-pitch CNN was split in 4 sequential models wired together, so they can be run with RTNeural.\n\n## Bug reports and feature requests\n\nIf you have any request\u002Fsuggestion concerning the plugin or encounter a bug, please file a GitHub issue.\n\n## Contributing\n\nContributions are most welcome! If you want to add some features to the plugin or simply improve the documentation,\nplease open a PR!\n\n## License\n\nNeuralNote software and code is published under the Apache-2.0 license. See the [license file](LICENSE).\n\n#### Third Party libraries used and license\n\nHere's a list of all the third party libraries used in NeuralNote and the license under which they are used.\n\n- [JUCE](https:\u002F\u002Fjuce.com\u002F) (JUCE Starter)\n- [RTNeural](https:\u002F\u002Fgithub.com\u002Fjatinchowdhury18\u002FRTNeural) (BSD-3-Clause license)\n- [ONNXRuntime](https:\u002F\u002Fgithub.com\u002Fmicrosoft\u002Fonnxruntime) (MIT License)\n- [ort-builder](https:\u002F\u002Fgithub.com\u002Folilarkin\u002Fort-builder) (MIT License)\n- [basic-pitch](https:\u002F\u002Fgithub.com\u002Fspotify\u002Fbasic-pitch) (Apache-2.0 license)\n- [basic-pitch-ts](https:\u002F\u002Fgithub.com\u002Fspotify\u002Fbasic-pitch-ts) (Apache-2.0 license)\n- [minimp3](https:\u002F\u002Fgithub.com\u002Flieff\u002Fminimp3) (CC0-1.0 license)\n\n## Could NeuralNote transcribe audio in real-time?\n\nUnfortunately no and this for a few reasons:\n\n- Basic Pitch uses the Constant-Q transform (CQT) as input feature. The CQT requires really long audio chunks (> 1s) to\n  get amplitudes for the lowest frequency bins. This makes the latency too high to have real-time transcription.\n- The basic pitch CNN has an additional latency of approximately 120ms.\n- The note events creation algorithm processes the posteriorgrams backward (from future to past) and is hence\n  non-causal.\n\nBut if you have ideas please share!\n\n## Credits\n\nNeuralNote was developed by [Damien Ronssin](https:\u002F\u002Fgithub.com\u002FDamRsn) and [Tibor Vass](https:\u002F\u002Fgithub.com\u002Ftiborvass).\nThe plugin user interface was designed by Perrine Morel.\n\n#### Contributors\n\nMany thanks to the contributors!\n\n- [jatinchowdhury18](https:\u002F\u002Fgithub.com\u002Fjatinchowdhury18): File browser.\n- [trirpi](https:\u002F\u002Fgithub.com\u002Ftrirpi)\n    - More scale options in `SCALE QUANTIZE`.\n    - Horizontal zoom for the audio waveform and the piano roll.\n- [polygon](https:\u002F\u002Fgithub.com\u002Fpolygon) and [SamuMazzi](https:\u002F\u002Fgithub.com\u002FSamuMazzi): Linux support.","NeuralNote 是一款基于深度学习技术的音频转MIDI插件，适用于数字音频工作站。其核心功能包括支持任何音调乐器（包括人声）的多音轨转录、音高弯音检测以及快速轻量级转录，并允许用户在监听转录结果时调整参数。此外，它还支持直接在插件内对转录后的MIDI进行缩放和时间量化处理。NeuralNote采用C++开发，基于JUCE框架构建，利用Spotify的basic-pitch模型并通过RTNeural和ONNXRuntime实现高效的实时处理。这款插件非常适合音乐制作人或音频工程师在创作过程中快速准确地将音频转换为可编辑的MIDI数据，从而提高工作效率。",2,"2026-06-11 03:57:30","trending"]