Python for Scientific Audio

Awesome Build Status

The aim of this repository is to create a comprehensive, curated list of python software/tools related and used for scientific research in audio/music applications.


  • Total number of packages: 66


Transformations - General DSP

Feature extraction

Data augmentation

Speech Processing

Environmental Sounds

Perceptial Models - Auditory Models

Source Separation

  • commonfate :octocat: ๐Ÿ“ฆ - Common Fate Model and Transform.
  • NTFLib :octocat: - Sparse Beta-Divergence Tensor Factorization.
  • NUSSL :octocat: ๐Ÿ“ฆ - Holistic source separation framework including DSP methods and deep learning methods.
  • NIMFA :octocat: ๐Ÿ“ฆ - Several flavors of non-negative-matrix factorization.

Music Information Retrieval

  • Catchy :octocat: - Corpus Analysis Tools for Computational Hook Discovery.
  • chord-detection :octocat: - Algorithms for chord detection and key estimation.
  • Madmom :octocat: ๐Ÿ“ฆ - MIR packages with strong focus on beat detection, onset detection and chord recognition.
  • mir_eval :octocat: ๐Ÿ“ฆ - Common scores for various MIR tasks. Also includes bss_eval implementation.
  • msaf :octocat: ๐Ÿ“ฆ - Music Structure Analysis Framework.
  • librosa :octocat: ๐Ÿ“ฆ - General audio and music analysis.

Deep Learning

Symbolic Music - MIDI - Musicology

Realtime applications

  • Jupylet :octocat: - Subtractive, additive, FM, and sample-based sound synthesis.
  • PYO :octocat: - Realtime audio dsp engine.
  • python-sounddevice :octocat: ๐Ÿ“ฆ - PortAudio wrapper providing realtime audio I/O with NumPy.
  • ReTiSAR :octocat: - Binarual rendering of streamed or IR-based high-order spherical microphone array signals.

Web Audio

  • TimeSide (Beta) :octocat: - high level audio analysis, imaging, transcoding, streaming and labelling.

Audio Dataset and Dataloaders

Wrappers for Audio Plugins



Scientific Papers

Other Resources

There is already PythonInMusic but it is not up to date and includes too many packages of special interest that are mostly not relevant for scientific applications. Awesome-Python is large curated list of python packages. However, the audio section is very small.


Your contributions are always welcome! Please take a look at the contribution guidelines first.

I will keep some pull requests open if I'm not sure whether those libraries are awesome, you could vote for them by adding ๐Ÿ‘ to them.


License: CC BY 4.0