SInES Tools: Instrument & Ensemble Recognizer (CLAP)
(AI based batch instruments analysis with transformers.js and Larger CLAP Music and Speech)

 

Profile:   •   Win: s   •   Hop: s

1. Click on "Start" and wait for the AI Model to load entirely.
2. Select an Ensemble Profile (improves AI accuracy significantly!).
3. Set Window and Hop Size (or leave defaults) and Upload one or multiple audio file(s).
4. optional: If you have uploaded multiple audio files to analyze them in a batch:
   Additionally, export a table for each file containing all individual values over time as a .zip file
5. Click on "Analyse" (Browser may pause slightly).
6. optional (Single-File only): View the plot (move the mouse over the plot to listen to the audio segment).
7. Click on "Show JS Arrays" or "Export CSV", to output the recorded data.

Loading AI Model... Please wait.

Instrument & Ensemble Recognizer © 2026 by Christoph Reuter and SInES (last modified: 24.6.2026) is released under MIT License
Translation of the Chinese version of the website: Li Hao
How to cite: Reuter, C. (2026). SInES Tools: Instrument & Ensemble Recognizer. Web Application https://sinestools.univie.ac.at/clap_music_analyser.htm