SINES Tools: Hand Tracking and Audio Feature Analysis (for two hands; Signal Analysis: Meyda) Chrome only!!!

1. Click on "Start" to set all values on default.
2. Upload an mp4 video file (duration: more than 6 seconds) showing one or two moving hands of one person.
3. optional: If you know the exact frame rate of the video, you can enter/correct it here: fps.
Otherwise, rely on the frame rate calculated by the app.
4. optional: Select whether the movement should be detected in real time or frame by frame
    real time (fast, with audio features, but less accurate) or
    frame by frame (slow and as accurate as possible, but without audio features).
5. optional: Select the noise gate setting to avoid artifacts in silent parts of the sound:
    noise gate off (quiet parts will be analysed) or
    noise gate on (quiet parts will not be analysed).
6. Click on "Analyse" and play the video to the end.
 7. optional: View data in the plot
8. Click on "Show JS Arrays" to view/export the movement data for further examination in the 3D Hand Tracking Visualizer
    or click on "Export CSV" to export the recorded data as a CSV/Excel file.

Feature Mean Stdev Median Min Max Range
Hand 1:
Wrist: left <--> right (X)
0
0
0
0
0
0
Wrist: up <--> down (Y)
0
0
0
0
0
0
Wrist: left <--> right (X3D)
0
0
0
0
0
0
Wrist: up <--> down (Y3D)
0
0
0
0
0
0
Wrist: front<--> back (Z3D)
0
0
0
0
0
0
Thumb: J1, left <--> right (X)
0
0
0
0
0
0
Thumb: J1, up <--> down (Y)
0
0
0
0
0
0
Thumb: J1, left <--> right (X3D)
0
0
0
0
0
0
Thumb: J1, up <--> down (Y3D)
0
0
0
0
0
0
Thumb: J1, fr. <--> back (Z3D)
0
0
0
0
0
0
Thumb: J2, left <--> right (X)
0
0
0
0
0
0
Thumb: J2, up <--> down (Y)
0
0
0
0
0
0
Thumb: J2, left <--> right (X3D)
0
0
0
0
0
0
Thumb: J2, up <--> down (Y3D)
0
0
0
0
0
0
Thumb: J2, fr.<--> back (Z3D)
0
0
0
0
0
0
Thumb: J3, left <--> right (X)
0
0
0
0
0
0
Thumb: J3, up <--> down (Y)
0
0
0
0
0
0
Thumb: J3, left <--> right (X3D)
0
0
0
0
0
0
Thumb: J3, up <--> down (Y3D)
0
0
0
0
0
0
Thumb: J3, fr.<--> back (Z3D)
0
0
0
0
0
0
Thumb: Tip, left <--> right (X)
0
0
0
0
0
0
Thumb: Tip, up <--> down (Y)
0
0
0
0
0
0
Thumb: Tip, left <--> right (X3D)
0
0
0
0
0
0
Thumb: Tip, up <--> down (Y3D)
0
0
0
0
0
0
Thumb: Tip, fr.<--> back (Z3D)
0
0
0
0
0
0
Index F.: J1, left <--> right (X)
0
0
0
0
0
0
Index F.: J1, up <--> down (Y)
0
0
0
0
0
0
Index F.: J1, left <--> right (X3D)
0
0
0
0
0
0
Index F.: J1, up <--> down (Y3D)
0
0
0
0
0
0
Index F.: J1, fr. <--> back (Z3D)
0
0
0
0
0
0
Index F.: J2, left <--> right (X)
0
0
0
0
0
0
Index F.: J2, up <--> down (Y)
0
0
0
0
0
0
Index F.: J2, left <--> right (X3D)
0
0
0
0
0
0
Index F.: J2, up <--> down (Y3D)
0
0
0
0
0
0
Index F.: J2, fr.<--> back (Z3D)
0
0
0
0
0
0
Index F.: J3, left <--> right (X)
0
0
0
0
0
0
Index F.: J3, up <--> down (Y)
0
0
0
0
0
0
Index F.: J3, left <--> right (X3D)
0
0
0
0
0
0
Index F.: J3, up <--> down (Y3D)
0
0
0
0
0
0
Index F.: J3, fr.<--> back (Z3D)
0
0
0
0
0
0
Index F.: Tip, left <--> right (X)
0
0
0
0
0
0
Index F.: Tip, up <--> down (Y)
0
0
0
0
0
0
Index F.: Tip, left <--> right (X3D)
0
0
0
0
0
0
Index F.: Tip, up <--> down (Y3D)
0
0
0
0
0
0
Index F.: Tip, fr.<--> back (Z3D)
0
0
0
0
0
0
Middle F.: J1, left <--> right (X)
0
0
0
0
0
0
Middle F.: J1, up <--> down (Y)
0
0
0
0
0
0
Middle F.: J1, left <--> right (X3D)
0
0
0
0
0
0
Middle F.: J1, up <--> down (Y3D)
0
0
0
0
0
0
Middle F.: J1, fr. <--> back (Z3D)
0
0
0
0
0
0
Middle F.: J2, left <--> right (X)
0
0
0
0
0
0
Middle F.: J2, up <--> down (Y)
0
0
0
0
0
0
Middle F.: J2, left <--> right (X3D)
0
0
0
0
0
0
Middle F.: J2, up <--> down (Y3D)
0
0
0
0
0
0
Middle F.: J2, fr.<--> back (Z3D)
0
0
0
0
0
0
Middle F.: J3, left <--> right (X)
0
0
0
0
0
0
Middle F.: J3, up <--> down (Y)
0
0
0
0
0
0
Middle F.: J3, left <--> right (X3D)
0
0
0
0
0
0
Middle F.: J3, up <--> down (Y3D)
0
0
0
0
0
0
Middle F.: J3, fr.<--> back (Z3D)
0
0
0
0
0
0
Middle F.: Tip, left <--> right (X)
0
0
0
0
0
0
Middle F.: Tip, up <--> down (Y)
0
0
0
0
0
0
Middle F.: Tip, left <--> right (X3D)
0
0
0
0
0
0
Middle F.: Tip, up <--> down (Y3D)
0
0
0
0
0
0
Middle F.: Tip, fr.<--> back (Z3D)
0
0
0
0
0
0
Ring F.: J1, left <--> right (X)
0
0
0
0
0
0
Ring F.: J1, up <--> down (Y)
0
0
0
0
0
0
Ring F.: J1, left <--> right (X3D)
0
0
0
0
0
0
Ring F.: J1, up <--> down (Y3D)
0
0
0
0
0
0
Ring F.: J1, fr. <--> back (Z3D)
0
0
0
0
0
0
Ring F.: J2, left <--> right (X)
0
0
0
0
0
0
Ring F.: J2, up <--> down (Y)
0
0
0
0
0
0
Ring F.: J2, left <--> right (X3D)
0
0
0
0
0
0
Ring F.: J2, up <--> down (Y3D)
0
0
0
0
0
0
Ring F.: J2, fr.<--> back (Z3D)
0
0
0
0
0
0
Ring F.: J3, left <--> right (X)
0
0
0
0
0
0
Ring F.: J3, up <--> down (Y)
0
0
0
0
0
0
Ring F.: J3, left <--> right (X3D)
0
0
0
0
0
0
Ring F.: J3, up <--> down (Y3D)
0
0
0
0
0
0
Ring F.: J3, fr.<--> back (Z3D)
0
0
0
0
0
0
Ring F.: Tip, left <--> right (X)
0
0
0
0
0
0
Ring F.: Tip, up <--> down (Y)
0
0
0
0
0
0
Ring F.: Tip, left <--> right (X3D)
0
0
0
0
0
0
Ring F.: Tip, up <--> down (Y3D)
0
0
0
0
0
0
Ring F.: Tip, fr.<--> back (Z3D)
0
0
0
0
0
0
Pinky F.: J1, left <--> right (X)
0
0
0
0
0
0
Pinky F.: J1, up <--> down (Y)
0
0
0
0
0
0
Pinky F.: J1, left <--> right (X3D)
0
0
0
0
0
0
Pinky F.: J1, up <--> down (Y3D)
0
0
0
0
0
0
Pinky F.: J1, fr. <--> back (Z3D)
0
0
0
0
0
0
Pinky F.: J2, left <--> right (X)
0
0
0
0
0
0
Pinky F.: J2, up <--> down (Y)
0
0
0
0
0
0
Pinky F.: J2, left <--> right (X3D)
0
0
0
0
0
0
Pinky F.: J2, up <--> down (Y3D)
0
0
0
0
0
0
Pinky F.: J2, fr.<--> back (Z3D)
0
0
0
0
0
0
Pinky F.: J3, left <--> right (X)
0
0
0
0
0
0
Pinky F.: J3, up <--> down (Y)
0
0
0
0
0
0
Pinky F.: J3, left <--> right (X3D)
0
0
0
0
0
0
Pinky F.: J3, up <--> down (Y3D)
0
0
0
0
0
0
Pinky F.: J3, fr.<--> back (Z3D)
0
0
0
0
0
0
Pinky F.: Tip, left <--> right (X)
0
0
0
0
0
0
Pinky F.: Tip, up <--> down (Y)
0
0
0
0
0
0
Pinky F.: Tip, left <--> right (X3D)
0
0
0
0
0
0
Pinky F.: Tip, up <--> down (Y3D)
0
0
0
0
0
0
Pinky F.: Tip, fr.<--> back (Z3D)
0
0
0
0
0
0
Hand 2:
Wrist: left <--> right (X)
0
0
0
0
0
0
Wrist: up <--> down (Y)
0
0
0
0
0
0
Wrist: left <--> right (X3D)
0
0
0
0
0
0
Wrist: up <--> down (Y3D)
0
0
0
0
0
0
Wrist: front<--> back (Z3D)
0
0
0
0
0
0
Thumb: J1, left <--> right (X)
0
0
0
0
0
0
Thumb: J1, up <--> down (Y)
0
0
0
0
0
0
Thumb: J1, left <--> right (X3D)
0
0
0
0
0
0
Thumb: J1, up <--> down (Y3D)
0
0
0
0
0
0
Thumb: J1, fr. <--> back (Z3D)
0
0
0
0
0
0
Thumb: J2, left <--> right (X)
0
0
0
0
0
0
Thumb: J2, up <--> down (Y)
0
0
0
0
0
0
Thumb: J2, left <--> right (X3D)
0
0
0
0
0
0
Thumb: J2, up <--> down (Y3D)
0
0
0
0
0
0
Thumb: J2, fr.<--> back (Z3D)
0
0
0
0
0
0
Thumb: J3, left <--> right (X)
0
0
0
0
0
0
Thumb: J3, up <--> down (Y)
0
0
0
0
0
0
Thumb: J3, left <--> right (X3D)
0
0
0
0
0
0
Thumb: J3, up <--> down (Y3D)
0
0
0
0
0
0
Thumb: J3, fr.<--> back (Z3D)
0
0
0
0
0
0
Thumb: Tip, left <--> right (X)
0
0
0
0
0
0
Thumb: Tip, up <--> down (Y)
0
0
0
0
0
0
Thumb: Tip, left <--> right (X3D)
0
0
0
0
0
0
Thumb: Tip, up <--> down (Y3D)
0
0
0
0
0
0
Thumb: Tip, fr.<--> back (Z3D)
0
0
0
0
0
0
Index F.: J1, left <--> right (X)
0
0
0
0
0
0
Index F.: J1, up <--> down (Y)
0
0
0
0
0
0
Index F.: J1, left <--> right (X3D)
0
0
0
0
0
0
Index F.: J1, up <--> down (Y3D)
0
0
0
0
0
0
Index F.: J1, fr. <--> back (Z3D)
0
0
0
0
0
0
Index F.: J2, left <--> right (X)
0
0
0
0
0
0
Index F.: J2, up <--> down (Y)
0
0
0
0
0
0
Index F.: J2, left <--> right (X3D)
0
0
0
0
0
0
Index F.: J2, up <--> down (Y3D)
0
0
0
0
0
0
Index F.: J2, fr.<--> back (Z3D)
0
0
0
0
0
0
Index F.: J3, left <--> right (X)
0
0
0
0
0
0
Index F.: J3, up <--> down (Y)
0
0
0
0
0
0
Index F.: J3, left <--> right (X3D)
0
0
0
0
0
0
Index F.: J3, up <--> down (Y3D)
0
0
0
0
0
0
Index F.: J3, fr.<--> back (Z3D)
0
0
0
0
0
0
Index F.: Tip, left <--> right (X)
0
0
0
0
0
0
Index F.: Tip, up <--> down (Y)
0
0
0
0
0
0
Index F.: Tip, left <--> right (X3D)
0
0
0
0
0
0
Index F.: Tip, up <--> down (Y3D)
0
0
0
0
0
0
Index F.: Tip, fr.<--> back (Z3D)
0
0
0
0
0
0
Middle F.: J1, left <--> right (X)
0
0
0
0
0
0
Middle F.: J1, up <--> down (Y)
0
0
0
0
0
0
Middle F.: J1, left <--> right (X3D)
0
0
0
0
0
0
Middle F.: J1, up <--> down (Y3D)
0
0
0
0
0
0
Middle F.: J1, fr. <--> back (Z3D)
0
0
0
0
0
0
Middle F.: J2, left <--> right (X)
0
0
0
0
0
0
Middle F.: J2, up <--> down (Y)
0
0
0
0
0
0
Middle F.: J2, left <--> right (X3D)
0
0
0
0
0
0
Middle F.: J2, up <--> down (Y3D)
0
0
0
0
0
0
Middle F.: J2, fr.<--> back (Z3D)
0
0
0
0
0
0
Middle F.: J3, left <--> right (X)
0
0
0
0
0
0
Middle F.: J3, up <--> down (Y)
0
0
0
0
0
0
Middle F.: J3, left <--> right (X3D)
0
0
0
0
0
0
Middle F.: J3, up <--> down (Y3D)
0
0
0
0
0
0
Middle F.: J3, fr.<--> back (Z3D)
0
0
0
0
0
0
Middle F.: Tip, left <--> right (X)
0
0
0
0
0
0
Middle F.: Tip, up <--> down (Y)
0
0
0
0
0
0
Middle F.: Tip, left <--> right (X3D)
0
0
0
0
0
0
Middle F.: Tip, up <--> down (Y3D)
0
0
0
0
0
0
Middle F.: Tip, fr.<--> back (Z3D)
0
0
0
0
0
0
Ring F.: J1, left <--> right (X)
0
0
0
0
0
0
Ring F.: J1, up <--> down (Y)
0
0
0
0
0
0
Ring F.: J1, left <--> right (X3D)
0
0
0
0
0
0
Ring F.: J1, up <--> down (Y3D)
0
0
0
0
0
0
Ring F.: J1, fr. <--> back (Z3D)
0
0
0
0
0
0
Ring F.: J2, left <--> right (X)
0
0
0
0
0
0
Ring F.: J2, up <--> down (Y)
0
0
0
0
0
0
Ring F.: J2, left <--> right (X3D)
0
0
0
0
0
0
Ring F.: J2, up <--> down (Y3D)
0
0
0
0
0
0
Ring F.: J2, fr.<--> back (Z3D)
0
0
0
0
0
0
Ring F.: J3, left <--> right (X)
0
0
0
0
0
0
Ring F.: J3, up <--> down (Y)
0
0
0
0
0
0
Ring F.: J3, left <--> right (X3D)
0
0
0
0
0
0
Ring F.: J3, up <--> down (Y3D)
0
0
0
0
0
0
Ring F.: J3, fr.<--> back (Z3D)
0
0
0
0
0
0
Ring F.: Tip, left <--> right (X)
0
0
0
0
0
0
Ring F.: Tip, up <--> down (Y)
0
0
0
0
0
0
Ring F.: Tip, left <--> right (X3D)
0
0
0
0
0
0
Ring F.: Tip, up <--> down (Y3D)
0
0
0
0
0
0
Ring F.: Tip, fr.<--> back (Z3D)
0
0
0
0
0
0
Pinky F.: J1, left <--> right (X)
0
0
0
0
0
0
Pinky F.: J1, up <--> down (Y)
0
0
0
0
0
0
Pinky F.: J1, left <--> right (X3D)
0
0
0
0
0
0
Pinky F.: J1, up <--> down (Y3D)
0
0
0
0
0
0
Pinky F.: J1, fr. <--> back (Z3D)
0
0
0
0
0
0
Pinky F.: J2, left <--> right (X)
0
0
0
0
0
0
Pinky F.: J2, up <--> down (Y)
0
0
0
0
0
0
Pinky F.: J2, left <--> right (X3D)
0
0
0
0
0
0
Pinky F.: J2, up <--> down (Y3D)
0
0
0
0
0
0
Pinky F.: J2, fr.<--> back (Z3D)
0
0
0
0
0
0
Pinky F.: J3, left <--> right (X)
0
0
0
0
0
0
Pinky F.: J3, up <--> down (Y)
0
0
0
0
0
0
Pinky F.: J3, left <--> right (X3D)
0
0
0
0
0
0
Pinky F.: J3, up <--> down (Y3D)
0
0
0
0
0
0
Pinky F.: J3, fr.<--> back (Z3D)
0
0
0
0
0
0
Pinky F.: Tip, left <--> right (X)
0
0
0
0
0
0
Pinky F.: Tip, up <--> down (Y)
0
0
0
0
0
0
Pinky F.: Tip, left <--> right (X3D)
0
0
0
0
0
0
Pinky F.: Tip, up <--> down (Y3D)
0
0
0
0
0
0
Pinky F.: Tip, fr.<--> back (Z3D)
0
0
0
0
0
0
RMS
0
0
0
0
0
0
Energy
0
0
0
0
0
0
Spectral Centroid [Hz]
0
0
0
0
0
0
Zero Crossing Rate
0
0
0
0
0
0
Spectral Flatness
0
0
0
0
0
0
Spectral Flux
0
0
0
0
0
0
Positive Flux
0
0
0
0
0
0
Spectral Slope
0
0
0
0
0
0
Spectral Rolloff
0
0
0
0
0
0
Spectral Spread
0
0
0
0
0
0
Spectral Skewness
0
0
0
0
0
0
Spectral Kurtosis
0
0
0
0
0
0
Perceptual Spread
0
0
0
0
0
0
Perceptual Sharpness
0
0
0
0
0
0
Chroma C
0
0
0
0
0
0
Chroma C#
0
0
0
0
0
0
Chroma D
0
0
0
0
0
0
Chroma D#
0
0
0
0
0
0
Chroma E
0
0
0
0
0
0
Chroma F
0
0
0
0
0
0
Chroma F#
0
0
0
0
0
0
Chroma G
0
0
0
0
0
0
Chroma G#
0
0
0
0
0
0
Chroma A
0
0
0
0
0
0
Chroma A#
0
0
0
0
0
0
Chroma B
0
0
0
0
0
0
MFCC1
0
0
0
0
0
0
MFCC2
0
0
0
0
0
0
MFCC3
0
0
0
0
0
0
MFCC4
0
0
0
0
0
0
MFCC5
0
0
0
0
0
0
MFCC6
0
0
0
0
0
0
MFCC7
0
0
0
0
0
0
MFCC8
0
0
0
0
0
0
MFCC9
0
0
0
0
0
0
MFCC10
0
0
0
0
0
0
MFCC11
0
0
0
0
0
0
MFCC12
0
0
0
0
0
0
MFCC13
0
0
0
0
0
0
Bark 1 (0-100 Hz)
0
0
0
0
0
0
Bark 2 (100-200 Hz)
0
0
0
0
0
0
Bark 3 (200-300 Hz)
0
0
0
0
0
0
Bark 4 (300-400 Hz)
0
0
0
0
0
0
Bark 5 (400-510 Hz)
0
0
0
0
0
0
Bark 6 (510-630 Hz)
0
0
0
0
0
0
Bark 7 (630-770 Hz)
0
0
0
0
0
0
Bark 8 (770-920 Hz)
0
0
0
0
0
0
Bark 9 (920-1080 Hz)
0
0
0
0
0
0
Bark 10 (1080-1270 Hz)
0
0
0
0
0
0
Bark 11 (1270-1480 Hz)
0
0
0
0
0
0
Bark 12 (1480-1720 Hz)
0
0
0
0
0
0
Bark 13 (1720-2000 Hz)
0
0
0
0
0
0
Bark 14 (2000-2320 Hz)
0
0
0
0
0
0
Bark 15 (2320-2700 Hz)
0
0
0
0
0
0
Bark 16 (2700-3150 Hz)
0
0
0
0
0
0
Bark 17 (3150-3700 Hz)
0
0
0
0
0
0
Bark 18 (3700-4400 Hz)
0
0
0
0
0
0
Bark 19 (4400-5300 Hz)
0
0
0
0
0
0
Bark 20 (5300-6400 Hz)
0
0
0
0
0
0
Bark 21 (6400-7700 Hz)
0
0
0
0
0
0
Bark 22 (7700-9500 Hz)
0
0
0
0
0
0
Bark 23 (9500-12000 Hz)
0
0
0
0
0
0
Bark 24 (12000-15500 Hz)
0
0
0
0
0
0
Loudness (Bark total)
0
0
0
0
0
0


Hand Tracking and Audio Feature Analysis © 2021-2025 by Christoph Reuter and SInES is licensed under CC BY 4.0