SINES Tools: Point Tracking and Audio Feature Analysis (for up to eight points, Signal analysis: Meyda)

1. Click on "Start" to set all values on default.
2. Upload an mp4 video file showing a moving object.
3. Make sure that the background in the video is as neutral as possible and contrasts strongly in color with the object to be tracked.
4. Click on the object to be tracked and mark it with up to eight points. The points can be deleted with
5. optional: Select the noise gate setting to avoid artifacts in silent parts of the sound:
    noise gate off (quiet parts will be analysed) or noise gate on (quiet parts will not be analysed).
6. Click on "Analyse" and play the video to the end.
 7. optional: View data in the plot
8. Click on "Show JS Arrays" or "Export CSV" to show the recorded data as Javascript arrays or to export them as a CSV/Excel file.
9. optional: If the placed points slip or disappear during analysis, the video image can be sharpened/optimized using the following buttons and sliders: poster pixel size: 0.001
10. optional: If the placed points still slip or disappear from the desired positions, the settings can be improved using the following sliders (related to Lucas-Kanade method with pyramids):
Window Size: 7 (size of the search window)
Max. Iterations: 30 (stop searching after a maximum number of iterations)
Epsilon: 0 (stop searching, when the search window moves by less than Epsilon)
Min. Eigen: 0 (chance to remove bad or slipped points)

Feature Mean Stdev Median Min Max Range
Point 1, left <--> right (X)
0
0
0
0
0
0
Point 1, up <--> down (Y)
0
0
0
0
0
0
Point 2, left <--> right (X)
0
0
0
0
0
0
Point 2, up <--> down (Y)
0
0
0
0
0
0
Point 3, left <--> right (X)
0
0
0
0
0
0
Point 3, up <--> down (Y)
0
0
0
0
0
0
Point 4, left <--> right (X)
0
0
0
0
0
0
Point 4, up <--> down (Y)
0
0
0
0
0
0
Point 5, left <--> right (X)
0
0
0
0
0
0
Point 5, up <--> down (Y)
0
0
0
0
0
0
Point 6, left <--> right (X)
0
0
0
0
0
0
Point 6, up <--> down (Y)
0
0
0
0
0
0
Point 7, left <--> right (X)
0
0
0
0
0
0
Point 7, up <--> down (Y)
0
0
0
0
0
0
Point 8, left <--> right (X)
0
0
0
0
0
0
Point 8, up <--> down (Y)
0
0
0
0
0
0
RMS
0
0
0
0
0
0
Energy
0
0
0
0
0
0
Spectral Centroid [Hz]
0
0
0
0
0
0
Zero Crossing Rate
0
0
0
0
0
0
Spectral Flatness
0
0
0
0
0
0
Spectral Slope
0
0
0
0
0
0
Spectral Rolloff
0
0
0
0
0
0
Spectral Spread
0
0
0
0
0
0
Spectral Skewness
0
0
0
0
0
0
Spectral Kurtosis
0
0
0
0
0
0
Perceptual Spread
0
0
0
0
0
0
Perceptual Sharpness
0
0
0
0
0
0
Chroma C
0
0
0
0
0
0
Chroma C#
0
0
0
0
0
0
Chroma D
0
0
0
0
0
0
Chroma D#
0
0
0
0
0
0
Chroma E
0
0
0
0
0
0
Chroma F
0
0
0
0
0
0
Chroma F#
0
0
0
0
0
0
Chroma G
0
0
0
0
0
0
Chroma G#
0
0
0
0
0
0
Chroma A
0
0
0
0
0
0
Chroma A#
0
0
0
0
0
0
Chroma B
0
0
0
0
0
0
MFCC1
0
0
0
0
0
0
MFCC2
0
0
0
0
0
0
MFCC3
0
0
0
0
0
0
MFCC4
0
0
0
0
0
0
MFCC5
0
0
0
0
0
0
MFCC6
0
0
0
0
0
0
MFCC7
0
0
0
0
0
0
MFCC8
0
0
0
0
0
0
MFCC9
0
0
0
0
0
0
MFCC10
0
0
0
0
0
0
MFCC11
0
0
0
0
0
0
MFCC12
0
0
0
0
0
0
MFCC13
0
0
0
0
0
0
Bark 1 (0-100 Hz)
0
0
0
0
0
0
Bark 2 (100-200 Hz)
0
0
0
0
0
0
Bark 3 (200-300 Hz)
0
0
0
0
0
0
Bark 4 (300-400 Hz)
0
0
0
0
0
0
Bark 5 (400-510 Hz)
0
0
0
0
0
0
Bark 6 (510-630 Hz)
0
0
0
0
0
0
Bark 7 (630-770 Hz)
0
0
0
0
0
0
Bark 8 (770-920 Hz)
0
0
0
0
0
0
Bark 9 (920-1080 Hz)
0
0
0
0
0
0
Bark 10 (1080-1270 Hz)
0
0
0
0
0
0
Bark 11 (1270-1480 Hz)
0
0
0
0
0
0
Bark 12 (1480-1720 Hz)
0
0
0
0
0
0
Bark 13 (1720-2000 Hz)
0
0
0
0
0
0
Bark 14 (2000-2320 Hz)
0
0
0
0
0
0
Bark 15 (2320-2700 Hz)
0
0
0
0
0
0
Bark 16 (2700-3150 Hz)
0
0
0
0
0
0
Bark 17 (3150-3700 Hz)
0
0
0
0
0
0
Bark 18 (3700-4400 Hz)
0
0
0
0
0
0
Bark 19 (4400-5300 Hz)
0
0
0
0
0
0
Bark 20 (5300-6400 Hz)
0
0
0
0
0
0
Bark 21 (6400-7700 Hz)
0
0
0
0
0
0
Bark 22 (7700-9500 Hz)
0
0
0
0
0
0
Bark 23 (9500-12000 Hz)
0
0
0
0
0
0
Bark 24 (12000-15500 Hz)
0
0
0
0
0
0
Loudness (Bark total)
0
0
0
0
0
0


C. Reuter (2024)