| |
| |
| |
Introduction | |
| |
| |
| |
Music Information Retrieval | |
| |
| |
| |
Outline of Part I | |
| |
| |
| |
Further Notes | |
| |
| |
| |
Motion Retrieval | |
| |
| |
| |
Outline of Part II | |
| |
| |
| |
Further Notes | |
| |
| |
| |
General Concepts | |
| |
| |
| |
Analysis and Retrieval Techniques for Music Data | |
| |
| |
| |
Fundamentals on Music and Audio Data | |
| |
| |
| |
Music Representations | |
| |
| |
| |
Score Representation | |
| |
| |
| |
Sound, Waveform, and Audio Representation | |
| |
| |
| |
MIDI Representation | |
| |
| |
| |
Fourier Transform | |
| |
| |
| |
Signals and Signal Spaces | |
| |
| |
| |
Fourier Representations | |
| |
| |
| |
Discrete Fourier Transform | |
| |
| |
| |
Further Notes | |
| |
| |
| |
Digital Filters | |
| |
| |
| |
Convolution Filters | |
| |
| |
| |
Frequency Response | |
| |
| |
| |
Filter Specifications | |
| |
| |
| |
Examples | |
| |
| |
| |
Further Notes | |
| |
| |
| |
Pitch- and Chroma-Based Audio Features | |
| |
| |
| |
Pitch Features | |
| |
| |
| |
Local Energy (STMSP) and Onset Features | |
| |
| |
| |
Chroma and CENS Features | |
| |
| |
| |
Further Notes | |
| |
| |
| |
Dynamic Time Warping | |
| |
| |
| |
Classical DTW | |
| |
| |
| |
Variations of DTW | |
| |
| |
| |
Step Size Condition | |
| |
| |
| |
Local Weights | |
| |
| |
| |
Global Constraints | |
| |
| |
| |
Approximations | |
| |
| |
| |
Multiscale DTW | |
| |
| |
| |
Subsequence DTW | |
| |
| |
| |
Further Notes | |
| |
| |
| |
Music Synchronization | |
| |
| |
| |
Synchronization Tasks | |
| |
| |
| |
A Multiscale Approach to Audio Synchronization | |
| |
| |
| |
Audio Features | |
| |
| |
| |
Local Cost Measure | |
| |
| |
| |
Resolution Levels and [delta]-Neighborhood | |
| |
| |
| |
Experimental Results | |
| |
| |
| |
Enhancing Cost Matrices | |
| |
| |
| |
Onset-Based Score-Audio Synchronization | |
| |
| |
| |
Audio Features | |
| |
| |
| |
Local Similarity Measure | |
| |
| |
| |
Matching Model and Alignment | |
| |
| |
| |
Efficiency and Anchor Matches | |
| |
| |
| |
Experimental Results | |
| |
| |
| |
Further Notes | |
| |
| |
| |
Audio Matching | |
| |
| |
| |
Diagonal Audio Matching | |
| |
| |
| |
Audio Features | |
| |
| |
| |
Basic Matching Procedure | |
| |
| |
| |
Global Variations in Tempo and Key | |
| |
| |
| |
Efficient Implementation | |
| |
| |
| |
Experimental Results for Diagonal Audio Matching | |
| |
| |
| |
Representative Matching Results | |
| |
| |
| |
Dependence on Query Length | |
| |
| |
| |
Codebook Selection for CENS Features | |
| |
| |
| |
Codebook Selection by Unsupervised Learning | |
| |
| |
| |
Codebook Selection Based on Musical Knowledge | |
| |
| |
| |
Index-Based Audio Matching | |
| |
| |
| |
Exact Matches | |
| |
| |
| |
Fault Tolerance Mechanisms | |
| |
| |
| |
Retrieval Scenario and Ranking | |
| |
| |
| |
Experimental Results for Index-Based Audio Matching | |
| |
| |
| |
Diagonal vs. Index-Based Matching | |
| |
| |
| |
Comparison of Codebooks | |
| |
| |
| |
Running Times | |
| |
| |
| |
Further Notes | |
| |
| |
| |
Audio Structure Analysis | |
| |
| |
| |
General Strategy and Notation | |
| |
| |
| |
Enhancing Similarity Matrices | |
| |
| |
| |
Path Extraction | |
| |
| |
| |
Global Structure Analysis | |
| |
| |
| |
Experiments | |
| |
| |
| |
General Results | |
| |
| |
| |
Running Time Behavior | |
| |
| |
| |
Transpositions | |
| |
| |
| |
Further Notes | |
| |
| |
| |
SyncPlayer: An Advanced Audio Player | |
| |
| |
| |
Overview | |
| |
| |
| |
SyncPlayer Server | |
| |
| |
| |
SyncPlayer Client | |
| |
| |
| |
Further Notes | |
| |
| |
| |
Analysis and Retrieval Techniques for Motion Data | |
| |
| |
| |
Fundamentals on Motion Capture Data | |
| |
| |
| |
Motion Capture Data | |
| |
| |
| |
Similarity Aspects | |
| |
| |
| |
Kinematic Chains | |
| |
| |
| |
Formal Definition | |
| |
| |
| |
Forward Kinematics | |
| |
| |
| |
Animated Kinematic Chains | |
| |
| |
| |
Further Notes | |
| |
| |
| |
Rotations | |
| |
| |
| |
Basic Definitions and Properties | |
| |
| |
| |
Euler Angles | |
| |
| |
| |
Quaternions | |
| |
| |
| |
Further Notes | |
| |
| |
| |
DTW-Based Motion Comparison and Retrieval | |
| |
| |
| |
Local Distance Measures | |
| |
| |
| |
Quaternion-Based Pose Distance | |
| |
| |
| |
3D Point Cloud Distance | |
| |
| |
| |
Examples | |
| |
| |
| |
DTW-Based Motion Warping | |
| |
| |
| |
Motion Retrieval Based on Self-Similarity | |
| |
| |
| |
Further Notes | |
| |
| |
| |
Relational Features and Adaptive Segmentation | |
| |
| |
| |
Relational Features | |
| |
| |
| |
A Basic Example | |
| |
| |
| |
Generic Features | |
| |
| |
| |
Threshold Selection | |
| |
| |
| |
Example for Some Feature Set | |
| |
| |
| |
Adaptive Segmentation | |
| |
| |
| |
Further Notes | |
| |
| |
| |
Index-Based Motion Retrieval | |
| |
| |
| |
Indexing, Queries, and Hits | |
| |
| |
| |
Inverted File Index | |
| |
| |
| |
Exact Queries and Exact Hits | |
| |
| |
| |
Fuzzy Queries and Fuzzy Hits | |
| |
| |
| |
Adaptive Fuzzy Hits | |
| |
| |
| |
QBE Motion Retrieval | |
| |
| |
| |
Query and Retrieval Mechanism | |
| |
| |
| |
Indexing Stage | |
| |
| |
| |
Experimental Results | |
| |
| |
| |
Ranking Strategies | |
| |
| |
| |
Further Applications | |
| |
| |
| |
Accelerating DTW-Based Motion Alignment | |
| |
| |
| |
Keyframe-Based Preselection | |
| |
| |
| |
Toward Scene Descriptions | |
| |
| |
| |
Further Notes | |
| |
| |
| |
Problems and Limitations | |
| |
| |
| |
Related Work | |
| |
| |
| |
Motion Templates | |
| |
| |
| |
Basic Definitions and Properties | |
| |
| |
| |
MT Learning Procedure: Overview | |
| |
| |
| |
MT Learning Procedure: Technical Details | |
| |
| |
| |
Reference-Based WMT Warping | |
| |
| |
| |
WMT Unwarping | |
| |
| |
| |
Reference-Based WMT Averaging | |
| |
| |
| |
Reference-Free WMT Averaging | |
| |
| |
| |
Experimental Results | |
| |
| |
| |
Motion Class Database | |
| |
| |
| |
WMT Computation and Time Complexity | |
| |
| |
| |
Examples | |
| |
| |
| |
Further Notes | |
| |
| |
| |
MT-Based Motion Annotation and Retrieval | |
| |
| |
| |
MT-Based Matching | |
| |
| |
| |
MT-Based Annotation | |
| |
| |
| |
MT-Based Retrieval | |
| |
| |
| |
Keyframe-Based Preprocessing | |
| |
| |
| |
Comparison to Other Retrieval Methods | |
| |
| |
| |
Further Notes | |
| |
| |
References | |
| |
| |
Index | |