Musicon: Glyph-Based Design for Music Visualization and Retrieval

This paper introduces a novel glyph-based design for music representation that leverages deep latent features to improve user-directed search for music discovery. We propose a system that combines a pre-trained neural network model for high-level music feature extraction with dimensionality-reduction methods for effective visual mapping of the intrinsic characteristics that help distinguishing a song. We provide a search-by-icon user interface (UI) that integrates glyph based on the neural features in combination with other novel navigation methods to achieve intuitive search and exploration. A detailed user study validates our approach, demonstrating its efficacy in enabling swift song clustering, identification, and retrieval. Our findings reveal that our visual representation not only speeds up the music searching process but also fosters increased user interaction with digital music libraries, representing a valuable contribution to the domain of music exploration and retrieval.

@Article { LHE24,
  author       = "Luo, Xuejiao and Hoveling, Vera and Eisemann, Elmar",
  title        = "Musicon: Glyph-Based Design for Music Visualization and Retrieval",
  journal      = "The International Symposium on Vision, Modeling, and Visualization 2024",
  year         = "2024",
  url          = "http://graphics.tudelft.nl/Publications-new/2024/LHE24"
}