All Issue

2025 Vol.44, Issue 4 Preview Page

Research Article

Salient chromagram extraction by using temporal smoothing and soft decision for cover song identification

커버곡 검색을 위한 시간축 방향 평탄화 및 연판정을 이용한 강인한 크로마그램 추출

Jin Soo Seo1*
서 진수1*
1Department of Electronic and Semiconductor Engineering, Gangneung-Wonju National University
*Corresponding Author
31 July 2025. pp. 338-345
PDF XML Citation
Abstract

Extracting a salient chromagram is crucial for cover song identification, where a cover refers to a live performance, remix, or re-recording of an original track. This paper enhances chromagram saliency through preprocessing and postprocessing techniques. Temporal smoothing is applied as preprocessing to reduce noise and fluctuations introduced during cover song generation, improving continuity and mitigating pitch estimation errors. Additionally, a soft decision of chroma activation is proposed as postprocessing to reliably determine pitch-class presence. Experimental results on two datasets demonstrate that the temporal smoothing and the soft decision improve cover song identification accuracy.

Keywords
Chromagram
Cover song
Temporal smoothing
Soft decision

커버곡 검색을 위해서는 강인한 크로마그램 추출이 중요하다. 라이브 녹음 또는 리메이크를 통한 재편집을 통해서 얻은 음악을 원곡의 커버곡이라 부른다. 본 논문은 전처리와 후처리를 통해 크로마그램의 강인성을 향상시킨다. 커버곡 생성 과정에서 발생하는 노이즈와 변동을 줄여 연속성을 향상시키고 피치 추정 오류를 완화하기 위해 전처리로 시간축 방향 평탄화를 적용한다. 또한, 후처리 단계에서 크로마 활성화 연판정을 통해서 음고류 존재 여부를 신뢰성 있게 판별한다. 두 가지 음악 데이터셋에서 커버곡 검색 실험을 수행하여 시간축 방향 평탄화와 연판정이 커버곡 검색 성능을 개선함을 확인하였다.

키워드
크로마그램
커버곡
시간축 방향 평탄화
연판정
References
1

M. Muller and S. Ewert, “Towards timbre-invariant audio features for harmony-based music,” IEEE Trans. Audio Speech Lang. Process. 18, 649-662 (2010).

10.1109/TASL.2010.2041394
2

M. Muller and S. Ewert, “Chroma Toolbox: MATLAB implementations for extracting variants of chroma-based audio features,” Proc. ISMIR-2011, 215-220 (2011).

3

J. Seo, “Salient chromagram extraction based on trend removal for cover song identification,” IEICE Trans. Inf. & Syst. 104, 51-54 (2021).

10.1587/transinf.2020MUL0002
4

J. Serra, E. Gomez, P. Herrera, and X. Serra, “Chroma binary similarity and local alignment applied to cover song identification,” IEEE Trans. Audio Speech Lang Process. 16, 1138-1151 (2008).

10.1109/TASL.2008.924595
5

J. Seo, “A relevance-based pairwise chromagram similarity for improving cover song retrieval accuracy” (in Korean), J. Acoust. Soc. Kr. 43, 200-206 (2024).

6

F. Yesiler, J. Serra, and E. Gomez, “Accurate and scalable version identification using musically-motivated embeddings,” Proc. ICASSP-2020, 21-25 (2020).

10.1109/ICASSP40776.2020.9053793
7

R. Hodrick and E. Prescott, “Postwar U.S. business cycles: An empirical investigation,” J. Money, Credit and Banking, 29, 1-16 (1997).

10.2307/2953682
8

A. Wink and J. Roerdink, “Denoising functional MR images: a comparison of wavelet denoising and Gaussian smoothing,” IEEE Trans. Medical Imaging, 23, 374-387 (2004).

10.1109/TMI.2004.824234
9

D. Song, A. Baek, and N. Kim, “Forecasting stock market indices using padding-based fourier transform denoising and time series deep learning models,” IEEE Access, 9, 83786-83796 (2021).

10.1109/ACCESS.2021.3086537
10

P. Maragos, “Tutorial on advances in morphological image processing and analysis,” Optical Engineering, 26, 623-632 (1987).

10.1117/12.7974127
11

P. Perona and J. Malik, “Scale-space and edge detection using anisotropic diffusion,” IEEE Trans. Pattern Analysis and Machine Intelligence, 12, 629-639 (1990).

10.1109/34.56205
12

A.S. Yaro, F. Maly, P. Prazak, and K. Maly, “Outlier detection performance of a modified z-score method in time-series rss observation with hybrid scale estimators,” IEEE Access, 12, 12785-12796 (2024).

10.1109/ACCESS.2024.3356731
13

C. Harte, Towards automatic extraction of harmony information from music signals, (Ph.D. dissertation, Queen Mary University of London, 2010).

14

Covers80 Cover Song Data Set, http://labrosa.ee.columbia.edu/projects/coversongs/covers80/, (Last viewed March 7, 2025).

15

T. F. Smith and M. S. Waterman, “Identification of common molecular subsequences,” J. Molecular Biology, 147, 195-197 (1981).

10.1016/0022-2836(81)90087-5
16

MOVE Code, https://github.com/furkanyesiler/move, (Last viewed March 7, 2025).

Information
  • Publisher :The Acoustical Society of Korea
  • Publisher(Ko) :한국음향학회
  • Journal Title :The Journal of the Acoustical Society of Korea
  • Journal Title(Ko) :한국음향학회지
  • Volume : 44
  • No :4
  • Pages :338-345
  • Received Date : 2025-03-07
  • Revised Date : 2025-04-28
  • Accepted Date : 2025-05-20
  • DOI :https://doi.org/10.7776/ASK.2025.44.4.338
Journal Informaiton The Journal of the Acoustical Society of Korea The Journal of the Acoustical Society of Korea
E-Book
  • scopus_JASK
  • ESCI_JASK
  • Google scholar_JASK
  • NRF
  • KOFST
  • KISTI Current Status
  • KISTI Cited-by
  • crosscheck
  • orcid
  • ccl
Journal Informaiton Journal Informaiton - close