Temporal attention based animal sound classification

Jungmin Kim; Younglo Lee; Donghyeon Kim; Hanseok Ko

doi:10.7776/ASK.2020.39.5.406

All Issue

2020 Vol.39, Issue 5 Preview Page Next Page

Research Article

Temporal attention based animal sound classification 시간 축 주의집중 기반 동물 울음소리 분류

30 September 2020. pp. 406-413

PDF XML

Abstract

In this paper, to improve the classification accuracy of bird and amphibian acoustic sound, we utilize GLU (Gated Linear Unit) and Self-attention that encourages the network to extract important features from data and discriminate relevant important frames from all the input sequences for further performance improvement. To utilize acoustic data, we convert 1-D acoustic data to a log-Mel spectrogram. Subsequently, undesirable component such as background noise in the log-Mel spectrogram is reduced by GLU. Then, we employ the proposed temporal self-attention to improve classification accuracy. The data consist of 6-species of birds, 8-species of amphibians including endangered species in the natural environment. As a result, our proposed method is shown to achieve an accuracy of 91 % with bird data and 93 % with amphibian data. Overall, an improvement of about 6 % ~ 7 % accuracy in performance is achieved compared to the existing algorithms.

Keywords

Audio event classification

Convolution Neural Network (CNN)

Self-attention

Gated Linear Unit (GLU)

본 논문에서는 조류와 양서류 울음소리의 구별 정확도를 높이기 위해 게이트 선형유닛과 자가주의 집중 모듈을 활용해서 데이터의 중요한 부분을 중심으로 특징 추출 및 데이터 프레임의 중요도를 판별해 구별 정확도를 높인다. 이를 위해 먼저 1차원의 음향 데이터를 로그 멜 스펙트럼으로 변환한다. 로그 멜 스펙트럼에서 배경잡음같이 중요하지 않은 정보는 게이트 선형유닛을 거쳐 제거한다. 그러고 난 뒤 시간 축에 자가주의집중기법을 적용해 구별 정확도를 높인다. 사용한 데이터는 자연환경에서 멸종위기종을 포함한 조류 6종의 울음소리와 양서류 8종의 울음소리로 구성했다. 그 결과, 게이트 선형유닛 알고리즘과 시간 축에서 자가주의집중을 적용한 구조의 평균 정확도는 조류를 구분했을 때 91 %, 양서류를 구분했을 때 93 %의 분류율을 보였다. 또한, 기존 알고리즘보다 약 6 % ~ 7 % 향상된 정확도를 보이는 것을 확인했다.

키워드

음향이벤트 인식

합성 곱 신경망

자가주의집중

게이트 선형유닛

References

K. Ko, J. Park, D. K. Han, and H. Ko, "Channel and frequency attention module for diverse animal sound classification," Proc. IEICE Trans. on Information and Systems, E102.D, 2615-2618 (2019).

10.1587/transinf.2019EDL8128

J. Strout, B. Rogan, S. M. M. Seyednezhad, K. Smart, M. Bush, and E. Ribeiro, "Anuran call classification with deep learning," Proc. IEEE ICASSP. 2662-2665 (2017).

10.1109/ICASSP.2017.7952639

X. Dong, N. Yan, and Y. Wei, "Insect sound recognition based on convolutional neural network," Proc, IEEE 3rd ICIVC. 855-859 (2018).

10.1109/ICIVC.2018.8492871

J. Salamon, J. P. Bello, A. Farnsworth, and S. Kelling, "Fusing shallow and deep learning for bioacoustic bird species classification," Proc. IEEE ICASSP. 141- 145 (2017).

10.1109/ICASSP.2017.795213428331433PMC5341259

K. Ko, S. Park, and H. Ko, "Convolutional feature vectors and support vector machine for animal sound classification," IEEE 40th EMBC. 376-379 (2018).

10.1109/EMBC.2018.8512408

Y. Xu, Q. Kong, W. Wang, and M. D. Plumbley, "Large-scale weakly supervised audio classification using gated convolutional neural network," Proc. IEEE ICASSP. 121-125 (2018).

10.1109/ICASSP.2018.8461975

J. Yan, Y. Song, W. Guo, L.-R. Dai, I. McLoughlin, and L. Chen, "A region based attention method for weakly supervised sound event detection and classification," Proc. IEEE ICASSP. 755-759 (2019).

10.1109/ICASSP.2019.8682376PMC6835048

K. Miyazaki, T. Komatsu, T. Hayashi, S. Watanabe, T. Toda, and K. Takeda, "Weakly-supervised sound event detection with self-attention," Proc. IEEE ICASSP. 66-70 (2020).

10.1109/ICASSP40776.2020.9053609PMC6960455

Y. N. Dauphin, A. Fan, M. Auli, and D. Grangier, "Language modeling with gated convolutional networks," Proc. ICML. 933-941 (2017).

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, "Attention is all you need," Advances in NPS30. 5998- 6008 (2017).

S. Ioffe and C. Szegedy, "Batch normalization: Accelerating deep network training by reducing internal covariate shift," arXiv preprint arXiv:1502.03167 (2015).

A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," Advances in NPS25. 1097-1105 (2012).

K. Ko, S. Park, and H. Ko, "Convolutional neural network based amphibian sound classification using covariance and modulogram" (in Korean), J. Acoust. Soc. Kr. 37, 60-65 (2018).

Information

Publisher :The Acoustical Society of Korea
Publisher(Ko) :한국음향학회
Journal Title :The Journal of the Acoustical Society of Korea
Journal Title(Ko) :한국음향학회지
Volume : 39
No :5
Pages :406-413
Received Date : 2020-07-21
Accepted Date : 2020-08-24
DOI :https://doi.org/10.7776/ASK.2020.39.5.406

The Journal of the Acoustical Society of Korea ISSN:1225-4428(Print) 2287-3775(Online) 한국음향학회지

All Issue