Audio-based COVID-19 diagnosis using separable transformer

Seungtae Kang; Gil-Jin Jang

doi:10.7776/ASK.2023.42.3.221

All Issue

2023 Vol.42, Issue 3 Preview Page Next Page

Research Article

Audio-based COVID-19 diagnosis using separable transformer 트랜스포머를 이용한 음성기반 코비드19 진단

31 May 2023. pp. 221-225

PDF XML

Abstract

In this paper, we proposed an efficient method for rapid diagnosis of COVID-19 by voice. A novel Strided Convolution Separable Transformer (SC-SepTr) is proposed by modifying the conventional Separable Transformer (SepTr) for audio signal recognition. The proposed method reduces the memory and computational requirements to enable rapid diagnosis of COVID-19. As a result of experiments on Coswara, it was shown that the proposed method perform rapid diagnosis with guaranteeing Area Under the Curve (AUC) performance even for a relatively small amount of learning data.

Keywords

COVID-19

Cough

Breathing

Transformer

Separable transformer

본 연구에서는 코로나 바이러스 감염증은 음성만으로 빠르게 진단하는 효율적인 방법을 제안하였다. 기존의 딥러닝 기반 방법들의 연산시간과 대용량 학습자료 요구조건을 완화하기 위해서 Separable Transformer(SepTr)의 구조를 개선하여 파라미터의 수를 대폭 감소시키고 빠른 진단을 가능하게 하는 새로운 Strided Convolution Separable Transformer(SC-SepTr)를 제안하였다. 공개 음향 데이터인 Coswara에 대하여 실험을 수행한 결과 제안된 방법은 상대적으로 소규모의 학습자료에 대해서도 Area Under the Curve(AUC) 성능을 보장하면서도 신속하게 진단을 수행할 수 있음을 보였다.

키워드

코로나바이러스감염증

기침소리

숨소리

트랜스포머

분리형트랜스포머

References

World Health Organization Official COVID-19 info Official Website, https://www.who.int/covid-19, (Last viewed May 23, 2023).

L. Orlandic, T. Teijeiro, and D. Atienza, "The COUGHVID crowdsourcing dataset, a corpus for the study of large- scale cough analysis algorithms," Sci. Data, 8, 1-10 (2021). 10.1038/s41597-021-00937-434162883PMC8222356

N. K. Sharma, P. Krishnan, R. Kumar, S. Ramoji, S. R. Chetupalli, N. R., P. K. Ghosh, and S. Ganapathy, "Coswara - a database of breathing, cough, and voice sounds for COVID-19 diagnosis," Proc. Interspeech, 4811-4815 (2020). 10.21437/Interspeech.2020-2768

D. T. Pizzo and S. Esteban, "IATos: AI-powered pre-screening tool for COVID-19 from cough audio samples," arXiv:2104.13247 (2021).

A. Mallol-Ragolta, H. Cuesta, E. Gomez, and B. Schuller, "Multi-type outer product-based fusion of respiratory sounds for detecting COVID-19," Proc. Interspeech, 2163-2167 (2022). 10.21437/Interspeech.2022-10291

V. S. Nallanthighal, A. Harma, and H. Strik. "COVID-19 detection based on respiratory sensing from speech," Proc. Interspeech, 2498-2502 (2022). 10.21437/Interspeech.2022-11209

Y. Gong, Y.-A. Chung, and J. Glass, "AST: audio spectrogram transformer," Proc. Interspeech, 571-575 (2021). 10.21437/Interspeech.2021-69833559302

N. C. Ristea, R. T. Ionescu, and F. S. Khan, "SepTr: separable transformer for audio spectrogram processing," Proc. Interspeech, 4103-4107 (2022). 10.21437/Interspeech.2022-249

N. K. Sharma, S. R. Chetupalli, D. Bhattacharya, D. Dutta, P. Mote, and S. Ganapathy, "The second DiCOVA challenge: Dataset and performance analysis for diagnosis of COVID-19 using acoustics," Proc. ICASSP, 556-560 (2022). 10.1109/ICASSP43922.2022.9747188PMC9463490

X.-Y. Chen, Q.-S. Zhu, J. Zhang, and L.-R. Dai, "Supervised and self-supervised pretraining based covid-19 detection using acoustic breathing /cough/ speech signals," Proc. ICASSP, 561-565 (2022). 10.1109/ICASSP43922.2022.9746205

T. Dang, T. Quinnell, and C. Mascolo, "Exploring semi-supervised learning for audio-based COVID-19 detection using FixMatch," Proc. Interspeech, 2468-2472 (2022). 10.21437/Interspeech.2022-10274

A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, J. Uszkoreit, and N. Houlsby, "An image is worth 16×16 words: Transformers for image recognition at scale," Proc. ICLR, 1-22 (2021).

K. Lee and C. H. Lee, "Abnormal signal detection based on parallel autoencoders" (in Korean), J. Acoust. Soc. Kr. 40, 337-346 (2021).

Information

Publisher :The Acoustical Society of Korea
Publisher(Ko) :한국음향학회
Journal Title :The Journal of the Acoustical Society of Korea
Journal Title(Ko) :한국음향학회지
Volume : 42
No :3
Pages :221-225
Received Date : 2023-04-18
Accepted Date : 2023-05-17
DOI :https://doi.org/10.7776/ASK.2023.42.3.221

The Journal of the Acoustical Society of KoreaISSN:1225-4428(Print) 2287-3775(Online)한국음향학회

All Issue