DERI Seminar with Dr Lin Wang

When: Thursday, March 2, 2023, 11:00 AM - 12:00 PM
Where: Zoom

Speaker: Dr Lin Wang, Lecturer at QMUL

Title: Acoustic sensing from multi-rotor drones
ZOOM link: https://qmul-ac-uk.zoom.us/j/81148100921
Abstract: In this talk we summarize our work on acoustic sensing from a multi-rotor drone, which is challenged by the strong ego-noise from rotating rotors and propellers. We proposed a time-frequency spatial filtering framework for sound enhancement and source localization with a microphone array mounted on the drone. The method works well in presence strong ego-noise by exploiting the time-frequency sparsity of the acoustic signals. We further proposed an audio-visual joint processing framework which additionally uses a camera mounted on the drone to detect and localize potential target sound sources, and to provide guidance to steer the time-frequency spatial filter. The audio-visual calibration problem is addressed in this framework, which aims to align the audio and visual streams temporally and geometrically. We collected an audio-visual dataset which was made publicly available to promote the research in flying robot audition. Finally, We discuss the application of deep learning methods to drone audition.
Bio: Dr Lin Wang is a Lecturer at QMUL. His research focuses on audio and visual signal processing, robotic perception and machine learning. Specifically, he developed microphone array techniques for sound enhancement, source localization and blind source separation. He developed audio-visual signal processing techniques for acoustic sensing from flying robots (mini-drones). He applied machine learning techniques to human activity and context recognition from wearable sensors (motion, GPS, sound and image). He is IEEE Audio and Acoustic Signal Processing Technical Committee Member. He is Associate Editor of IEEE Access and IEEE Sensors Journal.