Learning deep models from synthetic data for extracting dolphin whistle contours

Pu Li, Xiaobai Liu*, Kaitlin Palmer, Erica Fleishman, Douglas Michael Gillespie, Eva-Marie Nosal, Yu Shiu, Holger Klinck, Danielle Cholewiak, Tyler Helble, Marie Roch

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

14 Citations (Scopus)

Abstract

We present a learning-based method for extracting whistles of toothed whales (Odontoceti) in hydrophone recordings. Our method represents audio signals as time-frequency spectrograms and decomposes each spectrogram into a set of time-frequency patches. A deep neural network learns archetypical patterns (e.g., crossings, frequency modulated sweeps) from the spectrogram patches and predicts time-frequency peaks that are associated with whistles. We also developed a comprehensive method to synthesize training samples from background environments and train the network with minimal human annotation effort. We applied the proposed learn-from-synthesis method to a subset of the public
Detection, Classification, Localization, and Density Estimation (DCLDE) 2011 workshop data to extract whistle confidence maps, which we then processed with an existing contour extractor to produce whistle annotations. The F1-score of our best synthesis method was 0.158 greater than our baseline whistle extraction algorithm (~25% improvement) when applied to common dolphin (Delphinus spp.) and bottlenose dolphin (Tursiops truncatus) whistles.
Original languageEnglish
Title of host publication2020 International Joint Conference on Neural Networks, IJCNN 2020 - Proceedings
PublisherIEEE Computer Society
Number of pages10
ISBN (Electronic)9781728169262
DOIs
Publication statusPublished - Jul 2020
EventIEEE World Congress on Computational Intelligence (IEEE WCCI) - 2020 International Joint Conference on Neural Networks (IJCNN 2020) - Glasgow, United Kingdom
Duration: 19 Jul 202024 Jul 2020

Publication series

NameProceedings of the International Joint Conference on Neural Networks

Conference

ConferenceIEEE World Congress on Computational Intelligence (IEEE WCCI) - 2020 International Joint Conference on Neural Networks (IJCNN 2020)
Abbreviated titleIJCNN
Country/TerritoryUnited Kingdom
CityGlasgow
Period19/07/2024/07/20

Keywords

  • Whistle contour extraction
  • Deep neural network
  • Data synthesis
  • Acoustic
  • Odontocetes

Fingerprint

Dive into the research topics of 'Learning deep models from synthetic data for extracting dolphin whistle contours'. Together they form a unique fingerprint.

Cite this