Event
【GIR Open Seminar】Dr. Nicki Holighaus / Austrian Academy of Sciences（Austria）
| Date | 2025.11.17 (13：00 - 14：00) |
|---|---|
| Venue |
Lecture Room 204, 2ndFl., Building 3 Koganei Campus TUAT Meeting ID:851 6447 6809 Passcode:501239 |
| Speaker | Dr. Nicki Holighaus |
| Affiliation | Austrian Academy of Sciences (Austria) |
| Title | "Computer Vision and Acoustic Signal Processing for Understanding Animal Communication" ＜Abstract＞ In this talk I will present some recent results and future plans regarding the computer vision and signal processing aspects of our research in the project ANIML, in which we study the acoustic communication of a colony of budgerigars (Melopsittacus undulatus) in the animal laboratory of the Acoustics Research Institute. Using artificial intelligence to analyze audiovisual footage of animal groups holds great potential for studying social behaviors where manual analysis of recordings is impractical or even impossible. Our work combines computer vision, machine learning for audio, and acoustic methods to automatically separate individual vocalizations from recordings of a group of animals. In an aviary housing 11 budgerigars, the approach starts with a computer vision system designed to localise and identify individual birds on video. This system was developed by recording each bird individually to generate training data with minimal manual effort and by fine-tuning YOLOv11 and MobileNetV2 models, enabling the detection and identification of budgerigars with 98% mAP and up to 94% accuracy, respectively. At the same time, audio recordings of the group’s vocalization are taken with a planar array comprising 112 microphones. The spatial position of individual birds, derived from video, is integrated with acoustic source localization techniques performed on the audio to separate vocalizations from recordings where up to 11 birds vocalize simultaneously, and to attribute them to specific individuals. This pipeline allows us to capture individual vocalizations difficult to record outside of a group, such as a female budgerigars'. Additionally, it will be used to study turn-taking behaviour and consonant-, and vowel-like elements in budgerigars. Importantly, such an automated system is adaptable across species and enables the creation of large datasets of individually labeled social vocalizations, which allows for deeper analysis of non-human vocal interactions in naturalistic settings on both a structural and behavioral level. |
| Language | English |
| Intended for | Everyone is welcome to join |
| Organized by | Institute of Global Innovation Research "LIFE SCIENCE" Yatabe Team |
| Contact | Institute of Global Innovation Research, Institute of Engineering Associate Prof. Kohei Yatabe e-mail: yatabe（at）go.tuat.ac.jp |
| Remarks | This seminar will be held both face-to-face and online concurrently. |
このページの上部へ