Research group:<\/h2>\n\n\n\n
The Acoustics, Analysis & AI (3AI)<\/a> group at the IT:U Austria in Linz explores how mathematics, acoustics, and artificial intelligence can work together. We study interpretable, hybrid AI systems for sound analysis\u2014combining deep learning with mathematical structure and human insight. Our research ranges from signal processing and hearing models to bioacoustics and mathematical foundations, aiming to bridge human and machine understanding of acoustic phenomena. <\/p>\n\n\n\n Keine Forschungsgebiete gefunden.<\/p>\n <\/div> <\/div>\n <\/div>\n<\/div>\n\n\n Peter Balazs<\/a> is the Director of the Acoustics Research Institute at the \u00d6AW. He possesses extensive expertise in acoustics, signal processing, and mathematical methods. His research has led to significant contributions to frame theory and time-frequency analysis, with applications in numerical acoustics, mathematical physics, psychoacoustics and bioacoustics. <\/p>\n\n\n\n His vision is bridging (deep theoretical) mathematics to more applied scientific topics. He has long been passionately committed to application-oriented mathematics for acoustics, signal-processing and machine learning. This commitment was already evident in 2011, when his project Frames and Linear Operators for Acoustical Modeling and Parameter Estimation was awarded the prestigious START Prize. <\/p>\n\n\n\n His interdisciplinary work integrates mathematical models with acoustic applications, as demonstrated in current projects such as Frames and Time-Frequency Analysis in Machine Learning or Decoding Elephant Communication with AI. <\/p>\n\n\n\n His extensive experience in teaching and supervision, his ability to present complex theoretical concepts in an accessible applied way significantly enriches the academic environment at IT:U. His affiliation with the Austrian Academy of Sciences and his active involvement in international scientific organization \u2013 he currently serves the treasurer of the International Commission for Acoustics, e.g. – further strengthen research and mentorship at IT:U.\u202f <\/p>\n\n\n\n „My vision is bridging (deep theoretical) mathematics to more applied scientific topics. I am passionately committed to application-oriented mathematics for acoustics, signal-processing and machine learning. This allows the full usage of mathematical rigor and controllability of parameters for models and methods in the applied sciences on one hand. On the other hand, this creates new mathematical topics and concepts, raises novel questions within mathematics that are interesting and inspiring per-se“.<\/em><\/p>\nPeter Balazs<\/cite><\/blockquote>\n\n\n\n Here we describe six PhD projects envisioned for the group 3AI of fellow professor P. Balazs.<\/p>\n\n\n\n The PhD curriculum at IT:U follows a 4-year path. In the first year, emphasis is placed on focused research lab modules.<\/p>\n\n\n\n The first year concludes with the PhD Proposal Presentation. Over the next three years, the content of the PhD thesis will be developed. This is accompanied by interdisciplinary research seminars and work as a project assistant. The PhD program concludes after the 4th year with the submission and defence of the PhD thesis.<\/p>\n\n\n\n A call will be sent out for three positions, where candidates can apply for any of the projects. (This means that for some projects we will have no candidate.)<\/p>\n\n\n\n Home-cage monitoring of mice and other laboratory animals are increasingly being used in translational research, but several technical changes are needed in conventional cages to be able to study acoustic communication. In this project we will design and construct a new type of mouse cage with integrated automated control to monitor, record, and playback sonic and ultrasonic vocalisations. The cage will feature integrated video recording alongside an improved acoustic environment, computer-controlled doors, and a microphone\u2013speaker array capable of recording and playing back ultrasonic vocalizations with high fidelity. The video data will complement the microphone array, enabling simultaneous behavioral analysis, enhancing audio source separation, supporting advanced noise reduction, and allowing precise detection of individual vocalizations. Alongside the hardware development, the project will implement signal processing and machine learning algorithms for real-time detection, classification, and synthesis of mouse vocalizations, enabling closed-loop behavioral experiments. Special emphasis will be placed on co-design: optimizing the acoustic environment, minimizing handling of the animals, and ensuring robust, low-latency interaction between software and hardware. The resulting platform will support reproducible, high-throughput studies of communication, learning, and social behavior in laboratory mice.<\/p>\n\n\n\n This project will be conducted together with D. Penn and S. Zala<\/a> (VetMed Vienna). . It will be supported by PostDocs at ARI (R. Abbasi)<\/a>.<\/p>\n\n\n\n It will be conducted together with the IT:U HANS \u2013 Digital Production Lab and\/or the IT:U Design Lab.<\/p>\n\n\n\n See e.g.<\/p>\n\n\n\n * S. M. Zala, D. Reitschmidt, A. Noll, P. Balazs, D. J. Penn, „Sex-Dependent<\/p>\n\n\n\n Modulation of Ultrasonic Vocalizations in House Mice (Mus musculus musculus)“, PLOS ONE(2017)<\/p>\n<\/details>\n\n\n\n Why is spatial hearing important? Is its primary role to help us localize objects in space, or rather to segregate a sound of interest from competing sources\u2014such as during a cocktail party? Artificial neural networks (ANNs) offer a powerful framework to address such \u201cwhy\u201d questions about brain function. If an ANN trained on a particular task spontaneously reproduces a phenomenon observed in humans\u2014while training on other tasks does not\u2014this suggests that the phenomenon may emerge from optimizing the brain for that same task.<\/p>\n\n\n\n A striking example in spatial hearing is the history-dependent adaptation of absolute space perception. This has been speculated to reflect an adaptation that supports source segregation rather than precise localization.<\/p>\n\n\n\n This project will test that hypothesis by training ANNs on different objectives:<\/p>\n\n\n\n We will then examine under which training conditions human-like perceptual phenomena emerge. In addition, we will investigate the role of ecological validity by comparing networks trained on naturalistic, reverberant multi-source environments with those trained in simplified, anechoic conditions.<\/p>\n\n\n\n Ultimately, the project will shed light on whether and how representations of what and where interact in spatial hearing, offering insights into the functional relevance of this fundamental ability.<\/p>\n\n\n\n This project will be conducted together with R. Baumgartner<\/a> (ARI Vienna). <\/p>\n\n\n\n See e.g.<\/p>\n\n\n\n * Meijer, D., Barumerli, R. & Baumgartner, R. How relevant is the prior? Bayesian causal inference for dynamic perception in volatile environments. eLife 14, (2025).<\/p>\n\n\n\n This project aims to develop signal-processing and machine learning tools for automated segmentation, classification, and parameter estimation of animal vocalizations. Building on recent advances in computational bioacoustics, spectrogram- or waveform-based feature extraction, combined with convolutional, recurrent neural network architectures (and possibly other ML approaches) will be used to detect and classify call types, and extract acoustic parameters such as fundamental frequency contours, harmonics, or temporal structure under real-world<\/p>\n\n\n\n conditions with varying noise and domain shifts. Special attention will be paid to generalization: training and evaluating models across different recording conditions and species, designing effective data augmentation schemes, and deploying pretrained models and embeddings. The software and analysis tools will be open- source and interoperable, allowing reproducibility and seamless integration with diverse experimental platforms. The overall goal is to develop of a robust and interpretable framework that enables biologists to scale up quantitative bioacoustic analysis.<\/p>\n\n\n\n This project will be conducted on mice, budgerigars, elephants and potentially other animals, together with M. H\u00f6schele<\/a>, A. St\u00f6ger<\/a> and\/or A. Baotic<\/a> (ARI Vienna) depending on the animal taxa to be worked on. It will be supported by PostDocs at ARI (R. Abbasi<\/a>, D. Haider)<\/a>.<\/p>\n\n\n\n See e.g.<\/p>\n\n\n\n * R. Abbasi, P. Balazs, A. Marconi, D. Nicolakis, S. Zala, D. Penn, „Capturing the songs of mice with an improved detection and classification method for ultrasonic vocalizations (BootSnap)“, PLOS Computational Biology, Vol. 18( 5): e1010049, preprint on biorxiv (2022)<\/p>\n<\/details>\n\n\n\n This project addresses <\/em>the joint challenge of building energy-efficient acoustic monitoring hardware and developing <\/em>embedded machine learning algorithms is addressed <\/em>for wildlife applications. Specifically, the goals are to <\/em>design and prototype low-power acoustic monitors \u2014 either stationary sensors for zoos and field sites, or collar-mounted devices for large mammals such as giraffes or elephants \u2014 and equip <\/em>them with advanced <\/em>on-device signal processing and learning capabilities. The <\/em>research will mainly focus on co-designing the hardware and algorithms: optimizing microphones, developing efficient power supply solutions, designing data transmission pipelines for long-term deployment, and implementing lightweight machine learning models <\/em>for event detection, call classification, and active <\/em>learning directly on the device. The overall <\/em>goal is a comprehensive <\/em>system that enables autonomous bioacoustic monitoring and real-time tracking with <\/em>minimal energy consumption.<\/p>\n\n\n\n The developed system will be used for <\/em>elephants, giraffes, cheetahs, gibbons, or general wildlife monitoring, e.g. in Austrian woods, together with A. St\u00f6ger<\/a> and\/or A.<\/a> Baotic<\/a> (ARI Vienna) depending on the animal taxa.. It will be supported by PostDocs at ARI (D. Haider<\/a>), and a PhD student at ARI (J.Zeleznik<\/a>).<\/p>\n\n\n\n It will be conducted together with the IT:U HANS \u2013 Digital Production Lab and\/or the IT:U Design Lab.<\/p>\n\n\n\n See e.g.<\/p>\n\n\n\n * Zeppelzauer, M., Hensman, S., & Stoeger, A. S. (2014). Towards an automated<\/p>\n\n\n\n acoustic detection system for free-ranging elephants. Bioacoustics<\/em>, 24<\/em>(1), 13\u201329. https:\/\/doi.org\/10.1080\/09524622.2014.906321<\/p>\n<\/details>\n\n\n\n We will develop an interpretable (human) hearing model, building on our research on stable neural networks, and aimed at a continuous learning approach predicting human behavior in psychoacoustic experiments. In contrast to existing concepts, for the first task, we will create an interpretable invertible neural network-approach with learned filterbanks. The pipeline of a first model could be a hybrid filterbank based on an AUDlet, followed by a temporal convolution network (tCN) to model temporal integration in hearing, and general INNs, with a task-specific decision network at the end. The level of complexity will be increased by including tensors, recursive, and concatenated filterbank approaches to incorporate published modeling attempts such as multiple looks, level dependency and dual pathway approaches. We will learn and test our methods with a transfer learning approach on existing psychoacoustic datasets, predicting the results in published papers and integrate the results in the auditory modeling toolbox, hosted at ARI.<\/p>\n\n\n\n This project will be conducted together with B. Laback<\/a> (ARI). See e.g.<\/p>\n\n\n\n Saddler MR, McDermott JH. Models optimized for real-world tasks reveal the task- dependent necessity of precise temporal coding in hearing. Nat Commun. 2024 Dec 4;15(1):10590. doi: 10.1038\/s41467-024-54700-5. PMID: 39632854; PMCID:<\/p>\n\n\n\n PMC11618365. https:\/\/www.nature.com\/articles\/s41467-024-54700-5<\/a><\/p>\n<\/details>\n\n\n\n An ongoing debate in the design of machine learning models, particularly for applications involving acoustic data, is how input signals should be pre-processed and analyzed. That is, what is the best approach to feature extraction for audio? <\/em>The most common approach uses fixed time-frequency representations as a human- engineered way of representing audio to the model<\/em>. An alternative approach is to \u201clet the machine learn the representation<\/em>\u201d by using the raw audio signal directly as model input. The aim of this project is to explore the connections between concepts from signal processing and machine learning from a theoretical and practical point of view, and develop explanations as well as novel designs of feature extractors that leverage knowledge from both fields. An existing line of work within the project concerns a \u201chybrid\u201d approach that combines classical filterbank design with an integrated learning step by the model. A future goal here is to embed this construction into auditory research and design and use learned modulation filterbanks for feature extraction. <\/em>Additional topics include the interpretation of recurrent convolutional layers as filterbanks on infinite sequence spaces and the link of gradient boosting to empirical mode decomposition (EMD).<\/p>\n\n\n\n This project will be conducted together with V. Lostanlen<\/a> (LS2N CNRS Nantes) and will be supported by PostDocs at ARI (D. Haider<\/a>).<\/p>\n\n\n\n See e.g.<\/p>\n\n\n\n * D. Haider\u2217 , F. Perfler\u2217 , V. Lostanlen, M. Ehler, P. Balazs, „Hold Me Tight: Stable Encoder\u2013Decoder Design for Speech Enhancement“, Interspeech 2024, Kos Island (2024)<\/p>\n\n\n\n Supervision: Prof. Dr. Peter Balazs\u202f & Prof. Dr. Angela St\u00f6ger<\/em> Collar-mounted wildlife sensors enable continuous, minimally invasive monitoring of behavior,\u202fhabitat use, and inter-individual acoustic communication. Yet, attributing specific vocalizations to the correct individual in free-ranging groups remains challenging when audio is collected without tightly synchronized motion and position data. The candidate in this project will design and prototype a field-ready elephant collar that integrates wide-band acoustic recording, high-rate tri-axial accelerometery (X\/Y\/Z), and GPS positioning in a time-synchronized, low-power package. The system will feature precise clocking and sensor fusion pipelines so that subtle body movements and collar vibrations can be aligned with acoustic onsets, while GPS trajectories provide spatial constraints, together enabling robust focal-caller attribution. Emphasis will be placed on the ability to detect focal callers as well as power budgeting for longer deployments, rugged enclosure and microphone placement to minimize environmental noise, and serviceable data logging. The outcome will be a validated hardware prototype with open documentation, calibration and synchronization procedures, and a thesis evaluating focal-caller detection accuracy from combined sensors versus audio-only baselines. <\/p>\n\n\n\n Supervision: Prof. Dr. Peter Balazs\u202f & Prof. Dr. Angela St\u00f6ger<\/em> The use of long-term autonomous recorders has been steadily increasing over the past few decades in the field of bioacoustics. This means that wildlife researchers and bioacousticians are collecting thousands of hours of recordings, after which they manually extract sound events of their interest. Although the development and use of machine learning algorithms for automatic sound event extraction and analysis are promising, these generally only work well on large well-defined curated datasets with previously identified sounds events that can be used for training and validating. To make this available to the dataset at hand, the candidate in this project will design and prototype a modern annotation platform for audio and bioacoustics research that can couple an intuitive labelling UI with state-of-the-art machine learning. The tool will provide waveform\/spectrogram views, rapid keyboard\/mouse labelling, and flexible schema management, facilitating few-shot learners to \u201ccold-start\u201d models from just a handful of examples per class. An active-learning loop will continuously surface the most informative or uncertain clips for review, maximizing annotation efficiency and model quality with minimal human effort.\u202fEmphasis will be placed on the development of a tool which can be used for wildlife monitoring and\/or environmental soundscape analysis. The outcome will be a usable, extensible open-source tool, and a thesis evaluating gains in labelling speed\/accuracy versus conventional workflows.<\/p>\n<\/details>\n\n<\/div>\n\n \n <\/div> \n \n<\/div>\n\n\n
\n\n\n\n
\n\n\n\nShort bio:<\/h2>\n\n\n\n
\n
IT:U PhD Projects Acoustics, Analysis and AI (3AI)<\/strong><\/strong><\/h3>\n\n\n\n
Building Improved USV Boxes <\/summary>\n
Optimizing Artificial Neural Networks to Probe the Functional Role of Spatial Hearing<\/summary>\n
\n
![\"\"](\"https:\/\/it-u.at\/wp-content\/uploads\/2026\/02\/06\/headsfront-5.png\")
<\/figure>\n\n<\/details>\n\n\n\nMachine Learning and Signal Processing for Bioacoustic Vocalizations<\/summary>\n
Building Improved Bioacoustic Monitors<\/summary>\n
An Interpretable Hearing Model<\/summary>\n
Interpretable Audio-Preprocessing<\/summary>\n
![\"\"](\"https:\/\/it-u.at\/wp-content\/uploads\/2026\/02\/06\/filters-1024x304.png\")
<\/figure>\n\n<\/details>\n\n<\/div>\n\n \n <\/div> \n \n<\/div>\n\n\nPotential Projects<\/strong><\/strong><\/h3>\n\n\n\n
Potential Master and Off-Lab Projects:<\/strong>
<\/summary>\n\n
\n
\n
\n
\n
\n
Development of bioacoustics and movement monitoring collar mounted sensors for African Savannah elephants (Loxodonta Africana<\/em>) \u2013 MSc thesis project<\/strong> <\/summary>\n
Co-supervision: Dr. Daniel Haider & Jure \u017deleznik<\/em>
<\/p>\n\n\n\n![\"\"](\"https:\/\/it-u.at\/wp-content\/uploads\/2026\/02\/06\/adobestock_85248976-1024x609.jpeg\")
© AdobeStock<\/span><\/figure>\n\n<\/details>\n\n\n\nDevelopment of sound event annotating tool with incorporated few-shot and active learning \u2013 MSc thesis project<\/strong><\/summary>\n
Co-supervision: Dr. Daniel Haider & Jure \u017deleznik<\/em>
<\/p>\n\n\n\n<\/figure>\n\n\n\n\n![\"\"](\"https:\/\/it-u.at\/wp-content\/uploads\/2026\/02\/06\/jumphann8.png\")
<\/figure>\n\n\n\n\n![\"\"](\"https:\/\/it-u.at\/wp-content\/uploads\/2026\/02\/06\/synth.png\")
<\/figure>\n\n\n\n\n![\"\"](\"https:\/\/it-u.at\/wp-content\/uploads\/2026\/02\/06\/frame2.png\")
<\/figure>\n\n\n\n\n![\"\"](\"https:\/\/it-u.at\/wp-content\/uploads\/2026\/02\/06\/filters.png\")
<\/figure>\n\n\n<\/div>\n\n <\/div>\n\n","protected":false},"template":"","meta":{"_acf_changed":false},"acf":[],"yoast_head":"\n