Exploring Domain-Specific Enhancements for a Neural Foley Synthesizer

Published in arXiv preprint arXiv:2309.04641, 2023

Foley sound synthesis is the art of creating sound effects that match on-screen actions in film and video production. This paper explores domain-specific enhancements for neural Foley sound synthesis systems. We investigate architectural modifications, training strategies, and conditioning mechanisms that can improve the quality and realism of synthesized sounds for specific categories like footsteps, impacts, and environmental sounds.

Recommended citation: @article{pillay2023exploring, title={Exploring Domain-Specific Enhancements for a Neural Foley Synthesizer}, author={Pillay, Ashwin and Betko, Sage and Liloia, Ari and Chen, Hao and Shah, Ankit}, journal={arXiv preprint arXiv:2309.04641}, year={2023} }
Download Paper