Semantic Crosstalk in Timbre Perception
Music & Science, 2019 Many adjectives for musical timbre reflect cross-modal correspondence, particularly with vision and touch (e.g., “dark–bright,” “smooth–rough”). Although multisensory integration between visual/tactile processing and hearing has been demonstrated for ...
Zachary Wallmark
doaj +2 more sources
Learning metrics on spectrotemporal modulations reveals the perception of musical instrument timbre
Nature Human Behaviour, 2020 Etienne Thoret +2 more
exaly +2 more sources
iEmoTTS: Toward Robust Cross-Speaker Emotion Transfer and Control for Speech Synthesis Based on Disentanglement Between Prosody and Timbre [PDF]
IEEE/ACM Transactions on Audio Speech and Language Processing, 2022 Cross-speaker emotion transfer is a common approach to generating emotional speech when speech data with emotion labels from target speakers is not available. This paper presents a novel cross-speaker emotion transfer system named iEmoTTS.
Guangyan Zhang +7 more
semanticscholar +1 more source
VarietySound: Timbre-Controllable Video to Sound Generation Via Unsupervised Information Disentanglement [PDF]
IEEE International Conference on Acoustics, Speech, and Signal Processing, 2022 Video-to-sound generation aims to generate realistic and natural sound given a video input. However, previous video-to-sound generation methods can only generate a random or average timbre without any controls of the generated sound timbre, leading to ...
Chenye Cui +4 more
semanticscholar +1 more source
Research on the Correlation Between the Timbre Attributes of Musical Sound and Visual Color
IEEE Access, 2021 This article investigated the timbre of musical sound and visual color; comprehensively used experimental psychology, audio information processing and other experimental methods and technical means; and conducted research on the relationship between ...
Jingyu Liu +4 more
doaj +1 more source
Feature Extraction and Analysis Method of Trombone Timbre Based on CNN Model
Journal of Robotics, 2022 In order to improve the accuracy of trombone timbre feature extraction, this paper combines the CNN model to construct a trombone timbre feature extraction model and summarizes the principle of trombone timbre signal.
Yanjun Wang
doaj +1 more source
Transplayer: Timbre Style Transfer with Flexible Timbre Control
IEEE International Conference on Acoustics, Speech, and Signal Processing, 2023 Music timbre style transfer aims at replacing the instrument timbre in a solo recording with another instrument, while preserving the musical content. Existing GAN-based methods can only achieve timbre style transfer between two given timbres.
Yuxuan Wu +4 more
semanticscholar +1 more source
Timbre Transfer with Variational Auto Encoding and Cycle-Consistent Adversarial Networks [PDF]
IEEE International Joint Conference on Neural Network, 2021 This work investigates the application of deep learning to timbre transfer. The adopted approach combines Variational Autoencoders with Generative Adversarial Networks to construct meaningful representations of the source audio and produce realistic ...
Russell Sammut Bonnici +2 more
semanticscholar +1 more source
Any-to-Any Voice Conversion with F0 and Timbre Disentanglement and Novel Timbre Conditioning
IEEE International Conference on Acoustics, Speech, and Signal Processing, 2023 Despite recent advances in voice conversion (VC), it is still challenging to do real-time one-shot voice conversion with good control over timbre and F0. In this work, we present a PPG-based VC model that directly decodes waveforms. We designed a speaker
Sudheer Kovela +3 more
semanticscholar +1 more source
Open Research Europe, 2022 Over the last few years, the financial sector has undergone a digital revolution that has had a severe impact on different related areas such as, the entities, the cybersecurity of systems, regulations and, of course, customers.
Miren Karmele García +5 more
doaj +1 more source