Siamese autoencoders for speech style extraction and switching applied to voice identification and conversion

Seyed Hamidreza Mohammadi, Alexander Kain

Research output: Contribution to journalArticle

3 Scopus citations


We propose an architecture called siamese autoencoders for extracting and switching pre-determined styles of speech signals while retaining the content. We apply this architecture to a voice conversion task in which we define the content to be the linguistic message and the style to be the speaker's voice. We assume two or more data streams with the same content but unique styles. The architecture is composed of two or more separate but shared-weight autoencoders that are joined by loss functions at the hidden layers. A hidden vector is composed of style and content sub-vectors and the loss functions constrain the encodings to decompose style and content. We can select an intended target speaker either by supplying the associated style vector, or by extracting a new style vector from a new utterance, using a proposed style extraction algorithm. We focus on in-Training speakers but perform some initial experiments for out-of-Training speakers as well. We propose and study several types of loss functions. The experiment results show that the proposed many-To-many model is able to convert voices successfully; however, its performance does not surpass that of the state-of-The-Art one-To-one model's.

Original languageEnglish (US)
Pages (from-to)1293-1297
Number of pages5
JournalProceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
StatePublished - Jan 1 2017


  • Siamese autoencoders
  • Style extraction
  • Style switching
  • Voice conversion

ASJC Scopus subject areas

  • Language and Linguistics
  • Human-Computer Interaction
  • Signal Processing
  • Software
  • Modeling and Simulation

Fingerprint Dive into the research topics of 'Siamese autoencoders for speech style extraction and switching applied to voice identification and conversion'. Together they form a unique fingerprint.

  • Cite this