Zero-shot Multi-Lingual and Multi-Speaker TTS


Authors: Cheng Gong, Xin Wang, Erica Cooper, Dan Wells,
Longbiao Wang, Jianwu Dang, Korin Richmond, Junichi Yamagishi

College of Intelligence and Computing, Tianjin University, China

National Institute of Informatics, Japan

Centre for Speech Technology Research, University of Edinburgh, United Kingdom

Seen speaker results:

Input Text

  • English:a stooped old lady with a mottled face a hooked nose and a hard gray eye mrs pipchin took little children to board and her idea of managing them
  • French:Le concept d'emploi budgétaire est utilisé lors de la négociation entre le ministère du budget et le ministre chargé de l'enseignement supérieur
  • German:der Oberste Sowjet hatte es mehrheitlich abgelehnt das geltende Gesetz über ein Referendum mit den Beschlüssen des Kongresses in Einklang zu bringen
  • Portuguese:os presidentes se reuniram na cidade de Latakia na Síria mas nenhum dos dois se pronunciou sobre a vitória de Netanyahu
  • Spanish:Los vendedores ofrecen cada vez más ambas drogas lo que ha hecho la heroína tan disponible como el crack también llamado piedra
  • Swedish:Vi har svårt att påverka investeringsviljan direkt men genom att exempelvis erbjuda olika finansieringsalternativ kan vi positivt påverka kundens likviditetsbehov
Method English French German Portuguese Spanish Swedish
FSM1C
FSM2C
ZMM-TTS1C
ZMM-TTS2C
FSM1X
FSM2X
ZMM-TTS1X
ZMM-TTS2X
YourTTS
GT

Unseen speaker results:

Input Text

  • English:he lifted his head with a jerk and swung the quail away from the heat leaving it still suspended and taking his rifle from its pegs stood for a moment in his door listening
  • French:Au niveau national le premier délégué assume toutes les responsabilités pour ce qui concerne le concours national de mémoires
  • German:du starker tod dein schweigen machet graun hast du uns nur die totengruft zu bieten sollt nicht der geist die jakobsleiter schaun und fortbestehn nur in den
  • Portuguese:essa atitude já mudou o Alca é uma prioridade de Washington enquadrada na moldura da estratégia de de incentivo das exportações americanas
  • Spanish:La primera reunión entre negociadores palestinos y judíos se efectuará el domingo en la frontera entre Israel y Gaza con la participación del mediador norteamericano Dennis Ross
  • Swedish:flera beväpnade protester i Shimba tidigare slagits ner av Mobutus trupper
Method English French German Portuguese Spanish Swedish
FSM1C
FSM2C
ZMM-TTS1C
ZMM-TTS2C
FSM1X
FSM2X
ZMM-TTS1X
ZMM-TTS2X
YourTTS
GT

Low-resources results: