Audio samples from Tacotron 2

Authors: Stefan Taubert, Sven Albrecht, Rewa Tamboli, Maximilian Eibl, Josef Schmied, Günther Daniel Rey

Recommendation: The best quality is obtained by listening with headphones.

You can download our pretrained model here.

Scientific background

On the poster we described the scientific background for this specific TTS system.

Poster Background

Linguistic texts

The North Wind and the Sun (Version 1) - English with American English accent (female)

The IPA is retrieved by converting the English text with Epitran to IPA. The speaker was Linda Johnson from LJSpeech dataset (American English accent).

IPA

ðə nɔɹθ wɪnd ænd ðə sʌn wɹ̩ dɪspjutɪŋ wɪtʃ wɑz ðə stɹɔŋɹ̩, wɛn ə tɹævəlɹ̩ kejm əlɔŋ ɹæpt ɪn ə wɔɹm klowk. ðej əɡɹid ðæt ðə wʌn hu fɹ̩st səksidəd ɪn mejkɪŋ ðə tɹævəlɹ̩ tejk hɪz klowk ɔf ʃʊd bi kənsɪdɹ̩d stɹɔŋɹ̩ ðæn ðə ʌðɹ̩. ðɛn ðə nɔɹθ wɪnd blu æz hɑɹd æz hi kʊd, bʌt ðə mɔɹ hi blu ðə mɔɹ klowsli dɪd ðə tɹævəlɹ̩ fowld hɪz klowk ɹ̩awnd hɪm; ænd æt læst ðə nɔɹθ wɪnd ɡejv ʌp ðə ətɛmpt. ðɛn ðə sʌn ʃajnd awt wɔɹmli, ænd ɪmidiətli ðə tɹævəlɹ̩ tʊk ɔf hɪz klowk. ænd sow ðə nɔɹθ wɪnd wɑz əblajdʒd tə kənfɛs ðæt ðə sʌn wɑz ðə stɹɔŋɹ̩ ʌv ðə tu.

English

The North Wind and the Sun were disputing which was the stronger, when a traveler came along wrapped in a warm cloak. They agreed that the one who first succeeded in making the traveler take his cloak off should be considered stronger than the other. Then the North Wind blew as hard as he could, but the more he blew the more closely did the traveler fold his cloak around him; and at last the North Wind gave up the attempt. Then the Sun shined out warmly, and immediately the traveler took off his cloak. And so the North Wind was obliged to confess that the Sun was the stronger of the two.

The North Wind and the Sun (Version 1) - English with American English accent (male)

The IPA is retrieved by converting the English text with Epitran to IPA. The speaker was Brett W. Downey from libritts dataset (American English accent).

IPA

ðə nɔɹθ wɪnd ænd ðə sʌn wɹ̩ dɪspjutɪŋ wɪtʃ wɑz ðə stɹɔŋɹ̩, wɛn ə tɹævəlɹ̩ kejm əlɔŋ ɹæpt ɪn ə wɔɹm klowk. ðej əɡɹid ðæt ðə wʌn hu fɹ̩st səksidəd ɪn mejkɪŋ ðə tɹævəlɹ̩ tejk hɪz klowk ɔf ʃʊd bi kənsɪdɹ̩d stɹɔŋɹ̩ ðæn ðə ʌðɹ̩. ðɛn ðə nɔɹθ wɪnd blu æz hɑɹd æz hi kʊd, bʌt ðə mɔɹ hi blu ðə mɔɹ klowsli dɪd ðə tɹævəlɹ̩ fowld hɪz klowk ɹ̩awnd hɪm; ænd æt læst ðə nɔɹθ wɪnd ɡejv ʌp ðə ətɛmpt. ðɛn ðə sʌn ʃajnd awt wɔɹmli, ænd ɪmidiətli ðə tɹævəlɹ̩ tʊk ɔf hɪz klowk. ænd sow ðə nɔɹθ wɪnd wɑz əblajdʒd tə kənfɛs ðæt ðə sʌn wɑz ðə stɹɔŋɹ̩ ʌv ðə tu.

English

The North Wind and the Sun were disputing which was the stronger, when a traveler came along wrapped in a warm cloak. They agreed that the one who first succeeded in making the traveler take his cloak off should be considered stronger than the other. Then the North Wind blew as hard as he could, but the more he blew the more closely did the traveler fold his cloak around him; and at last the North Wind gave up the attempt. Then the Sun shined out warmly, and immediately the traveler took off his cloak. And so the North Wind was obliged to confess that the Sun was the stronger of the two.

The North Wind and the Sun (Version 2) - English with American English accent (female)

The IPA is created by hand. The speaker was Linda Johnson from LJSpeech dataset (American English accent).

IPA

ðə nɔɹθ wɪnd ənd ðə sʌn wɹ̩ dɪspjutɪŋ wɪtʃ wɑz ðə stɹɑŋɹ̩, wen ə tɹævəlɹ̩ keɪm əlɑŋ ɹæpt ɪn ə wɔɹm kloʊk. ðeɪ əɡɹid ðæt ðə wʌn hu fɹ̩st səksidɪd ɪn meɪkɪŋ ðə tɹævəlɹ̩ teɪk ɑf hɪz kloʊk ʃʊd bi kənsɪdɹ̩d stɹɑŋɹ̩ ðən ðə ʌðɹ̩. ðen ðə nɔɹθ wɪnd blu əz hɑɹd əz hi kʊd, bət ðə mɔɹ hi blu ðə mɔɹ kloʊsli dɪd ðə tɹævəlɹ̩ foʊld hɪz kloʊk əɹaʊnd ɪm; ænd ət læst ðə nɔɹθ wɪnd ɡeɪv ʌp ðə ətempt. ðen ðə sʌn ʃaɪnd aʊt wɔɹmli, ənd ɪmidiətli ðə tɹævəlɹ̩ tʊk ɑf hɪz kloʊk. ənd soʊ ðə nɔɹθ wɪnd wɑz əblaɪdʒd tu kənfes ðæt ðə sʌn wɑz ðə stɹɑŋɹ̩ əv ðə tu.

English

The North Wind and the Sun were disputing which was the stronger, when a traveler came along wrapped in a warm cloak. They agreed that the one who first succeeded in making the traveler take off his cloak should be considered stronger than the other. Then the North Wind blew as hard as he could, but the more he blew the more closely did the traveler fold his cloak around him; and at last the North Wind gave up the attempt. Then the Sun shined out warmly, and immediately the traveler took off his cloak. And so the North Wind was obliged to confess that the Sun was the stronger of the two.

Stella - English with American English accent (female)

The speaker was Linda Johnson from LJSpeech dataset (American English accent).

IPA

pliz kɔl stɛlə. æsk hɹ̩ tə bɹɪŋ ðiz θɪŋz wɪð hɹ̩ fɹʌm ðə stɔɹ: sɪks spunz ʌv fɹɛʃ snow piz, fajv θɪk slæbz ʌv blu tʃiz, ænd mejbi ə snæk fɔɹ hɹ̩ bɹʌðɹ̩ bɑb. wi ɔlsow nid ə smɔl plæstɪk snejk ænd ə bɪɡ toj fɹɑɡ fɔɹ ðə kɪdz. ʃi kæn skup ðiz θɪŋz ɪntu θɹi ɹɛd bæɡz, ænd wi wɪl ɡow mit hɹ̩ wɛnzdi æt ðə tɹejn stejʃən.

English

Please call Stella. Ask her to bring these things with her from the store: six spoons of fresh snow peas, five thick slabs of blue cheese, and maybe a snack for her brother Bob. We also need a small plastic snake and a big toy frog for the kids. She can scoop these things into three red bags, and we will go meet her Wednesday at the train station.

Der Nordwind und die Sonne - German with American English accent (female)

The speaker was Linda Johnson from LJSpeech dataset (American English accent).

IPA

ainst stɹitən sih noətvind und sone, vəɹ fon inən baiedən vol dəɹ steəkeɹe veɹe, als ain vandeɹəɹ, dəɹ in aiənən vaəmən mantel ɡehult vaɹ, des veɡes daheəkam. tsi vuədən aiəniʃ, das deəjeniɡe fuɹ dən steəkeɹən ɡeltən solte, dəɹ dən vandeɹəɹ tsviŋən vuəde, saiənən mantel aptsunemən. dəɹ noətvind plis mit aləɹ maht, abəɹ je meɹ əɹ plis, desto festəɹ hulte sih dəɹ vandeɹəɹ in saiənən mantel ain. əntlih ɡab dəɹ noətvind dən kampf auf. nun eəveəmte di sone di luft mit iɹən fɹountlihən stɹalən, und ʃon nah veniɡən auhɡənplikən tsoɡ dəɹ vandeɹəɹ saiənən mantel aus. da muste dəɹ noətvind tsuɡebən, das di sone fon inən baiedən dəɹ steəkeɹe vaɹ.

German

Einst stritten sich Nordwind und Sonne, wer von ihnen beiden wohl der Stärkere wäre, als ein Wanderer, der in einen warmen Mantel gehüllt war, des Weges daherkam. Sie wurden einig, daß derjenige für den Stärkeren gelten sollte, der den Wanderer zwingen würde, seinen Mantel abzunehmen. Der Nordwind blies mit aller Macht, aber je mehr er blies, desto fester hüllte sich der Wanderer in seinen Mantel ein. Endlich gab der Nordwind den Kampf auf. Nun erwärmte die Sonne die Luft mit ihren freundlichen Strahlen, und schon nach wenigen Augenblicken zog der Wanderer seinen Mantel aus. Da mußte der Nordwind zugeben, daß die Sonne von ihnen beiden der Stärkere war.

The Northwind and the Sun (Chinese) - Chinese with Mandarin accent (female)

The speaker was D4 from THCHS-30 dataset (Mandarin accent).

IPA

tɑŋ̋lȳ̏̄ɕiŋ̄̋ʈʂɤ̄̏̄kwɔ̄̏̄ʈʂɤwən̋nwan̄̏̄tɤtoʊ̋̏pʰɤŋtsoʊ̄̏̄laɪ̄̋ʂɨ̄̋ peɪ̄̏̄fɤŋ̋xɤ̄̋tʰaɪ̋̏jɑŋ̄̋ʈʂɨ̋ʈʂɤŋ̋kɤŋ̋̏tɕʰjɑŋ̄̋. tʰa̋məntʰʊŋ̄̋i̋̏ i̋kɤ̋̏ʂoʊ̄̏̄ɕjɛn̋ʈʂʰɤŋ̄̋kʊŋ̋ʂɨ̄̏̄lȳ̏̄ɕiŋ̄̋ʈʂɤ̄̏̄tʰwɔ̋ɕja̋̏toʊ̋̏pʰɤŋtɤʐən̄̋iŋ̋kaɪ̋peɪ̋̏ʐən̋̏weɪ̋̏pī̏̄liŋ̋̏i̋kɤ̋̏kɤŋ̋̏tɕʰjɑŋ̄̋ta̋̏. ʐan̄̋xoʊ̋̏ peɪ̄̏̄fɤŋ̋ʈʂʰweɪ̋tɤtɕin̄̏̄li̋̏ɑɻ̄̋weɪ̋̏ tan̋̏ʈʂʰweɪ̋tɤɥœ̋̏li̋̏xaɪ̋̏ lȳ̏̄ɕiŋ̄̋ʈʂɤ̄̏̄tɕjoʊ̋̏ɥœ̋̏pʰi̋ʂɑŋ̋̏toʊ̋̏pʰɤŋ. tsweɪ̋̏xoʊ̋̏ peɪ̄̏̄fɤŋ̋fɑŋ̋̏tɕʰi̋̏lɤʈʂɤ̋̏i̋ʈʂʰɑŋ̄̋ʂɨ̋̏. ʐan̄̋xoʊ̋̏tʰaɪ̋̏jɑŋ̄̋wən̋nwan̄̏̄tɤʈʂɑʊ̋̏jɑʊ̋̏ʈʂɤ lȳ̏̄ɕiŋ̄̋ʈʂɤ̄̏̄li̋̏kʰɤ̋̏tʰwɔ̋ɕja̋̏lɤtoʊ̋̏pʰɤŋ. in̋tsʰɯ̄̏̄ peɪ̄̏̄fɤŋ̋pű̏tɤpű̏ʈʂʰɤŋ̄̋ʐən̋̏tʰaɪ̋̏jɑŋ̄̋ʂɨ̋̏ljɑŋ̄̏̄ʈʂɤ̄̏̄ʈʂʊŋ̋tsweɪ̋̏tɕʰjɑŋ̄̋tɤi̋kɤ̋̏.

Chinese

当旅行者裹着温暖的斗篷走来时,北风和太阳之争更强。他们同意,一个首先成功使旅行者脱下斗篷的人应该被认为比另一个更强大。然后,北风吹得尽力而为,但吹得越厉害,旅行者就越披上斗篷。最后,北风放弃了这一尝试。然后太阳温暖地照耀着,旅行者立刻脱下了斗篷。因此,北风不得不承认太阳是两者中最强的一个。

The Northwind and the Sun - English with Mandarin accent (female)

The speaker was D4 from THCHS-30 dataset (Mandarin accent) and trained on Chinese.

IPA (English IPA mapped to Chinese IPA)

sə nɔɻs wɪnt ant sə sɑn wɻ tɪspjutɪŋ wɪtʂ wɑɕ sə stɻɔŋɻ wɛn ə tɻawəlɻ kejm əlɔŋ ɻapt ɪn ə wɔɻm klowk. sej əkɻit sat sə wɑn xu fɻst səksitət ɪn mejkɪŋ sə tɻawəlɻ tejk xɪɕ klowk ɔf ʂʊt pi kənsɪtɻt stɻɔŋɻ san sə ɑsɻ. sɛn sə nɔɻs wɪnt plu aɕ xɑɻt aɕ xi kʊt pɑt sə mɔɻ xi plu sə mɔɻ klowsli tɪt sə tɻawəlɻ fowlt xɪɕ klowk ɻawnt xɪm. ant at last sə nɔɻs wɪnt kejw ɑp sə ətɛmpt. sɛn sə sɑn ʂajnt awt wɔɻmli ant ɪmitiətli sə tɻawəlɻ tʊk ɔf xɪɕ klowk. ant sow sə nɔɻs wɪnt wɑɕ əplajtɕt tə kənfɛs sat sə sɑn wɑɕ sə stɻɔŋɻ ɑw sə tu.

English

The North Wind and the Sun were disputing which was the stronger, when a traveler came along wrapped in a warm cloak. They agreed that the one who first succeeded in making the traveler take his cloak off should be considered stronger than the other. Then the North Wind blew as hard as he could, but the more he blew the more closely did the traveler fold his cloak around him; and at last the North Wind gave up the attempt. Then the Sun shined out warmly, and immediately the traveler took off his cloak. And so the North Wind was obliged to confess that the Sun was the stronger of the two.

Der Nordwind und die Sonne - German with Chinese accent (female)

The speaker was D4 from THCHS-30 dataset (Mandarin accent) and trained on Chinese.

IPA (German IPA mapped to Chinese IPA)

ainst stɻitən six noətwint unt sone wəɻ fon inən paietən wol təɻ steəkeɻe weɻe als ain wanteɻəɻ təɻ in aiənən waəmən mantel kexylt waɻ tes wekes taxeəkam. tsi wuətən aiəniɕ tas teəjenike fyɻ tən steəkeɻən keltən solte təɻ tən wanteɻəɻ tswiŋən wyəte saiənən mantel aptsunemən. təɻ noətwint plis mit aləɻ maxt apəɻ je meɻ əɻ plis testo festəɻ xylte six təɻ wanteɻəɻ in saiənən mantel ain. əntlix kap təɻ noətwint tən kampf auf. nun eəweəmte ti sone ti luft mit iɻən fɻoyntlixən stɻalən unt ʂon nax wenikən auxkənplikən tsok təɻ wanteɻəɻ saiənən mantel aus. ta muste təɻ noətwint tsukepən tas ti sone fon inən paietən təɻ steəkeɻe waɻ.

German

Einst stritten sich Nordwind und Sonne, wer von ihnen beiden wohl der Stärkere wäre, als ein Wanderer, der in einen warmen Mantel gehüllt war, des Weges daherkam. Sie wurden einig, daß derjenige für den Stärkeren gelten sollte, der den Wanderer zwingen würde, seinen Mantel abzunehmen. Der Nordwind blies mit aller Macht, aber je mehr er blies, desto fester hüllte sich der Wanderer in seinen Mantel ein. Endlich gab der Nordwind den Kampf auf. Nun erwärmte die Sonne die Luft mit ihren freundlichen Strahlen, und schon nach wenigen Augenblicken zog der Wanderer seinen Mantel aus. Da mußte der Nordwind zugeben, daß die Sonne von ihnen beiden der Stärkere war.

The North Wind and the Sun (Version 1) - English with Mandarin accent (female)

The IPA is retrieved by converting the English text with Epitran to IPA. The speaker was LXC from arctic dataset (Mandarin L1). The characters "," and ";" were removed as they didn't occured in the training set.

IPA

ðə nɔɹθ wɪnd ænd ðə sʌn wɹ̩ dɪspjutɪŋ wɪtʃ wɑz ðə stɹɔŋɹ̩ wɛn ə tɹævəlɹ̩ kejm əlɔŋ ɹæpt ɪn ə wɔɹm klowk. ðej əɡɹid ðæt ðə wʌn hu fɹ̩st səksidəd ɪn mejkɪŋ ðə tɹævəlɹ̩ tejk hɪz klowk ɔf ʃʊd bi kənsɪdɹ̩d stɹɔŋɹ̩ ðæn ðə ʌðɹ̩. ðɛn ðə nɔɹθ wɪnd blu æz hɑɹd æz hi kʊd bʌt ðə mɔɹ hi blu ðə mɔɹ klowsli dɪd ðə tɹævəlɹ̩ fowld hɪz klowk ɹ̩awnd hɪm ænd æt læst ðə nɔɹθ wɪnd ɡejv ʌp ðə ətɛmpt. ðɛn ðə sʌn ʃajnd awt wɔɹmli ænd ɪmidiətli ðə tɹævəlɹ̩ tʊk ɔf hɪz klowk. ænd sow ðə nɔɹθ wɪnd wɑz əblajdʒd tə kənfɛs ðæt ðə sʌn wɑz ðə stɹɔŋɹ̩ ʌv ðə tu.

English

The North Wind and the Sun were disputing which was the stronger, when a traveler came along wrapped in a warm cloak. They agreed that the one who first succeeded in making the traveler take his cloak off should be considered stronger than the other. Then the North Wind blew as hard as he could, but the more he blew the more closely did the traveler fold his cloak around him; and at last the North Wind gave up the attempt. Then the Sun shined out warmly, and immediately the traveler took off his cloak. And so the North Wind was obliged to confess that the Sun was the stronger of the two.

The North Wind and the Sun (Version 1) - English with Hindi accent (male)

The IPA is retrieved by converting the English text with CMU dictionary and Epitran to IPA. The speaker was RRBI from arctic dataset (Hindi L1). The characters "," and ";" were replaced with "." as they didn't occured in the training set.

IPA

ðʌ nˈɔɹθ wˈɪnd ʌnd ðʌ sˈʌn wˈɹ̩ dɪspjˈutɪŋ wˈɪtʃ wˈɑz ðʌ stɹˈɔŋɡɹ̩. wˈɛn ʌ tɹˈævʌlɹ̩ kˈeɪm ʌlˈɔŋ ɹˈæpt ɪn ʌ wˈɔɹm klˈoʊk. ðˈeɪ ʌɡɹˈid ðˈæt ðʌ wˈʌn hˈu fˈɹ̩st sʌksˈidʌd ɪn mˈeɪkɪŋ ðʌ tɹˈævʌlɹ̩ tˈeɪk hˈɪz klˈoʊk ˈɔf ʃˈʊd bˈi kʌnsˈɪdɹ̩d stɹˈɔŋɡɹ̩ ðˈæn ðʌ ˈʌðɹ̩. ðˈɛn ðʌ nˈɔɹθ wˈɪnd blˈu ˈæz hˈɑɹd ˈæz hˈi kˈʊd. bˈʌt ðʌ mˈɔɹ hˈi blˈu ðʌ mˈɔɹ klˈoʊsli dˈɪd ðʌ tɹˈævʌlɹ̩ fˈoʊld hˈɪz klˈoʊk ɹ̩ˈaʊnd hˈɪm. ʌnd ˈæt lˈæst ðʌ nˈɔɹθ wˈɪnd ɡˈeɪv ˈʌp ðʌ ʌtˈɛmpt. ðˈɛn ðʌ sˈʌn ʃˈaɪnd ˈaʊt wˈɔɹmli. ʌnd ˌɪmˈidˌiʌtli ðʌ tɹˈævʌlɹ̩ tˈʊk ˈɔf hˈɪz klˈoʊk. ʌnd sˈoʊ ðʌ nˈɔɹθ wˈɪnd wˈɑz ʌblˈaɪdʒd tˈu kʌnfˈɛs ðˈæt ðʌ sˈʌn wˈɑz ðʌ stɹˈɔŋɡɹ̩ ˈʌv ðʌ tˈu.

English

The North Wind and the Sun were disputing which was the stronger. When a traveler came along wrapped in a warm cloak. They agreed that the one who first succeeded in making the traveler take his cloak off should be considered stronger than the other. Then the North Wind blew as hard as he could, but the more he blew the more closely did the traveler fold his cloak around him. And at last the North Wind gave up the attempt. Then the Sun shined out warmly. And immediately the traveler took off his cloak. And so the North Wind was obliged to confess that the Sun was the stronger of the two.

The North Wind and the Sun (Version 1) - English with Hindi accent (female)

The IPA is retrieved by converting the English text with CMU dictionary and Epitran to IPA. The speaker was TNI from arctic dataset (Hindi L1). The characters "," and ";" were removed as they didn't occured in the training set.

IPA

ðʌ nˈɔɹθ wˈɪnd ʌnd ðʌ sˈʌn wˈɝ dɪspjˈutɪŋ wˈɪtʃ wˈɑz ðʌ stɹˈɔŋɡɝ wˈɛn ʌ tɹˈævʌlɝ kˈeɪm ʌlˈɔŋ ɹˈæpt ɪn ʌ wˈɔɹm klˈoʊk. ðˈeɪ ʌɡɹˈid ðˈæt ðʌ wˈʌn hˈu fˈɝst sʌksˈidʌd ɪn mˈeɪkɪŋ ðʌ tɹˈævʌlɝ tˈeɪk hˈɪz klˈoʊk ˈɔf ʃˈʊd bˈi kʌnsˈɪdɝd stɹˈɔŋɡɝ ðˈæn ðʌ ˈʌðɝ. ðˈɛn ðʌ nˈɔɹθ wˈɪnd blˈu ˈæz hˈɑɹd ˈæz hˈi kˈʊd bˈʌt ðʌ mˈɔɹ hˈi blˈu ðʌ mˈɔɹ klˈoʊsli dˈɪd ðʌ tɹˈævʌlɝ fˈoʊld hˈɪz klˈoʊk ɝˈaʊnd hˈɪm. ʌnd ˈæt lˈæst ðʌ nˈɔɹθ wˈɪnd ɡˈeɪv ˈʌp ðʌ ʌtˈɛmpt. ðˈɛn ðʌ sˈʌn ʃˈaɪnd ˈaʊt wˈɔɹmli ʌnd ˌɪmˈidˌiʌtli ðʌ tɹˈævʌlɝ tˈʊk ˈɔf hˈɪz klˈoʊk. ʌnd sˈoʊ ðʌ nˈɔɹθ wˈɪnd wˈɑz ʌblˈaɪdʒd tˈu kʌnfˈɛs ðˈæt ðʌ sˈʌn wˈɑz ðʌ stɹˈɔŋɡɝ ˈʌv ðʌ tˈu.

English

The North Wind and the Sun were disputing which was the stronger when a traveler came along wrapped in a warm cloak. They agreed that the one who first succeeded in making the traveler take his cloak off should be considered stronger than the other. Then the North Wind blew as hard as he could, but the more he blew the more closely did the traveler fold his cloak around him and at last the North Wind gave up the attempt. Then the Sun shined out warmly, and immediately the traveler took off his cloak. And so the North Wind was obliged to confess that the Sun was the stronger of the two.

Validation

LJSpeech - LJ014-0126

Displayed is the synthesized result for one entry from the validation set (LJ014-0126).

IPA

hɹ̩ fejs wɑz kʌmli, ʃi hæd dɑɹk hɛɹ ænd ɡʊd ajz, ænd wɑz əbʌv ðə mɪdəl hajt, jɛt ɪnklajnd tə bi stawt.

English

her face was comely, she had dark hair and good eyes, and was above the middle height, yet inclined to be stout.

Reference
Mel-spectrogram Original audio mel-spectrogram
Synthesized
Mel-spectrogram Synthesized audio mel-spectrogram