# Mimic2 custom training produces "horizontal high line" line in alignment graph

**URL:** https://community.openconversational.ai/t/mimic2-custom-training-produces-horizontal-high-line-line-in-alignment-graph/8459
**Category:** Mimic
**Created:** [April 9, 2020, 4:52am UTC](https://community.openconversational.ai/t/mimic2-custom-training-produces-horizontal-high-line-line-in-alignment-graph/8459 "2020-04-09T04:52:00Z")
**Posts on this page:** 11
**Page:** 1

<div class="post-metadata">

### Author: ![Thorsten](https://community.openconversational.ai/user_avatar/community.openconversational.ai/thorsten/32/4539_2.png) [@Thorsten](https://community.openconversational.ai/u/Thorsten)
#### Post date: [April 9, 2020, 4:52am UTC](https://community.openconversational.ai/t/mimic2-custom-training-produces-horizontal-high-line-line-in-alignment-graph/8459/1 "2020-04-09T04:52:00Z")

</div>

I’m currently training my own german voice for “free-to-use” by community based on mimic2.  
But alignement graph shows always a high horizontal line and produces some too robotic speech.

Will this line go away with more training steps (currently on 110k) or how can i fix this?

![step-110000-align](https://community.openconversational.ai/uploads/default/original/2X/9/965a4b0dd752d2d4b22474afa6bf87c3734a243f.png)

The generated tts wav file is available here:  
[https://drive.google.com/open?id=1A6cMpOxRtopXRwLpFeBCr31cBUxWr\_gF](https://drive.google.com/open?id=1A6cMpOxRtopXRwLpFeBCr31cBUxWr_gF)

The alignement example on [GitHub - MycroftAI/mimic2: Text to Speech engine based on the Tacotron architecture, initially implemented by Keith Ito.](https://github.com/MycroftAI/mimic2) does not have this problem.

Would be thankful for any suggestion on how to fix this.

Thorsten

---

<div class="post-metadata">

### Author: ![baconator](https://community.openconversational.ai/letter_avatar_proxy/v4/letter/b/d07c76/32.png) [@baconator](https://community.openconversational.ai/u/baconator)
#### Post date: [April 9, 2020, 6:40pm UTC](https://community.openconversational.ai/t/mimic2-custom-training-produces-horizontal-high-line-line-in-alignment-graph/8459/2 "2020-04-09T18:40:00Z")

</div>

I was never able to get this to go away with different datasets, including LJ.

---

<div class="post-metadata">

### Author: ![Thorsten](https://community.openconversational.ai/user_avatar/community.openconversational.ai/thorsten/32/4539_2.png) [@Thorsten](https://community.openconversational.ai/u/Thorsten)
#### Post date: [April 9, 2020, 8:24pm UTC](https://community.openconversational.ai/t/mimic2-custom-training-produces-horizontal-high-line-line-in-alignment-graph/8459/3 "2020-04-09T20:24:13Z")

</div>

Thanks for your reply.

Do you know if the line is the reason for the voice sounding robotic with little reverb?  
How many steps did you train during your tests? I’m currently on step 127k.

 ![Bildschirmfoto von 2020-04-09 22-22-16](https://community.openconversational.ai/uploads/default/original/2X/f/fc70bbcc0a7e61643b779871598693b4c611f3a5.png)

---

<div class="post-metadata">

### Author: ![Thorsten](https://community.openconversational.ai/user_avatar/community.openconversational.ai/thorsten/32/4539_2.png) [@Thorsten](https://community.openconversational.ai/u/Thorsten)
#### Post date: [April 9, 2020, 8:38pm UTC](https://community.openconversational.ai/t/mimic2-custom-training-produces-horizontal-high-line-line-in-alignment-graph/8459/4 "2020-04-09T20:38:17Z")

</div>

When running eval.py crazy alignment graphs are generated for (german) test sentences. But sentence no. 3 creates a “good” one.  
 ![eval-128000-4](https://community.openconversational.ai/uploads/default/original/2X/9/999b89cc499b3e09feba944193e9a74bed9ca725.png) ![eval-128000-3](https://community.openconversational.ai/uploads/default/original/2X/5/57ca130516919741ab410c1cb1fb59ae65d11e03.png) ![eval-128000-2](https://community.openconversational.ai/uploads/default/original/2X/3/34644a286a83ccf1ae4179d8d58f43f6b449a073.png) ![eval-128000-1](https://community.openconversational.ai/uploads/default/original/2X/e/edfa46e5f4e16e7ae81261073e2e334ac3c96c65.png)

---

<div class="post-metadata">

### Author: ![baconator](https://community.openconversational.ai/letter_avatar_proxy/v4/letter/b/d07c76/32.png) [@baconator](https://community.openconversational.ai/u/baconator)
#### Post date: [April 9, 2020, 10:34pm UTC](https://community.openconversational.ai/t/mimic2-custom-training-produces-horizontal-high-line-line-in-alignment-graph/8459/5 "2020-04-09T22:34:55Z")

</div>

up to 400k at one point. It never got better. Basically 50k is the cut off…if alignment hasn’t happened by then I’d kill it and try something else. Also the large spikes were places I’d stop and backup and start again on. That seemed to help a bit.

---

<div class="post-metadata">

### Author: ![Thorsten](https://community.openconversational.ai/user_avatar/community.openconversational.ai/thorsten/32/4539_2.png) [@Thorsten](https://community.openconversational.ai/u/Thorsten)
#### Post date: [April 15, 2020, 3:41pm UTC](https://community.openconversational.ai/t/mimic2-custom-training-produces-horizontal-high-line-line-in-alignment-graph/8459/6 "2020-04-15T15:41:34Z")

</div>

Thanks for your reply.

400k training steps sounds like a lot of invested compute time.

I’m currently running a training using original tacotron1 implementation ([GitHub - keithito/tacotron: A TensorFlow implementation of Google's Tacotron speech synthesis with pre-trained model (unofficial)](https://github.com/keithito/tacotron)) with tensorflow 1.6 instead of mimic2 implementation and tensorflow 1.8 on the same ljspeech dataset.  
The results and alignments seems (much) better.

Could be interesting to check the reason for the different results is a code change in mimic2 or use of tensorflow 1.6 instead of 1.8?

Here are some sample outputs from mimic2 vs. tacotron1 training.

[Sample WAVs](https://drive.google.com/open?id=1SHzlO3vBQl0ORdovkSBmWGdmzshNrIl3)

# Mimic2 alignment graphs

## alignment 35k and 50k steps

 ![mimic2-step-50000-align](https://community.openconversational.ai/uploads/default/original/2X/3/3ae75bd3c810418aa5d97fe248006f5747e99527.png) ![mimic2-step-35000-align](https://community.openconversational.ai/uploads/default/original/2X/2/24b3e1f2f841914475370e7a6356c923a4226543.png)

# Tacotron Version 1 (Keithio) graphs

## alignment 35k and 50k steps

 ![keithito-step-50000-align](https://community.openconversational.ai/uploads/default/original/2X/6/62b9b24b0a6f225f28116260e2febf070b9a257b.png) ![keithito-step-35000-align](https://community.openconversational.ai/uploads/default/original/2X/0/0217e24d5e69b311a475c02b41567ee6cb883346.png)

## Tensorboard (at 50k steps)

 ![keithito-tensorboard-03-50k](https://community.openconversational.ai/uploads/default/original/2X/0/08581979b2c2caa644d7c599d11cf146eebc0c45.png) ![keithito-tensorboard-02-50k](https://community.openconversational.ai/uploads/default/original/2X/9/90ed52aac68bfca091082670303a7efb84a0aa0e.png) ![keithito-tensorboard-01-50k](https://community.openconversational.ai/uploads/default/original/2X/5/557c0fdb230eed6bee872e76de4a8dafe7668701.png)

---

<div class="post-metadata">

### Author: ![baconator](https://community.openconversational.ai/letter_avatar_proxy/v4/letter/b/d07c76/32.png) [@baconator](https://community.openconversational.ai/u/baconator)
#### Post date: [April 15, 2020, 6:59pm UTC](https://community.openconversational.ai/t/mimic2-custom-training-produces-horizontal-high-line-line-in-alignment-graph/8459/7 "2020-04-15T18:59:24Z")

</div>

This replicates what I experienced as well.

---

<div class="post-metadata">

### Author: ![Thorsten](https://community.openconversational.ai/user_avatar/community.openconversational.ai/thorsten/32/4539_2.png) [@Thorsten](https://community.openconversational.ai/u/Thorsten)
#### Post date: [April 15, 2020, 7:01pm UTC](https://community.openconversational.ai/t/mimic2-custom-training-produces-horizontal-high-line-line-in-alignment-graph/8459/8 "2020-04-15T19:01:21Z")

</div>

So you tried tacotron1 too, instead of mimic2 fork?

---

<div class="post-metadata">

### Author: ![baconator](https://community.openconversational.ai/letter_avatar_proxy/v4/letter/b/d07c76/32.png) [@baconator](https://community.openconversational.ai/u/baconator)
#### Post date: [April 15, 2020, 7:20pm UTC](https://community.openconversational.ai/t/mimic2-custom-training-produces-horizontal-high-line-line-in-alignment-graph/8459/9 "2020-04-15T19:20:15Z")

</div>

Yes. This was how I built the first model I used for my local TTS, and it sounded pretty good.

---

<div class="post-metadata">

### Author: ![Thorsten](https://community.openconversational.ai/user_avatar/community.openconversational.ai/thorsten/32/4539_2.png) [@Thorsten](https://community.openconversational.ai/u/Thorsten)
#### Post date: [April 15, 2020, 8:23pm UTC](https://community.openconversational.ai/t/mimic2-custom-training-produces-horizontal-high-line-line-in-alignment-graph/8459/10 "2020-04-15T20:23:25Z")

</div>

Was this your 400k training or to how many steps did you train your model till being good enough for every day usage?

---

<div class="post-metadata">

### Author: ![baconator](https://community.openconversational.ai/letter_avatar_proxy/v4/letter/b/d07c76/32.png) [@baconator](https://community.openconversational.ai/u/baconator)
#### Post date: [April 15, 2020, 8:49pm UTC](https://community.openconversational.ai/t/mimic2-custom-training-produces-horizontal-high-line-line-in-alignment-graph/8459/11 "2020-04-15T20:49:38Z")

</div>

I did 400k a couple of times on each. The model I ended up using was about 350k on tacotron (1). None of the current mimic 2 models ever well worked for me, there’s a previous commit before the attention stuff was added that worked closer to tacotron.

I’ve been waffling about trying a moz tts t2 modeling run with another dataset, but haven’t gotten the time to get it set to go quite yet.
