diff --git a/README.md b/README.md index 6c62495..b81adb9 100644 --- a/README.md +++ b/README.md @@ -6,7 +6,7 @@
-
+
## 👉🏻 IndexTTS 👈🏻
@@ -39,131 +39,32 @@ The main improvements and contributions are summarized as follows:
## 📑 Evaluation
-**Word Error Rate (WER) and Speaker Similarity (SS) Results for IndexTTS and Baseline Models**
+**Word Error Rate (WER) Results for IndexTTS and Baseline Models**
+
+
+| **Model** | **aishell1_test** | **commonvoice_20_test_zh** | **commonvoice_20_test_en** | **librispeech_test_clean** | **avg** |
+|:---------------:|:-----------------:|:--------------------------:|:--------------------------:|:--------------------------:|:--------:|
+| **Human** | 2.0 | 9.5 | 10.0 | 2.4 | 5.1 |
+| **CosyVoice 2** | 1.8 | 9.1 | 7.3 | 4.9 | 5.9 |
+| **F5TTS** | 3.9 | 11.7 | 5.4 | 7.8 | 8.2 |
+| **Fishspeech** | 2.4 | 11.4 | 8.8 | 8.0 | 8.3 |
+| **FireRedTTS** | 2.2 | 11.0 | 16.3 | 5.7 | 7.7 |
+| **XTTS** | 3.0 | 11.4 | 7.1 | 3.5 | 6.0 |
+| **IndexTTS** | **1.3** | **7.0** | **5.3** | **2.1** | **3.7** |
+
+
+**Speaker Similarity (SS) Results for IndexTTS and Baseline Models**
+
+| **Model** | **aishell1_test** | **commonvoice_20_test_zh** | **commonvoice_20_test_en** | **librispeech_test_clean** | **avg** |
+|:---------------:|:-----------------:|:--------------------------:|:--------------------------:|:--------------------------:|:---------:|
+| **Human** | 0.846 | 0.809 | 0.820 | 0.858 | 0.836 |
+| **CosyVoice 2** | **0.796** | 0.743 | 0.742 | **0.837** | **0.788** |
+| **F5TTS** | 0.743 | **0.747** | 0.746 | 0.828 | 0.779 |
+| **Fishspeech** | 0.488 | 0.552 | 0.622 | 0.701 | 0.612 |
+| **FireRedTTS** | 0.579 | 0.593 | 0.587 | 0.698 | 0.631 |
+| **XTTS** | 0.573 | 0.586 | 0.648 | 0.761 | 0.663 |
+| **IndexTTS** | 0.744 | 0.742 | **0.758** | 0.823 | 0.776 |
-
-
| Model | -aishell1_test | -commonvoice_20_test_zh | -commonvoice_20_test_en | -librispeech_test_clean | -avg | -|||||
|---|---|---|---|---|---|---|---|---|---|---|
| CER(%)↓ | -SS↑ | -CER(%)↓ | -SS↑ | -WER(%)↓ | -SS↑ | -WER(%)↓ | -SS↑ | -CER(%)↓ | -SS↑ | -|
| Human | -2.0 | -0.846 | -9.5 | -0.809 | -10.0 | -0.820 | -2.4 | -0.858 | -5.1 | -0.836 | -
| CosyVoice 2 | -1.8 | -0.796 | -9.1 | -0.743 | -7.3 | -0.742 | -4.9 | -0.837 | -5.9 | -0.788 | -
| F5TTS | -3.9 | -0.743 | -11.7 | -0.747 | -5.4 | -0.746 | -7.8 | -0.828 | -8.2 | -0.779 | -
| Fishspeech | -2.4 | -0.488 | -11.4 | -0.552 | -8.8 | -0.622 | -8.0 | -0.701 | -8.3 | -0.612 | -
| FireRedTTS | -2.2 | -0.579 | -11.0 | -0.593 | -16.3 | -0.587 | -5.7 | -0.698 | -7.7 | -0.631 | -
| XTTS | -3.0 | -0.573 | -11.4 | -0.586 | -7.1 | -0.648 | -3.5 | -0.761 | -6.0 | -0.663 | -
| IndexTTS | -1.3 | -0.744 | -7.0 | -0.742 | -5.3 | -0.753 | -2.1 | -0.823 | -3.7 | -0.776 | -