Cloyir/index-tts2-ForDgxSpark
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs: Add FP16 usage advice for faster inference

Browse Source
This commit is contained in:
Arcitec 2025-09-11 07:06:25 +02:00 committed by nanaoto
parent 8336824c71
commit d777b8a029
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
README.md
View File

@ -264,7 +264,10 @@ uv run webui.py -h
Have fun!
> [!IMPORTANT]
> **DeepSpeed** *may* speed up inference on some systems, but it could also
> It can be very helpful to use **FP16** (half-precision) inference. It is faster
> and uses less VRAM, with a very small quality loss.
>
> **DeepSpeed** *may* also speed up inference on some systems, but it could also
> make it slower. The performance impact is highly dependent on your specific
> hardware, drivers and operating system. Please try with and without it,
> to discover what works best on your personal system.