- Introduced `de_tokenized_by_CJK_char` for restoring original text from tokenized format.
- Added `TextTokenizer` class for improved tokenization, including sentence splitting and handling of special tokens.
- Enhanced `TextNormalizer` to handle names and pinyin tones with placeholder mechanisms.
- Added regression tests for new features in `regression_test.py`.
* Update Pinyin tone handling in TextNormalizer
* Enhance sentence splitting and improve tokenizer integration in inference
* Update character replacement mappings
test: "在电影《肖申克的救赎》中,安迪·杜佛兰被错误地判处终身监禁..."
* Refactor TextNormalizer and enhance testing with additional cases