Allow interpuncts in phrases

[groverlynn]

Pull request

Issue tracker

Fixes will automatically close the related issue

Fixes #

Feature

Allow certain interpuncts in phrases in dictionaries. Essay already has some of them in the entries but disabled for now.
This allows easier input of transliterated names (e.g. 尚－雅克‧盧梭 or 让‐雅克·卢梭, with the same code as 尚雅克盧梭 or 让雅克卢梭), disambiguation names (刚果（金）, with the same code as 刚果金), and poem verses (e.g. 鵝，鵝，鵝，曲項向天歌, with the same code as 鵝鵝鵝曲項向天歌)

Setting in dictionary: encoder/free_puncts
The value is one single string containing all of the intended free punctuations (can include any characters, not necessarily punctuations).
The default value is ·‧‐－，（） (U+00B7 middle dot, U+2027 hyphenation point, U+2010 hyphen, U+FF0D fullwidth hyphen-minus, U+FF0C fullwidth comma, U+FF08 fullwidth left parenthesis, U+FF09 fullwidth right parenthesis). Use the default free puncts, set encoder/free_puncts to "default" or "preset". To opt-out, set the value to an empty string ("")

Unit test

• Done

Manual test

• Done

Code Review

1. Unit and manual test pass
2. GitHub Action CI pass
3. At least one contributor reviews and votes
4. Can be merged clean without conflicts
5. PR will be merged by rebase upstream base

Additional Info

[lotem]

This feature should not be added as a hidden behaviour. There are input schemas which do encode symbols.

Consider creating a separate tool for editing code in the yaml dictionary.
Then the Rime deployer do not need to handle these cases.

[groverlynn]

This feature should not be added as a hidden behaviour. There are input schemas which do encode symbols.

Consider creating a separate tool for editing code in the yaml dictionary. Then the Rime deployer do not need to handle these cases.

just revised as you suggested