[Feature] UTF-16 LE/BE and Chinese Character Encoding Issues Without TBL File

[Moxueliang]

What feature would you like to see?

I am experiencing difficulties with encoding Chinese characters using UTF-16 LE and UTF-16 BE without a TBL (table) file. Specifically, when I attempt to import data following UTF-8 encoding rules, it does not work as expected.

Steps to Reproduce
Attempt to encode Chinese characters using UTF-16 LE or UTF-16 BE.
Ensure no TBL file is used in the process.
Follow the UTF-8 encoding rules for import.
Expected Behavior
The Chinese characters should be correctly encoded and imported without issues, even in the absence of a TBL file.

How will this feature be useful to you and others?

Any guidance or documentation on properly handling Chinese character encoding with UTF-16 LE/BE without relying on a TBL file would be greatly appreciated. If there are any specific steps or tools required to achieve this, please advise.

Thank you for your assistance!
utf16.zip

Request Type

• I can provide a PoC for this feature or am willing to work on it myself and submit a PR

Additional context?

No response