Repository navigation
Fix for UTF-8 problems with the ascii printer. - #661
Conversation
Characters need to be in the ascii range, otherwise invalid UTF-8 data can (and is) written. So anything outside the 32-126 range is output as hexadecimal number. Signed-off-by: Hans Dijkema <hans@dijkewijk.nl>
|
I did those minor changes:
|
|
Hi AlbertShown, The problem with 0xCF in a UTF-8 context is that it is a marker for a multi byte sequence. For the sake of documentation: In UTF-8, multi-byte sequences are introduced by leading bytes that start with a specific pattern Leading bytes (head bytes):
So CF indicates a 2-byte sequence. It might be better to do something else, e.g. a ~ (126) or a tab (9). |
|
I see, I agree with you. I suggest we simply remove |
|
Fixed in 3093057. |
Characters need to be in the ascii range, otherwise invalid UTF-8 data can (and is) written.
So anything outside the 32-126 range is output as hexadecimal number.