[Python-Dev] Decoding incomplete unicode

Walter Dörwald walter at livinglogic.de
Mon Aug 23 22:41:55 CEST 2004


Martin v. Löwis wrote:

> Walter Dörwald wrote:
> 
>> Both approaches have one problem: Error handling won't
>> work for them. If the error handling is "replace", the decoder
>> should return U+FFFD for the final trailing incomplete sequence
>> in read(). This won't happen when read() never reads those
>> bytes from the input stream.
> 
> Ok. So it really looks like a final flag on read is necessary.
> 
>> Well, I had to choose a subject. ;)
> 
> I still would prefer if the two issues were discussed separately.

OK, let's come up with a patch that fixes the incomplete byte
sequences problem and then discuss non-stream APIs.

So, what should the next step be?

Bye,
    Walter Dörwald




More information about the Python-Dev mailing list

Follow Lee on X/Twitter - Father, Husband, Serial builder creating AI, crypto, games & web tools. We are friends :) AI Will Come To Life!

Check out: eBank.nz (Art Generator) | Netwrck.com (AI Tools) | Text-Generator.io (AI API) | BitBank.nz (Crypto AI) | ReadingTime (Kids Reading) | RewordGame | BigMultiplayerChess | WebFiddle | How.nz | Helix AI Assistant