[Python-Dev] PEP 393 Summer of Code Project (original) (raw)

Guido van Rossum guido at python.org
Wed Aug 31 05:35:27 CEST 2011

On Tue, Aug 30, 2011 at 7:55 PM, Stephen J. Turnbull <stephen at xemacs.org> wrote:

Antoine Pitrou writes:

 > Sorry, what is a conformant UTF-16 array op? For starters, one that doesn't ever return lone surrogates, but rather interprets surrogate pairs as Unicode code points as in UTF-16.  (This is not a Unicode standard definition, it's intended to be suggestive of why many app writers will be distressed if they must use Python unicode/str in a narrow build without a fairly comprehensive library that wraps the arrays in operations that treat unicode/str as an array of code points.)

That sounds like a contradiction -- it wouldn't be a UTF-16 array if you couldn't tell that it was using UTF-16.

-- --Guido van Rossum (python.org/~guido)

More information about the Python-Dev mailing list