Message11227

Aha! Python 3 agrees with Java 8:

>>> b'abc\x80\x80\xc1\xc4def'.decode('big5', 'replace')
'abc\ufffd\ufffd\u8b10def'

This will be the result of this change set:
https://hg.python.org/cpython/rev/16cbd84de848
and this issue:
http://bugs.python.org/issue12016
where, in a last-minute change of mind, CPython decided not to back-port the fix to 2.7 and 3.2.

However, nothing in the Python documentation seems to guarantee one or other behaviour. Given we have good reasons for using the Java codec, I'll give us a custom test that is either sensitive to version, or accepts the two.