On Mar 23, 2014, at 5:11 AM, Markus Sabadello <> wrote:
Finally, we talked about Unicode and how the differences between UTF-8 and UTF-16 may affect ordering and therefore signatures. Joseph explained that Java internally uses UTF-16, whereas XDI serializations require UTF-8 encoding.
Markus will review the relevant XDI2 code sections to see if this is an issue. In Java, the popular ICU4j library may be needed to produce correct results.
I think it is enough to alter the comparison of the top digit of two code units so that D > E, D > F:
| 0-C D EF
0-C| = < <
D | > = >
EF | > < =
This procedure gives a result for unpaired surrogates rather than throwing an error, but screening out unpaired surrogates is a separate issue.
