Empty regexp replaceall and surrogate pairs results in corrupted utf16. (original) (raw)

Dawid Weiss dawid.weiss at gmail.com
Thu Jun 7 20:07:07 UTC 2012

Hi, I'm a committer to the Apache Lucene project. We have randomized tests and one seed hit the following (simplified) scenario:

String s1 = "AB\uD840\uDC00C"; String s2 = s1.replaceAll("", "X");

the input contains an extended unicode character (any surrogate pair will do). The pattern is an empty string (in fact, it was randomized as "]|" but it's the same problem so I omit the details). The problem is that after applying this pattern, replaceAll inserts X in between the surrogate pair characters and this results in invalid UTF-16:

AB��C XAXBX?X?XCX

I believe this is a bug in the regexp implementation (sorry, don't have a patch for it) but I'd like to confirm it's not something known. Pointers appreciated.

Dawid

More information about the core-libs-dev mailing list