Unicode 5.2 support

[Olly Betts]

Unicode 5.2 is expected to be out in "Summer 2009" - if that happens before we release 1.2.0, we should probably update our Unicode tables to use it. This will mean minor incompatibilities in fairly obscure cases in term parsing somewhere between 1.1.0 and 1.2.0, but I think that's acceptable (and I will update the development series "rules" to mention this).

I don't believe this is worth delaying 1.2.0 for though (unless it's just by a few days). If Unicode 5.2 isn't out, we just release it anyway and this change can happen in 1.3.x.

[Olly Betts]

Triaging milestone:1.1.1 bugs.

[Olly Betts]

Unicode 5.2.0 is now in public beta with a release aim of October 2009.

If it's released before we're ready for 1.2.0, then it should go in. Otherwise this can wait for the next release cycle.

[Olly Betts]

Just tested converting the character data from the beta - specifically:

​http://www.unicode.org/Public/5.2.0/ucd/UnicodeData-5.2.0d10.txt

The converter handled it fine, and the testsuite passes. So it looks like we're ready for this once it is actually released.

[Olly Betts]

Bumping ticket to keep on track. We want to release well before they're currently aiming to have this ready anyway. If it were to be released sooner, then I've checked the conversion script handles the new data, so we would just need to drop that in, and add some testcases to cover the changes in Unicode 5.2.

Also, marking as "enhancement" rather than "defect".

[Olly Betts]

Unicode 5.2 was released on 2009-10-01. It's a safe and easy change, so marking for 1.1.3.

[Olly Betts]

Committed to trunk r13544.