Accent problem

[amphiprion]

Hi papillon,

there is a trouble to exchange accent (i.e. é, è, ô ...) between NWN and Database (or simply NWN and NWNX)

If i do SetCustomToken(100, "télévision"); and in a conversation <CUSTOM100> it work fine

but if i have in a mysql field the same text (télévision), then
SetCustomToken(100, SQLGetData(1));

in the dialog i will have square characters (t□l□vision)

It's not a mysql problem, because i can see correctly data with a database client (character set, West european)

[yi]

I do have the same issue
_________________
http://www.arkalym.com

[amphiprion]

Any clue to fix the bug, papillon ?

[Papillon]

I haven't looked into that, yet.
_________________
Papillon

[Papillon]

Could you please try to write the data to the log file ? This is what I got in my test:

[amphiprion]

Exact, if i trace the SQLGetData in the log file it work fine

so :

1) SetCustomToken(100, "télévision"); work fine
2) WriteTimestampToLog(SQLGetData(1)); work fine (in mysql field 1 there is "télévision")
3) SetCustomToken(100, SQLGetData(1)); BUG

if someone have an idea to avoid this problem

[Grinning Fool]

It sounds like the problem may be with the game itself, in that perhaps it can't display that character?
_________________
Khalidine, a NWN2 persistent world

Looking for volunteers.

[Papillon]

Or there is some character conversion going on silently... but I wouldn't know where to look, currently.
_________________
Papillon

[Gryphyn]

[amphiprion]

i use Latin1 character set

this evening i will make some test with different MySQL character set

[amphiprion]

So, i have made many test with different character set (Latin1, Latin2,...Latin7, UTF8, and many others)
but none can display correcly the accent character in nwn2

[Papillon]

I'll conduct some more tests on the weekend.
_________________
Papillon

[amphiprion]

Hi,

Any new idea about this problem ?

[xaltos]

I think this is a Unicode / ASCII code problem

The scripts are stored in Unicode !
So your êèé are coded with two or more bytes.

Some of the functions do an automatically convert for the strings.
e.g. if you call a Standard Windows DLL from a .Net program will it convert all the Unicode character in normal ASCII character.

You can do an easy test , to confirm this theory.

do a
WriteTimestampToLog(SQLGetData(1));
and a
WriteTimestampToLog("télévision");

and open the log file with an Hex editor.

I think you will see that the first entry is a ASCII and the second one a Unicode text.
_________________
xaltos

NWN2_Audolo

[amphiprion]

i've already do this test, and the accents appear correctly in the log file (méthod 1 znd 2), but not at screen (SendMessageToPC, ...)