How convert UTF-16 string to UTF-8 or OEMCP code

[bomz]

Hi to all! How convert UTF-16 string to UTF-8 or OEMCP code (FindNextFileW)?

[zedd151]

Hi to all! How convert UTF-16 string to UTF-8 or OEMCP code (FindNextFileW)?

Hi bomz. I had asked that your post be made into its own topic, where you might get a better response than posting your question to an unrelated existing topic.

I myself do not have an answer for you, as I work solely with ascii, 99.9 percent of the time.

[NoCforMe]

[deleted]

[bomz]

problem occurred when downloading video files from YouTube, windows can't reflect files name, but can address files - delete,move, copy, rename, back rename. where is no method how do it in console, only use mass method with musk *.mp4

[tenkey]

For UTF-8, you could try WideCharToMultiByte.

[zedd151]

problem occurred when downloading video files from YouTube, windows can't reflect files namess method with musk *.mp4

Did this just start recently, or has it always been this way? I am just curious.

[NoCforMe]

[deleted]

[sinsi]

If the 16-bit text is anything like Unicode, which I suspect it is, you can simply do the "read a word, write a byte" method:

Code Select Expand

; Assuming ECX points to your UTF-16 string,
; and EDX points to where you want to store the ASCII:

next: MOV AX, [ECX] ;Read a WORD.
MOV [EDX], AL ;Write a BYTE.
TEST AX, AX ;If it's a zero,
JZ done ;  that's the end.
ADD ECX, 2 ;Advance your pointers.
INC EDX
JMP next

done:

You don't have to use those registers; I just wrote the code that one way.
But you get the idea.

That is so wrong it's giving me double vision
Try it on real unicode, like some chinese text.

[NoCforMe]

Well, if that won't work, you'll need to use some kind of translation table to convert UTF-16, right?

[zedd151]

If the 16-bit text is anything like Unicode, which I suspect it is, you can simply do the "read a word, write a byte" method:

Code Select Expand

; Assuming ECX points to your UTF-16 string,
; and EDX points to where you want to store the ASCII:

next: MOV AX, [ECX] ;Read a WORD.
MOV [EDX], AL ;Write a BYTE.
TEST AX, AX ;If it's a zero,
JZ done ;  that's the end.
ADD ECX, 2 ;Advance your pointers.
INC EDX
JMP next

done:

You don't have to use those registers; I just wrote the code that one way.
But you get the idea.

That is so wrong it's giving me double vision
Try it on real unicode, like some chinese text.

Looks like unicode->ascii conversion code.

[sinsi]

Zài zhēnzhèng de unicode shàng chángshì yīxià, lìrú yīxiē zhōngwén wénzì.

Code Select Expand

5A C3 A0 69 20 7A 68 C4 93 6E 7A 68 C3 A8 6E 67 20 64 65 20 75 6E 69 63 6F 64 65 20 73 68 C3 A0
6E 67 20 63 68 C3 A1 6E 67 73 68 C3 AC 20 79 C4 AB 78 69 C3 A0 2C 20 6C C3 AC 72 C3 BA 20 79 C4
AB 78 69 C4 93 20 7A 68 C5 8D 6E 67 77 C3 A9 6E 20 77 C3 A9 6E 7A C3 AC 2ETake every second byte away and you're still left with gibberish

Well, if that won't work, you'll need to use some kind of translation table to convert UTF-16, right?

For UTF-8, you could try WideCharToMultiByte.

Even WideCharToMultiByte isn't guaranteed to convert properly, or convert to an ANSI string (as the ToMultiByte part infers).

[NoCforMe]

So how does that stuff get translated to ASCII? or can it even be?

[bomz]

Converting Between Unicode UTF-16 and UTF-8 Using ATL CString and Direct Win32 API Calls
I try repeat, but something wrong. In the same time I have UTF-8 to OEMCP working code

[jj2007]

That is so wrong it's giving me double vision
Try it on real unicode, like some chinese text.

Indeed. All file names are stored internally as Utf-16. You either use them "as is" in Utf-16, or you convert them for display purposes to Utf-8.

For UTF-8, you could try WideCharToMultiByte.

Exactly.

[bomz]

perhaps I am wrong to use console streams?