Issue #20959 has been updated by YO4 (Yoshinao Muramatsu). When I filed #20959, I had #20929 in mind. Since Windows APIs return time zone names localized based on the user's language settings rather than the system's language settings, it was important to retrieve them using a language-independent encoding. That issue has been resolved in a different form by #21144. While `setlocale(LC_CTYPE, “.utf8”)` seems like the desired direction, its necessity for me has decreased at this point. On the other hand, cmd.exe's internal commands and PowerShell in its default state use the console's code page. That is, the following idioms may exist: ``` dir | ruby -e “puts STDIN.read.force_encoding('locale')” ``` This will become an obstacle when changing `encoding('locale')` in the future. This is why we need `Encoding.find('console')` right now. Depending on the pipe's counterpart, `Encoding.default_external` may be preferable in some cases, so both options are important. On Windows, the C runtime locale for each process is currently inconsistent, so changing the locale encoding for this purpose does not seem useful at present. Regarding OEMCP, in environments where it is a factor, the console code page should be OEMCP. So it may not need to be considered. In Windows, "C" locale seems to use ACP in default. Of course, programs that use mbcs also utilize ACP. Therefore, ACP appears to be in demand. If there were a gem or ffi to obtain ACP, it might become clear. ---------------------------------------- Feature #20959: Add a way to get codepage of console. https://bugs.ruby-lang.org/issues/20959#change-115613 * Author: YO4 (Yoshinao Muramatsu) * Status: Assigned * Assignee: windows ---------------------------------------- # Abstract Add a way to retrieve code pages of console. On Windows, Encoding.find("locale") returns the console codepage. To prepare for future changes, specify ```console``` instead of ```locale``` to get the encoding when a console code page is needed. # Background On Windows, Encoding.find("locale") returns the console codepage. This is different from locale in other environments. Also the name and content do not seem to match. In the future, if we change the locale_encoding of the Windows port to the locale codepage of the C runtime library, we need to get the encoding for the console. Strings received via pipe from cmd.exe or powershell are encoded in the console codepage. This would be necessary when communicating with other programs via pipes. # Proposal Make Encoding.find("console") return the encoding that represents the console codepage. # Background(continued) Since Windows 10, UTF-8 support seems to be enhanced in the commandline environment. * build 17134 ucrt supports UTF-8 locale codepage ```setlocale(LC_CTYPE, ".utf8")``` Windows support UTF-8 ANSI Codepage(experimental) ```Beta: Use Unicode UTF-8 for worldwide language support``` * build 18362 support ```Set a process code page to UTF-8``` via manifest. * build 19041 Time zone name holds in wchar_t internaly, so proper tzname can be obtained regardless of the Windows language setting. This should not be all. Through these, I feel that the Microsoft team recommends the use of utf-8. It also seems that Microsoft, which has previously depricated the ANSI version of the API, is treating it as a valid alternative to use in UTF-8. If it becomes widespread on Windows for libraries to respect the C runtime library locale, ruby would do better to follow it. Of course, it is good to be able to get the encoding of the console by specifying a console. # Future plan By reducing differences from other platforms, bugs and extra code are hoped to be reduced. * Do ```setlocale(LC_CTYPE, ".utf8");``` in main.c (or refer LC_* environment variables). * ```Encoding.find("locale")``` returns C runtime library locale. Since strings obtained from the Windows system have a Unicode code range, the API to obtain fixed UTF-8 encoding remains unchanged. # Discussion The code page we can get from Windows also has ACP and OEMCP, but are these necessary? Is it reasonable to get locale_encoding if Encoding.find("console") is called on other platforms? -- https://bugs.ruby-lang.org/