Issue #13571 has been updated by jeremyevans0 (Jeremy Evans). Status changed from Open to Closed Starting in Ruby 3.0, arguments provided to Ruby (in `ARGV`) are now in correct UTF-8 encoding. ---------------------------------------- Bug #13571: Script arguments, encoding, windows / MinGW https://bugs.ruby-lang.org/issues/13571#change-104237 * Author: MSP-Greg (Greg L) * Status: Closed * Priority: Normal * ruby -v: ruby 2.5.0dev (2017-05-17 trunk 58774) [x64-mingw32] * Backport: 2.2: UNKNOWN, 2.3: UNKNOWN, 2.4: UNKNOWN ---------------------------------------- The following is windows/MinGW specific. I have been patching around a failure in [TestRubyOptions#test_command_line_progname_nonascii](https://github.com/ruby/ruby/blob/trunk/test/ruby/test_rubyoptions.rb#L742-L...) for a while, and decided to investigate further, assuming it was a simple issue. The following code - ```ruby # set dir to valid directory dir = "E:/temp" fn_1 = 'äÖü.rb' fn_2 = 'テスト.rb' puts puts "ENV['RUBYOPT'] #{ENV['RUBYOPT']}" \ "\nfilesystem #{Encoding.find('filesystem')}" \ "\nexternal #{Encoding.default_external}" \ "\n`chcp` #{`chcp`}" \ "locale #{Encoding.find('locale')}" \ "\n__ENCODING__ #{__ENCODING__}" \ "\ninternal #{Encoding.default_internal}\n" \ "\nfn_1 #{fn_1.encoding.to_s}" \ "\näÖü.rb #{'äÖü.rb'.encoding.to_s}" \ "\nfn_2 #{fn_2.encoding.to_s}" \ "\nテスト.rb #{'テスト.rb'.encoding.to_s}" Dir.chdir(dir) do |dir| open(fn_1, "w") { |f| f.puts "puts File.basename($0)" } open(fn_2, "w") { |f| f.puts "puts File.basename($0)" } puts puts "File.exist?(fn_1) #{File.exist?(fn_1)}" puts "File.exist?(fn_2) #{File.exist?(fn_2)}" puts puts `ruby #{fn_1}` puts `ruby #{fn_2}` end ``` produces the following output - ``` ENV['RUBYOPT'] filesystem Windows-1252 external IBM437 `chcp` Active code page: 437 locale IBM437 __ENCODING__ UTF-8 internal fn_1 UTF-8 äÖü.rb UTF-8 fn_2 UTF-8 テスト.rb UTF-8 File.exist?(fn_1) true File.exist?(fn_2) true äÖü.rb: No such file or directory @ realpath_rec - E:/temp/„™�.rb (Errno::ENOENT) ruby: Invalid argument -- ???.rb (LoadError) ``` Of note is that both files are created (and appear correctly in Explorer), but neither can be used as a script argument. Copy and pasting the names (from Explorer) on the command line produces the following similar output - ``` E:\temp>ruby äÖü.rb äÖü.rb: No such file or directory @ realpath_rec - E:/temp/„™�.rb (Errno::ENOENT) E:\temp>ruby テスト.rb ruby: Invalid argument -- ???.rb (LoadError) ``` Lastly, if before running the code I do a `chcp 1252` command to match up 'locale' and 'filesystem', the first script file runs and produces the correct output. Hence, it appears that some (or all?) `File` methods deal properly with `filesystem` encoding, but ruby script arguments are not correctly encoded. -- https://bugs.ruby-lang.org/