[ruby-core:114669] [Ruby master Bug#19869] Mark skipped test somehow

Issue #19869 has been reported by vo.x (Vit Ondruch). ---------------------------------------- Bug #19869: Mark skipped test somehow https://bugs.ruby-lang.org/issues/19869 * Author: vo.x (Vit Ondruch) * Status: Open * Priority: Normal * ruby -v: ruby 3.3.0dev (2023-09-05 master 7c8932365f) [x86_64-linux] * Backport: 3.0: UNKNOWN, 3.1: UNKNOWN, 3.2: UNKNOWN ---------------------------------------- When Minitest was used to execute the Ruby test suite, skipped test were cleanly marked, e.g.: ~~~ [14036/25715] TestGemExtCmakeBuilder#test_self_build_has_makefile = s ~~~ However, with the test-unit the output is: ~~~ [14036/25715] TestGemExtCmakeBuilder#test_self_build_has_makefile = 0.01 s ~~~ This is problematic, because running test suite, I can see that some test were skipped: ~~~ 25705 tests, 6108213 assertions, 0 failures, 0 errors, 99 skips ~~~ But I can't tell which. Is there a chance to fix this? -- https://bugs.ruby-lang.org/

Issue #19869 has been updated by vo.x (Vit Ondruch). Ok, adding `TESTS="--show-skip"` makes the difference. Such tests are reported at the end of the run of test suite, e.g.: ~~~ 70) Skipped: TestGemExtCmakeBuilder#test_self_build_fail [/builddir/build/BUILD/ruby-3.3.0-7c8932365f/test/rubygems/test_gem_ext_cmake_builder.rb:19]: ~~~ That is nice, but I wonder why is it not default? As I can see, this is enabled just for [MinGW](https://github.com/ruby/ruby/blob/8807b0dc96cbb0d0b72cddae2f41dd163589b7cc/....). Please note that I cannot enable this option via `$TESTOPTS`, which would be probably the right way, because runnint `make check`, this is then feed to [bootstrap runner](https://github.com/ruby/ruby/blob/master/bootstraptest/runner.rb), which does not handle this option :/ ---------------------------------------- Bug #19869: Mark skipped test somehow https://bugs.ruby-lang.org/issues/19869#change-104499 * Author: vo.x (Vit Ondruch) * Status: Open * Priority: Normal * ruby -v: ruby 3.3.0dev (2023-09-05 master 7c8932365f) [x86_64-linux] * Backport: 3.0: UNKNOWN, 3.1: UNKNOWN, 3.2: UNKNOWN ---------------------------------------- When Minitest was used to execute the Ruby test suite, skipped test were cleanly marked, e.g.: ~~~ [14036/25715] TestGemExtCmakeBuilder#test_self_build_has_makefile = s ~~~ However, with the test-unit the output is: ~~~ [14036/25715] TestGemExtCmakeBuilder#test_self_build_has_makefile = 0.01 s ~~~ This is problematic, because running test suite, I can see that some test were skipped: ~~~ 25705 tests, 6108213 assertions, 0 failures, 0 errors, 99 skips ~~~ But I can't tell which. Is there a chance to fix this? -- https://bugs.ruby-lang.org/
participants (1)
-
vo.x (Vit Ondruch)