hi Tomasz you ask about the rounding in ruby. but why can we not just let the cpu's do that? This is a big problem with Java. We do not want to repeat that. It is not the job of the language to care of every bit of the floats. I believe that x86 and arm now pretty much agree on ieee 754 It is not the job of the language to intervene with that. In the end, the differences will only show up in the least significant digit. It is quite important to have repducible results. But if an algorithm is that bad, that it would diverge badly? I actually opt for it, to compute with different roundings. On Sun, Jun 25, 2023 at 11:39 PM Tomasz Smykowski via ruby-talk <ruby-talk@ml.ruby-lang.org> wrote:
Hey,
I was browsing December commit history and found a fix for round to even function being commited for special cases.
In the unit tests there were a few new tests added. One of them looks like this:
assert_equal(767573.18759, 767573.1875850001.round(5, half: :even))
Shouldn't the function round to ...8 in this case? It struck me it does not end with an even digit, but an odd one.
There are two or free unit tests that also end with odd digit.
Commit: https://github.com/ruby/ruby/commit/9f2378959e5c5b5c39c9993f1a84e5304ff113d6...
Tests: https://github.com/ruby/ruby/blob/ed587abffb48da991c33d232fd151683458938a9/t...
Cheers, Tom Smykowski ______________________________________________ ruby-talk mailing list -- ruby-talk@ml.ruby-lang.org To unsubscribe send an email to ruby-talk-leave@ml.ruby-lang.org ruby-talk info -- https://ml.ruby-lang.org/mailman3/postorius/lists/ruby-talk.ml.ruby-lang.org...