User talk:Tkubaska
Well, I read Kahan's paper of Mindless Rounding (well, still reading) but I cannot reproduce the Excel errors he shows with Excel 2007 which is the only version I have.
Here's a quote from the paper. Start Quote Excel's HELP files should advise users that its floating-point arithmetic is binary to explain why a value entered as “ 8.04 ”, for example, displays as “ 8.0399 9999 9999 9991 ” when displayed to all of 17 sig. dec. End Quote
It doesn't for me. I see 8.04000000000000000. ????
--ted 17:27, 5 November 2007 (PST)
- Is this about Stop Foolish Rounding? TedErnst | talk 12:15, 7 November 2007 (PST)
Categories:
- get page alerts
-
close
Close Me
