[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #53166] format long displays 15 significant di

From: Michael Leitner
Subject: [Octave-bug-tracker] [bug #53166] format long displays 15 significant digits, rather than 15 digits after decimal point (Matlab Compatibility)
Date: Fri, 16 Feb 2018 04:49:42 -0500 (EST)
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Firefox/52.0

Follow-up Comment #4, bug #53166 (project octave):

I'm sorry, probably I just let myself be bitten by this floating-point
business. Probably 0.9 has a floating-point representation that it just a bit
larger than 0.9 and thus gives rises to this seemingly incorrect rounding. But
the rest of my comment of course stands.


Reply to this item at:


  Message sent via/by Savannah

reply via email to

[Prev in Thread] Current Thread [Next in Thread]