[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #53683] numerical output format for float valu

From: Dan Sebald
Subject: [Octave-bug-tracker] [bug #53683] numerical output format for float values with magnitude greater than precision is wrong
Date: Thu, 19 Apr 2018 16:13:32 -0400 (EDT)
User-agent: Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:55.0) Gecko/20100101 Firefox/55.0

Follow-up Comment #6, bug #53683 (project octave):

Well, I'd say that current behavior is wrong, no matter the interpretation. 
I'm not a real stickler for exact compatibility, but the issue here is that
Matlab appears to be saying nothing about "precision" or (what Octave states
in the documentation) "with 5 significant figures".  To me, "significant
figures" can only be interpreted as precision, and Octave is sort of doing
that in the first half of the progression below.  Anyway, Matlab just says "4
digits after the decimal point".  Perhaps once that no longer makes reasonable
sense, then it switches to exponent notation.


Reply to this item at:


  Message sent via/by Savannah

reply via email to

[Prev in Thread] Current Thread [Next in Thread]