[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Octave-bug-tracker] [bug #53683] numerical output format for float valu
From: |
Dan Sebald |
Subject: |
[Octave-bug-tracker] [bug #53683] numerical output format for float values with magnitude greater than precision is wrong |
Date: |
Thu, 19 Apr 2018 16:13:32 -0400 (EDT) |
User-agent: |
Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:55.0) Gecko/20100101 Firefox/55.0 |
Follow-up Comment #6, bug #53683 (project octave):
Well, I'd say that current behavior is wrong, no matter the interpretation.
I'm not a real stickler for exact compatibility, but the issue here is that
Matlab appears to be saying nothing about "precision" or (what Octave states
in the documentation) "with 5 significant figures". To me, "significant
figures" can only be interpreted as precision, and Octave is sort of doing
that in the first half of the progression below. Anyway, Matlab just says "4
digits after the decimal point". Perhaps once that no longer makes reasonable
sense, then it switches to exponent notation.
_______________________________________________________
Reply to this item at:
<http://savannah.gnu.org/bugs/?53683>
_______________________________________________
Message sent via/by Savannah
http://savannah.gnu.org/
- [Octave-bug-tracker] [bug #53683] numerical output format for float values with magnitude greater than precision is wrong, Dan Sebald, 2018/04/17
- [Octave-bug-tracker] [bug #53683] numerical output format for float values with magnitude greater than precision is wrong, Dan Sebald, 2018/04/17
- [Octave-bug-tracker] [bug #53683] numerical output format for float values with magnitude greater than precision is wrong, Mike Miller, 2018/04/17
- [Octave-bug-tracker] [bug #53683] numerical output format for float values with magnitude greater than precision is wrong, Dan Sebald, 2018/04/17
- [Octave-bug-tracker] [bug #53683] numerical output format for float values with magnitude greater than precision is wrong, Nicholas Jankowski, 2018/04/18
- [Octave-bug-tracker] [bug #53683] numerical output format for float values with magnitude greater than precision is wrong, John W. Eaton, 2018/04/19
- [Octave-bug-tracker] [bug #53683] numerical output format for float values with magnitude greater than precision is wrong,
Dan Sebald <=
- [Octave-bug-tracker] [bug #53683] numerical output format for float values with magnitude greater than precision is wrong, John W. Eaton, 2018/04/19
- [Octave-bug-tracker] [bug #53683] numerical output format for float values with magnitude greater than precision is wrong, John W. Eaton, 2018/04/19
- [Octave-bug-tracker] [bug #53683] numerical output format for float values with magnitude greater than precision is wrong, Dan Sebald, 2018/04/20