[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #54562] numel should warn if the resulting dou

From: Rik
Subject: [Octave-bug-tracker] [bug #54562] numel should warn if the resulting double might be inaccurate
Date: Sat, 25 Aug 2018 13:50:47 -0400 (EDT)
User-agent: Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:61.0) Gecko/20100101 Firefox/61.0

Update of bug #54562 (project octave):

                Severity:              3 - Normal => 1 - Wish               
                  Status:                    None => Confirmed              


Follow-up Comment #3:

I agree on a couple of points.  First, Octave's handling of very large indices
needs to be better.  Second, the problem can be broken up in to different
regimes where, unfortunately, Octave is performing poorly each time.  For
indices greater than intmax, as Dan has pointed out, the integer value
reverses sign and becomes negative and is generally handled poorly.  That is
the first thing to fix.  The second regime is indices greater than flintmax
but less than intmax where there can be a loss of precision.  A warning about
using linear indexing in this regime would be a good idea.  In addition, to
warning about linear indexing it should suggest the alternative of using full
subscripts (A(i,j)) which very likely preserves full precision.


Reply to this item at:


  Message sent via Savannah

reply via email to

[Prev in Thread] Current Thread [Next in Thread]