[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #32924] lcm yields wrong results

From: Rik
Subject: [Octave-bug-tracker] [bug #32924] lcm yields wrong results
Date: Mon, 28 Mar 2011 00:40:03 +0000
User-agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv: Gecko/20110323 Ubuntu/10.04 (lucid) Firefox/3.6.16

Follow-up Comment #2, bug #32924 (project octave):

To add a bit more to Jordi's analysis, Octave is using the double class to
represent the integers for the lcm analysis.  The largest integer that can be
represented is found with the 'bitmax' function.  For standard IEEE 64-bit
doubles the result is 9.0072e+15.  The fact that you are getting results of
order 1e20 means that you have gone well beyond the ability of the double
class to represent the numbers involved.

Even using the 'uint64' class will only get you numbers up to ~1.8e19.  If you
need something more you will need to look into a package with arbitrary


Reply to this item at:


  Message sent via/by Savannah

reply via email to

[Prev in Thread] Current Thread [Next in Thread]