help-octave
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: polyfit weirdness


From: Scott Lamb
Subject: Re: polyfit weirdness
Date: Tue, 11 Feb 2003 10:25:12 -0600
User-agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.0.1) Gecko/20020826

Etienne Grossmann wrote:
     A problem with order of magnitude of f1 and floating-point
     limitations?


octave:63> f1 /= 1e14;
octave:64>      [p1,cv1] = polyfit(f1,v1,1)'
p1 =

   0.41679
  -1.49481

cv1 =

  0.66528  0.79417  1.37189  1.59260  1.92606

     Is that more like what you expected?

Yes, it is, thanks.

I'm a little disappointed Octave has this problem; I'd assumed it would be using gmp or something for arbitrary precision. Oh well.

Thanks,
Scott Lamb



-------------------------------------------------------------
Octave is freely available under the terms of the GNU GPL.

Octave's home on the web:  http://www.octave.org
How to fund new projects:  http://www.octave.org/funding.html
Subscription information:  http://www.octave.org/archive.html
-------------------------------------------------------------



reply via email to

[Prev in Thread] Current Thread [Next in Thread]