help-octave
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

floating point print out


From: David Grohmann
Subject: floating point print out
Date: Fri, 08 Jun 2007 16:29:45 -0500
User-agent: Thunderbird 1.5.0.12 (Windows/20070509)

I have printed out a floating point number in  format long e
1.00000000000000e-00 which is apparently slightly less than 1.00000000000000e00
debug> x
ans =  1.00000000000000e-00
debug> x < 1
ans =  1.00000000000000e+00
debug> 1 - x
ans =  1.11022302462516e-16

What is the decimal value for 1.00000000000000e-00 , is it not possible to show? entering in the text "1.00000000000000e-00" to an octave prompt produces:
debug> 1.00000000000000e-00
ans =  1.00000000000000e+00

I ran the same code on matlab that produced this number and instead got 9.897959183673469e-001

I know I will need to post the code and I will if I am allowed (and find a way to boil the problem down to a small test case). But I'm still wondering what 1.00000000000000e-00 means negative zero exponent. And do you believe this is a bug that could be important?

debug> version
ans = 2.9.10

--
David Grohmann
Senior Student Associate
Applied Research Lab : UT Austin : ESL - S206
Office: 512-835-3237




reply via email to

[Prev in Thread] Current Thread [Next in Thread]