bug-gnu-utils
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

bc: Accuracy bug?


From: Rogier Wolff
Subject: bc: Accuracy bug?
Date: Sun, 15 Apr 2001 18:39:03 +0200 (MEST)

Hi,

/home/wolff> bc -l
bc 1.03 (Nov 2, 1994)
Copyright (C) 1991, 1992, 1993, 1994 Free Software Foundation, Inc.
This is free software with ABSOLUTELY NO WARRANTY.
For details type `warranty'. 
.3333333333*12
3.9999999996
.3333333334*12
4.0000000008
ibase=16
obase=10 
.5555555555*C
3.FFFFFFFE4
.5555555556*C
3.FFFFFFFE4
.5555555566*C
3.FFFFFFFE4
.55555555666*C
4.0000000057


As far as I can see, the calculation of "scale" is slightly off (by
nearly two digits!) when in "HEX" mode.

Note that I don't see this with 1/x * x ... 

                                Roger. 

-- 
** address@hidden ** http://www.BitWizard.nl/ ** +31-15-2137555 **
*-- BitWizard writes Linux device drivers for any device you may have! --*
* There are old pilots, and there are bold pilots. 
* There are also old, bald pilots. 



reply via email to

[Prev in Thread] Current Thread [Next in Thread]