bug-apl
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Bug-apl] Format by specification - bug in exponential display


From: apm
Subject: [Bug-apl] Format by specification - bug in exponential display
Date: Wed, 01 Jul 2015 00:21:12 -0400
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0

I get the following when using ⍕:

      12 ¯4 ⍕ 9.9994 9.9995 9.9996 ¯9.9995E¯10 ¯9.9996E¯10
     9.999E0     9.999E0     0.000E0  ¯0.000E¯10  ¯0.000E¯10

This should display as:
     9.999E0     1.000E1     1.000E1   ¯1.000E¯9   ¯1.000E¯9

The error in (12 ¯4 ⍕ 9.9996 ¯9.9995E¯10 ¯9.9996E¯10) seems to be related to the failure to increase the exponent by 1 and reduce the coefficient by 9 when the coefficient rounds to 10.000

The error in (12 ¯4 ⍕ 9.9995) is probably related to ⎕CT and binary/decimal conversions and may not be considered a true error.




reply via email to

[Prev in Thread] Current Thread [Next in Thread]