[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
R: float to integer conversion anomalies
From: |
Marco Atzeri |
Subject: |
R: float to integer conversion anomalies |
Date: |
Tue, 30 Jun 2009 09:55:16 +0000 (GMT) |
--- Mar 30/6/09, Levente Torok <address@hidden> ha scritto:
> Da: Levente Torok <address@hidden>
> Oggetto: float to integer conversion anomalies
> A: address@hidden
> Data: Martedì 30 giugno 2009, 11:16
> Hi All,
>
> May be I am commenting something that has already been
> reported or even solved.
> On octave-3.0.5 I found a somewhat inconsistent behavior.
>
> octave:2> for i=.1:.1:2
> > i*10
> > endfor
> ans = 1
> ans = 2
> ans = 3..00000000000000 <-????
> ans = 4
> ans = 5
may I suggest
for i=.1:.1:2
round(i*10)
endfor
You are missing some ground on 0.3 representation
in base 2.
It is a periodic number so must be truncated.
> Levente
>
Marco
- R: float to integer conversion anomalies,
Marco Atzeri <=