[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
integer artithmetic
From: |
John W. Eaton |
Subject: |
integer artithmetic |
Date: |
Wed, 1 Sep 2004 14:32:09 -0400 |
What should we do for things like
int16(0) / int16(0)
or
Inf * int16(0)
?
If both arguments are double, these operations genrate NaNs. What
should Octave do, given the constraint that the result should be an
int16 object (at least I believe that's the rule that we have to
follow for compatibility)?
Should the result be int16(0)?
Can someone who has Matlab R14 say what it does?
Thanks,
jwe
- integer artithmetic,
John W. Eaton <=