[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
How to force single precision (32bit) math ? (Octave crash on mixed 32/6
How to force single precision (32bit) math ? (Octave crash on mixed 32/64bit math)
Sun, 25 Dec 2016 22:17:26 -0800 (PST)
when simulating IIR filter based on biquads (for DSP) I try using standard
The problem is that it operates well only with standard double precision
And in the DSP is based on 32bit biquad filters. The ultra-precise 64bit
coefficients just give wrong result when truncated to 32bit.
When I try to convert the variables and the resulting SOS coeff. matrix to
single(), OCTAVE crashes without throwing a message.
I suspect, that is caused by mixing 32bit and 64 bit data.
Seems the most straightforward solution would be *forcing* all the math in
the session to single precision.
Is it possible
View this message in context:
Sent from the Octave - General mailing list archive at Nabble.com.
- How to force single precision (32bit) math ? (Octave crash on mixed 32/64bit math),