[Openmcl-devel] Floating point precision
sshenoy at gol.com
Wed Jan 21 16:38:16 PST 2009
I have actually gone with your (and Brian's) earlier suggestion of
shadowing all the math functions.
Editing the int constants to single-float format does not solve the
problem since it would return the same results as passing an int itself.
On Jan 21, 2009, at 11:23 PM, Alexander Repenning wrote:
> A happy compromise may be to set *read-default-float-format* to
> double and to edit your int constants to be in single float format,
> e.g., "2.0" At least you would not have to append the "d0" to each
> constant value which I agree would look a tad ugly.
> On Jan 17, 2009, at 7:18 PM, Sudhir Shenoy wrote:
>> I now
>> have to go through the code and ensure that all constants are affixed
>> with 'd0' even where they are exact integers because of the danger of
>> intermediate results losing precision if these constants are passed
>> math functions ...
> Prof. Alexander Repenning
> University of Colorado
> Computer Science Department
> Boulder, CO 80309-430
> vCard: http://www.cs.colorado.edu/~ralex/AlexanderRepenning.vcf
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Openmcl-devel