Category Archives: Floating Point

Intermediate Floating-Point Precision

Riddle me this Batman: how much precision are these calculations evaluated at? If you answered ‘double’ and ‘float’ then you score one point for youthful idealism, but zero points for correctness. The correct answer, for zero-idealism points and forty two … Continue reading

Posted in AltDevBlogADay, Floating Point, Programming, Visual Studio | Tagged , , , , , | 46 Comments

C++ 11 std::async for Fast Float Format Finding

After a recent post on float precision there was some debate about round-tripping of floats. My claim was that if you print a float with printf(“%1.8e”, f); and then scan it back in then you are guaranteed to get back … Continue reading

Posted in Floating Point, Programming, Visual Studio | Tagged , , , | 24 Comments

Float Precision–From Zero to 100+ Digits

How much precision does a float have? It depends on the float, and it depends on what you mean by precision. Typical reasonable answers range from 6-9 decimal digits, but it turns out that you can make a case for … Continue reading

Posted in AltDevBlogADay, Floating Point, Programming | Tagged , , , , , | 51 Comments

Comparing Floating Point Numbers, 2012 Edition

This post is a more carefully thought out and peer reviewed version of a floating-point comparison article I wrote many years ago. This one gives solid advice and some surprising observations about the tricky subject of comparing floating-point numbers. We’ve … Continue reading

Posted in AltDevBlogADay, Floating Point, Programming | Tagged , , , , , , | 195 Comments

Don’t Store That in a Float

I promised in my last post to show an example of the importance of knowing how much precision a float has at a particular value. Here goes. As a general rule this type of data should never be stored in … Continue reading

Posted in AltDevBlogADay, Floating Point, Programming | Tagged , , , , , , | 24 Comments

They sure look equal…

This is a special bonus extra post in my floating-point series, ranting about an issue that has been a problem for years. Some debuggers don’t display floats with enough precision.

Posted in Floating Point, Math, Programming | Tagged , , , , | 17 Comments

Stupid Float Tricks

Type Punning is Not a Joke I left the last post with a promise to share an interesting property of the IEEE float format. There are several equivalent ways of stating this property, and here are two of them.

Posted in AltDevBlogADay, Floating Point, Programming | Tagged , , , | 32 Comments