CODEWITHSUNDEEP
excel
Jack Kada
Jack Kada

Reputation: 25242

Excel Floating Point Arihmetic - What Type Does It Actually Use

From a previous questions someone indicated that Excel uses a 64 bit (8 byte) double-precision floating.

Is that correct - Is there any material on this at all?

I am trying to tie off numbers and this is killing me!

Upvotes: 4

Views: 1753

Answers (2)

Adriaan Stander
Adriaan Stander

Reputation: 166476

Have a look at

Floating-point arithmetic

Under the section Precision

A floating-point number is stored in binary in three parts within a 65-bit range: the sign, the exponent, and the mantissa.

Here is another article

Understanding Floating Point Precision, aka “Why does Excel Give Me Seemingly Wrong Answers?”

Have a look at the section Structure of a Floating Point Number

Upvotes: 3

Vincent Ramdhanie
Vincent Ramdhanie

Reputation: 103145

According to this article yes, it uses 64 bit double precision floating point numbers. The article also describes the rounding errors etc associated with this format.

Upvotes: 5

Related Questions