StackOverflow Questions for Tag: floating-accuracy

Dessislava Mitova

Reputation: 391

Truncate float numbers with PHP

phpfloating-pointtruncatefloating-accuracy

Score: 23

Answers: 16

Arjan

Reputation: 619

Conversion accuracy issues of E57 to LAS in Python using pye57 and laspy

pythonpython-3.xdata-conversionfloating-accuracypoint-clouds

Score: 0

Answers: 1

Andrew Walker

Reputation: 42440

Is there a floating point value of x, for which x-x == 0 is false?

floating-pointfloating-accuracyieee-754

Score: 21

Answers: 7

abukaj

Reputation: 2712

Is there a numerically optimal order of matrix multiplication?

pythonnumpymatrix-multiplicationnumerical-methodsfloating-accuracy

Score: 9

Answers: 4

StevenGoode

Reputation: 1

Workaround for numpy.linspace to work with step size rather than number of steps?

numpyfloating-accuracylinspace

Score: -2

Answers: 0

Uriel Herrera

Reputation: 43

Calculate accuracy in libtorch (C++) when using Softmax

c++floating-accuracysoftmaxlibtorch

Score: 1

Answers: 0

Ferdinando Randisi

Reputation: 4378

How to get bc to handle numbers in scientific (aka exponential) notation?

bashnumericfloating-accuracybc

Score: 54

Answers: 13

paradise

Reputation: 491

Why does Double.CompareTo() use "==" internally?

c#.netfloating-pointfloating-accuracy

Score: 0

Answers: 3

Cato Johnston

Reputation: 45659

Is floating-point math broken?

mathfloating-pointlanguage-agnosticprecisionfloating-accuracy

Score: 4006

Answers: 35

BangTheBank

Reputation: 828

postgresql round half down function

postgresqlfloating-pointplpgsqlroundingfloating-accuracy

Score: 6

Answers: 7

Spektre

Reputation: 51835

Ray and ellipsoid intersection accuracy improvement

geometryglslshaderfloating-accuracyartifacts

Score: 19

Answers: 0

Robert

Reputation: 3870

Mystery behind presentation of Floating Point numbers

swiftfloating-pointdecimalprecisionfloating-accuracy

Score: 0

Answers: 3

Zaphod Beeblebrox

Reputation: 458

Format floating-point numbers with sed to equal precision - add trailing zeros

bashsedfloating-pointprecisionfloating-accuracy

Score: -1

Answers: 5

bers

Reputation: 5771

Is Google Sheets less or more accurate than Microsoft Excel?

excelgoogle-sheetsieee-754floating-accuracy

Score: 3

Answers: 2

Luis Mendo

Reputation: 112659

Is "banker's rounding" really more numerically stable?

floating-pointlanguage-agnosticroundingfloating-accuracybankers-rounding

Score: 48

Answers: 2

Carol.Kar

Reputation: 5345

Whats the smallest de-/normalized number greater than 1?(64bit)

floating-pointbinaryfloating-accuracyieee-754denormalization

Score: 3

Answers: 2

javery

Reputation: 41

Workarounds for High Floating-Point Error in NumPy Arrays Raised to Powers

pythonpython-3.xnumpyfloating-accuracygmpy

Score: 1

Answers: 2

dcmoody

Reputation: 1325

PHP - Floating Number Precision

phpfloating-pointprecisionfloating-accuracy

Score: 98

Answers: 8

Peter Smit

Reputation: 28686

How to do an integer log2() in C++?

c++floating-accuracylogarithm

Score: 58

Answers: 18

haifisch123

Reputation: 239

Function which returns coefficients of Legendre Polynomials not accurate enough

c++recursionboostfloating-accuracypolynomials

Score: 3

Answers: 2

PreviousPage 1Next

StackOverflow Questions for Tag: floating-accuracy

Truncate float numbers with PHP

Conversion accuracy issues of E57 to LAS in Python using pye57 and laspy

Is there a floating point value of x, for which x-x == 0 is false?

Is there a numerically optimal order of matrix multiplication?

Workaround for numpy.linspace to work with step size rather than number of steps?

Calculate accuracy in libtorch (C++) when using Softmax

How to get bc to handle numbers in scientific (aka exponential) notation?

Why does Double.CompareTo() use &quot;==&quot; internally?

Is floating-point math broken?

postgresql round half down function

Ray and ellipsoid intersection accuracy improvement

Mystery behind presentation of Floating Point numbers

Format floating-point numbers with sed to equal precision - add trailing zeros

Is Google Sheets less or more accurate than Microsoft Excel?

Is &quot;banker&#39;s rounding&quot; really more numerically stable?

Whats the smallest de-/normalized number greater than 1?(64bit)

Workarounds for High Floating-Point Error in NumPy Arrays Raised to Powers

PHP - Floating Number Precision

How to do an integer log2() in C++?

Function which returns coefficients of Legendre Polynomials not accurate enough

Why does Double.CompareTo() use "==" internally?

Is "banker's rounding" really more numerically stable?