StackOverflow Questions for Tag: arbitrary-precision

Esteban Küber

Reputation: 36852

What class to use for money representation?

pythoncurrencyrounding-errorarbitrary-precisionprecision

Score: 52

Answers: 6

regexp

Reputation: 263

Large numbers in Delphi

delphibignumarbitrary-precision

Score: 14

Answers: 3

Bek

Reputation: 33

Why 5.0 / 2 returns 2.5000000000000000 (scale of 16) instead of 2.5 (scale of 1)?

sqlpostgresqlprecisionnumericarbitrary-precision

Score: 0

Answers: 2

Vincent

Reputation: 60451

SIMD versions of SHLD/SHRD instructions

cassemblyx86-64bit-shiftarbitrary-precision

Score: 7

Answers: 1

Caio

Reputation: 117

Arbitrary precision integer on GPU

bigintarbitrary-precision

Score: 8

Answers: 2

Divye Sharma

Reputation: 11

Boost multiprecision library

pythonboostarbitrary-precisionboost-multiprecision

Score: 1

Answers: 1

CitizenInsane

Reputation: 4865

Confused with matlab arbitrary precision toolboxes

matlabarbitrary-precision

Score: 0

Answers: 0

Abhranil Das

Reputation: 5916

Represent tiny numbers in Matlab using sym and vpa

matlabsymbolic-matharbitrary-precision

Score: 0

Answers: 1

nraina

Reputation: 354

BigNumber.js calculation shows different value when done same calculation in C# using decimal datatype

javascriptc#arbitrary-precisionbignumber.js

Score: 1

Answers: 2

Andrew Kornder

Reputation: 59

A faster way of comparing arrays of integers lexicographically

c++optimizationprofilingarbitrary-precision

Score: 2

Answers: 3

Camion

Reputation: 1374

when extending python with c, how do one cope with arbitrary size integers?

pythoncpython-3.xlong-integerarbitrary-precision

Score: 5

Answers: 2

Jimmix

Reputation: 6536

MySQL 8 timestamp precision in nanoseconds

mysqldatetimetimestampprecisionarbitrary-precision

Score: 2

Answers: 1

SFtigs

Reputation: 3

mpmath and mathmatica discrepancy in output

precisionarbitrary-precisionmpmath

Score: 0

Answers: 1

Vincent

Reputation: 60451

Limb in the vocabulary of arbitrary precision integer?

c++cintegergmparbitrary-precision

Score: 3

Answers: 2

Snowy Owl

Reputation: 43

Can AVX-512 be used to calculate the multiplication of two 256-bit Integers on a 64 bit computer in C++? Whether using Assembly Language or not

c++assemblygmparbitrary-precision

Score: 3

Answers: 1

Kittoes0124

Reputation: 5080

Calculating the fixed-point representation of (1 - SQRT(0.5)) to arbitrary levels of precision

cmathbinaryfixed-pointarbitrary-precision

Score: -1

Answers: 2

osgx

Reputation: 94445

Restore a number from several its remainders (chinese remainder theorem)

mathgmpnumber-theoryarbitrary-precisionchinese-remainder-theorem

Score: 6

Answers: 4

srikanth m

Reputation: 11

why Java BigDecimal giving Precision Errors

javabigdecimalarbitrary-precisionfault-tolerance

Score: 0

Answers: 0

Matt Gregory

Reputation: 8682

What programming languages support arbitrary precision arithmetic?

programming-languagesbigdecimalarbitrary-precision

Score: 23

Answers: 18

user3612731

Reputation: 11

Variable precision arithmetic for definite integrals in Matlab

matlabnumerical-integrationarbitrary-precision

Score: 1

Answers: 1

PreviousPage 1Next