August 2013 Archives

Fixed point arithmetic's susceptibilities to rounding error and overflow both stem from the limited number of decimal digits available to represent them, as discussed in the previous post. A common solution to this problem is to use arbitrary precision integers, also known as bignums, to represent the digits.

Full text...

submit to reddit