Reference library1 entry

Tag: floating point

Practical explanations, worked examples, and reference notes for reporting numbers correctly.

Significant Figures

Floating Point Errors That Break Sig Fig Calculations

A deep dive into how binary floating-point arithmetic can corrupt significant figure calculations, with standards-based guidance for precision-aware rounding.

Read explanation