Reference library46 entries

Tag: precision

Practical explanations, worked examples, and reference notes for reporting numbers correctly.

Error Propagation

Propagating Uncertainty Through Addition and Multiplication: Rules, Examples, and Standards

Learn how to propagate uncertainty when adding, subtracting, multiplying, and dividing measured values. Understand the significant figure rules, the GUM approach, and common pitfalls.

Read explanation

What Is ASTM E29 Rounding and Who Uses It?

ASTM E29 defines the standard practice for rounding test data to determine conformance with specifications. It is widely used in materials testing, manufacturing, and…

Read explanation

Significant Figures

Significant Figures in Multi-Step Calculations: When to Round

Learn the correct rounding strategy for multi-step calculations to preserve precision and avoid error propagation.

Read explanation

Significant Figures

Why 1200 Can Have 2, 3, or 4 Significant Figures

The number 1200 is ambiguous because trailing zeros without a decimal point are not significant. Depending on context, it can have 2, 3, or…

Read explanation

Double Rounding Error

The Double Rounding Error That Changes Your Final Answer

Double rounding—rounding an intermediate value and then rounding again—can produce a different final result than a single direct rounding. Learn the rules, standards, and…

Read explanation

How to Round to Significant Figures in Excel (ROUND + LOG10 Method)

Learn the exact Excel formula to round any number to a specified number of significant figures using ROUND and LOG10, with worked examples, standards…

Read explanation

pH and Sig Figs: Why Only the Decimals Count

In pH measurements, only the digits after the decimal point are significant. This article explains the logarithmic basis, the rules, and common pitfalls.

Read explanation

Ambiguous Trailing Zeros

The Overline (Bar) Notation for Ambiguous Trailing Zeros

Learn how the overline (bar) notation resolves ambiguity in trailing zeros, with rules, examples, standards citations, and common pitfalls.

Read explanation

Rounding Methods

Round Half Up vs Round Half Even: Which Does Your Class Use?

A comprehensive comparison of two common tie-breaking rules for rounding, including definitions, examples, standards, and software behavior.

Read explanation

Rounding vs Significant Figures

Rounding vs Significant Figures: Not the Same Thing

Rounding and significant figures are often confused, but they serve different purposes. Rounding reduces digits; significant figures convey precision. Learn the rules, standards, and…

Read explanation