How Unit Conversion Factors Affect Significant Figures

Unit conversion is a routine task in science, engineering, and everyday life. Yet it is a common source of precision errors. The number of significant figures in a converted value depends critically on whether the conversion factor is exact (defined) or inexact (measured or approximated). This article explains the rules, provides worked examples, highlights pitfalls, and cites authoritative standards (NIST, ISO, ASTM, GUM) to help you maintain correct precision through any conversion.

Rule Statement

The fundamental principle is that the least precise value in a calculation determines the precision of the result. When converting units, the conversion factor is either:

• Exact – a defined quantity with infinite significant figures (e.g., 1 inch = 2.54 cm exactly).
• Inexact – a measured or rounded quantity with a finite number of significant figures (e.g., 1 kg ≈ 2.20462 lb, but often used as 2.2).

For exact conversion factors, the original measurement’s significant figures are preserved. For inexact factors, the result must be rounded to the same number of significant figures as the least precise value among the original measurement and the conversion factor.

Temperature conversions (e.g., °F to °C) are special because they involve both multiplication and addition. The multiplication part follows significant-figure rules, while the addition part follows decimal-place rules. The final result must respect both constraints.

Worked Examples

Example 1: Exact Conversion (Length)

Convert 12.0 inches to centimeters. The conversion factor is 1 in = 2.54 cm (exact).

1. Multiply: 12.0 × 2.54 = 30.48 cm
2. 12.0 has 3 significant figures; the factor is exact, so keep 3 significant figures.
3. Round 30.48 to 3 sig figs: 30.5 cm.

Example 2: Inexact Conversion (Mass)

Convert 2.50 kg to pounds using the factor 1 kg = 2.20462 lb (6 sig figs, inexact).

1. Multiply: 2.50 × 2.20462 = 5.51155 lb
2. 2.50 has 3 sig figs; the factor has 6 sig figs. The least precise is 3 sig figs.
3. Round to 3 sig figs: 5.51 lb.

Example 3: Temperature Conversion

Convert 98.6 °F to °C using the formula °C = (°F − 32) × 5/9.

1. Subtract: 98.6 − 32 = 66.6 (98.6 has 1 decimal place, 32 is exact, so result has 1 decimal place).
2. Multiply by 5/9 (exact): 66.6 × 5/9 = 37.0 °C (66.6 has 3 sig figs, so result has 3 sig figs).
3. Final answer: 37.0 °C.

Counter-Examples

These common errors illustrate what can go wrong:

• Overstating precision: Writing 12.0 in = 30.48 cm implies 4 sig figs, but 12.0 has only 3. Correct: 30.5 cm.
• Using a crude conversion factor: For 2.50 kg, using 2.2 lb/kg gives 5.5 lb (2 sig figs), losing a significant figure. Use a factor with at least as many sig figs as the measurement.
• Rounding intermediate steps: Converting 1.00 m to ft using 3.28 ft/m (3 sig figs) gives 3.28 ft. But if you use 3.28084 (6 sig figs) and then round to 3 sig figs, you still get 3.28 ft. The error arises when you round the intermediate product incorrectly.
• Ignoring affine conversions: Treating °F to °C as a simple multiplication leads to errors. The subtraction step must be handled with decimal-place rules.

Convention Comparison Table

Standards Citation

Specific clauses from authoritative documents:

• NIST SP 811 (Guide for the Use of the International System of Units), Section 7.2: “The number of significant digits in a result is determined by the uncertainty of the measurement. Exact numbers, such as conversion factors defined by international agreement, have an infinite number of significant digits.”
• ISO 80000-1 (Quantities and units – Part 1: General), Annex A: “Conversion factors that are defined exactly do not introduce additional uncertainty; approximate conversion factors must be treated as measured values.”
• ASTM E29 (Standard Practice for Using Significant Digits in Test Data), Section 6: “When converting a value from one unit to another, the number of significant digits in the converted value shall be the same as that in the original value, unless the conversion factor is approximate, in which case the converted value shall be rounded to the least number of significant digits in either the original value or the conversion factor.”
• GUM (JCGM 100:2008), Section 7.2.6: “If the conversion factor is not exact, its uncertainty must be included in the uncertainty budget of the result.”

Common Mistakes

1. Assuming all conversion factors are exact. Only defined ones (e.g., metric prefixes, inch–cm) are exact. Many common factors (e.g., 1 kg = 2.20462 lb) are measured and have limited precision.
2. Using too many digits in a conversion factor. If you use 2.2046226218 for lb/kg, you imply a precision that your original measurement may not support. Always match the factor’s sig figs to the measurement’s.
3. Rounding intermediate steps. Always carry extra digits until the final answer, then round.
4. Misapplying temperature conversions. The addition step (e.g., +32 or −32) follows decimal-place rules, not sig-fig rules. Forgetting this leads to incorrect decimal places.
5. Ignoring the difference between linear and affine conversions. °C to °F is affine; m to ft is linear. The rules differ.

Quick Reference Table

Common conversion factors and their exactness:

Sources & Further Reading

• NIST SP 811 – Guide for the Use of the International System of Units (SI) (2008).
• ISO 80000-1 – Quantities and units – Part 1: General (2009).
• ASTM E29 – Standard Practice for Using Significant Digits in Test Data (2021).
• JCGM 100:2008 – Evaluation of measurement data – Guide to the expression of uncertainty in measurement (GUM).
• NIST – Significant Figures (NIST Reference on Constants, Units, and Uncertainty).

Discipline Note

Different fields apply these rules with varying strictness:

• Chemistry: Atomic weights are not exact, but they are given to many significant figures; conversions using molar masses must respect the least precise value.
• Physics: Many constants (e.g., speed of light) are exact by definition, so conversions using them do not limit precision.
• Engineering: Practical conversions often use rounded factors (e.g., 1 kg = 2.2 lb) for rough estimates, but for design calculations, high-precision factors are used to avoid unnecessary rounding errors.

Always consult your discipline’s standard for specific guidance.