The ozone standard (environmental policy)

Air quality in the United States is regulated by comparing monitor readings with national standards. For ozone, the official arithmetic drops digits by truncation at three separate steps. For a single number the difference between rounding and truncating is at most half a part per billion. The way the computation is run, however, the losses compound: among the cases surveyed, values whose exactly propagated mean lands more than 1.4 parts per billion above the limit still pass. Carrying the computation through exactly and comparing once would remove that ambiguity.

The ozone standard and the design value

Under the Clean Air Act, the Environmental Protection Agency (EPA) sets National Ambient Air Quality Standards and determines, region by region, whether the air meets them. For each monitoring site one statistic, the design value, is compared with the level of the standard. For ozone the level, set in 2015, is 70 parts per billiona mixing ratio: 70 molecules of ozone in every billion molecules of air, the same quantity as 0.070 parts per million (ppb), written in the regulation as 0.070 parts per million (ppm). The design value is built in stages. A monitor reports hourly concentrations; these are combined into eight-hour averages, seventeen per day beginning at each hour from 7:00 a.m. through 11:00 p.m., and each day is scored by the highest of them. Each year contributes its fourth-highest daily maximum, and the design value is the average of three consecutive years’ fourth-highest values. The site attains if the design value is “less than or equal to” 0.070 ppm. Fine particulate matter, PM2.5airborne particles 2.5 micrometers or less across, small enough to reach deep into the lungs; the standards limit their mass per cubic meter of air, has two design values of its own under the same part of the Code of Federal Regulations, 40 CFR Part 50, against levels of 9.0 and 35 micrograms per cubic meter. The two pollutants make a natural pair because the regulation handles their last digits differently: Appendix U to Part 50, for ozone, truncates, and Appendix N, for PM2.5, rounds.

A great deal rides on whether a site attains. A nonattainment designation triggers mandatory state implementation plansa state’s federally enforceable plan of emission limits and control programs for bringing a nonattainment area back under the standard by a deadline and permitting constraints on industry. Recent determinations have turned on the last digit: in EPA’s 2022 determinations Atlanta attained the 2015 ozone standard at 0.070 ppm, while Washington, DC, St. Louis and Milwaukee, at 0.071, failed to attain and were reclassified from Marginal to Moderateozone nonattainment areas are classed Marginal, Moderate, Serious, Severe or Extreme; each higher class carries stricter required controls and a later deadline nonattainment.

Where the digits go

A computed average carries more digits than the standard, so the rule must say what happens to the extras. Truncation drops them: a three-year mean of 0.0706… ppm is reported as 0.070 and attains. Rounding goes to the nearest value: the same mean becomes 0.071 and violates. One final truncation lets a mean as high as 70.9 ppb attain, while one final rounding stops at 70.4. At the last digit, then, the conventions differ by half a part per billion, the quantity in dispute in EPA’s docketsthe public file of a federal rulemaking, holding the proposal, the comments received and the supporting documents.

The final digit, though, is one of three places where Appendix U discards digits, in nearly identical words each time. The hourly concentrations are cut before they are even reported: “Hourly average O3 concentrations shall be reported in parts per million (ppm) to the third decimal place, with additional digits to the right of the third decimal place truncated” (§3(a)). Then “The 8-hour averages shall be reported to three decimal places, with additional digits to the right of the third decimal place truncated” (§3(b)), and finally “Design values shall be reported in ppm to three decimal places,” again with the further digits “truncated” (§3(e)). In symbols, the calculation from the reported values is

$$X_y=\mathop{\mathrm{fourth}}_{d\in D_y}\ \max_{1\le w\le 17}\ \operatorname{tr}\!\Big(\frac{1}{n_{d,w}}\sum_{h\in H_{d,w}}c_{d,h}\Big),\qquad \mathrm{DV}=\operatorname{tr}\!\Big(\frac{X_1+X_2+X_3}{3}\Big),\qquad \text{attainment}\iff\mathrm{DV}\le 0.070\ \mathrm{ppm}.$$

Here $c_{d,h}$ is the reported hourly concentration, in ppm, for hour $h$ of day $d$, already a whole number of ppb; $H_{d,w}$ is the set of reported hours in the $w$-th eight-hour period of that day and $n_{d,w}$ their number (eight, or six or seven with missing hours). $D_y$ is the set of valid days of year $y$; “fourth” picks the fourth-highest value; $\operatorname{tr}$ truncates to 0.001 ppm, a whole ppb; and $\mathrm{DV}$ is the design value. An eight-hour average of whole numbers is a multiple of one eighth (or sixth or seventh) of a ppb, and its truncation discards that fraction; a three-year mean of whole numbers is a multiple of one third of a ppb, and its truncation discards the thirds. No cut can move the number up, so the losses accumulate instead of canceling.

Flow chart of six numbered boxes joined by downward arrows, with a note to the right of each. 1: Hourly ozone concentration c_{d,h}; orange dot, truncated to a whole ppb, section 3(a); before reporting, cannot be undone. 2: Eight-hour averages, 17 per day; orange dot, truncated to a whole ppb, section 3(b); each average, up to seven eighths of a ppb lost. 3: Daily maximum eight-hour average; gray note, a selection, no digits lost. 4: Annual fourth-highest daily maximum X_y; gray note, a selection, no digits lost. 5: Three-year average, the design value; orange dot, truncated to a whole ppb, section 3(e); up to two thirds of a ppb lost. 6, outlined in violet: Attains if the design value is at most 0.070 ppm; note, section 50.19(b), a value equal to the level attains. Legend: an orange dot marks a point where Appendix U to 40 CFR Part 50 discards digits by truncation.

The six steps from a monitor’s hourly ozone readings to an attainment decision under Appendix U, with an orange dot at each of the three points where the regulation discards digits. The hourly concentration is cut to a whole part per billion before it is reported (§3(a)). Each of a day’s 17 eight-hour averages is cut to a whole ppb (§3(b)), losing up to seven eighths of a ppb. The three-year average is cut to a whole ppb (§3(e)), losing up to two thirds. Steps 3 and 4 only select a value and lose nothing. The first cut precedes reporting and cannot be undone from public data; the second and third act on reported numbers, so their effect can be recomputed, as is done for the counts below. For PM2.5, Appendix N instead rounds the final average half-up. (Redrawn from Figure 1 of the paper.)

Three decades of comment and response

The argument over truncation versus rounding goes back three decades, with a record of comment and response running from 1997 to 2025. The question was raised in journal papers of the 1990s; Fairley, in a 1999 study of overshoot bias, concluded that “rounding may tend to misclassify nonattainment areas as attainment.” EPA solicited and answered comment on the convention in two rulemakingsthe formal procedure in which a federal agency publishes a proposed rule, takes public comment, and issues a final rule together with its responses, 1997 and 2008. Both times environmental and health organizations supported the more stringent alternative, industry associations supported the existing one, and EPA declined to change, in 2008 on the stated ground that “the 8-hour design value has an uncertainty of approximately 0.001 ppm.”

Then, in January 2010, EPA itself proposed to end the truncation. Section V.G of its ozone reconsideration proposal, “Truncation Versus Rounding,” states: “The effect of this repeated truncation is that there is a consistent downward bias in the calculation of the three-year design value. The size of this bias can be notable.” The proposed remedy was to retain all digits through the computation and round the three-year average once. In September 2011 the Administration withdrew the proposal, and EPA did not pursue the change in any later ozone rulemaking. In a comment of May 2022, Sierra Club told EPA that its “truncation conventions in the calculation of design values have no scientific basis,” estimating “up to approximately 1.6 parts per billion of under-protection.” That objection is still pending in EPA’s current review of the ozone standard. To the author’s knowledge none of these documents counts the actual determinations that depend on the conventions; the author searched the Federal Registerthe daily journal of the U.S. government in which agencies publish proposed and final rules; cited by volume and page, as in 75 FR 3031, the regulations.gov dockets, the CourtListener case-law database and, to limited depth, the open web.

What the paper computes

EPA’s Design Value Reports for the four evaluation periods 2020–2022 through 2023–2025 list 13,250 site-level design values, one for each monitoring site and period (a site-period), 4,929 of them for ozone. A value is borderline here if it lies within one unit in the last reported digit of its standard, and there are 340: 202 ozone values published at exactly 0.070 ppm, and 92 annual and 46 daily PM2.5 values at the 9.0 and 35 boundaries. Each is recalculated from EPA’s public Air Quality System (AQS) AirData files, hourly for ozone and daily for PM2.5, step by step as Appendices U and N prescribe, in exact fractions. Exact arithmetic is needed because of ties: a computed value that lands exactly on a threshold must be recognized as equal to it, so that the comparison written in the rule decides the outcome.

The recalculation reproduces EPA’s published values. Of the 340 borderline values, 330 can be calculated from the public files, and every one equals the published design value; for 283 the agreement holds all the way down from the hourly concentrations. EPA applies the conventions exactly as written, so every dependence on a convention counted below arises from the rule itself, applied to the measurements as reported.

Each of the 304 borderline values that are also valid under the completeness rulesan attaining ozone value is valid only with daily maxima on at least 90 percent of ozone-season days over three years, 75 percent each year (190 ozone, 75 annual and 39 daily PM2.5) is then recalculated with the measurements fixed and one provision changed: the final-digit rule, the comparison, or the completeness requirements. For ozone the eight-hour truncation is also replaced, under four procedures applied to the same reported hourly integers: (a) as written; (b) rounding at both steps; (c) the eight-hour averages carried untruncated to one final rounding, EPA’s 2010 proposal; (d) the same with one final truncation. A second implementation written from the regulatory text alone, applied to a sample of twenty-five site-periods, agreed with the first in each of 281 comparisons.

What turns on the last digit

Among the 304 valid borderline values, the final digit decides roughly one determination in three, in opposite directions for the two pollutants. For ozone, 61 of 190 borderline values attain only because Appendix U truncates; rounded, each would be published as 0.071. For PM2.5, 33 of 75 annual and 14 of 39 daily values violate only because Appendix N rounds. So a computed value that exceeds its standard by a given fraction of the last digit can attain for ozone and violate for PM2.5, within one body of regulation. (The PM2.5 values of all four periods are measured against the levels in force since 2024, so for the 2020–2022 annual values the status counted is the one under today’s standard and not the legally operative determination of that period.) The comparison operator matters only when a value equals the level exactly, which is common: 257 of the 304 do, and each attains because the comparison is inclusive. A third provision is one-sided by construction: both appendices relax or waive the data-completeness requirements for a violating value but not for an attaining one. The waiver has an evident rationale, since an observed exceedance is evidence however many other days went unmeasured. Nothing here argues against it; the count is only of the valid ozone violations that owe their validity to it, 8 to 18 in each evaluation period.

One site shows two conventions acting at once. At the New Haven, Connecticut, monitor (site 09-009-0027) EPA published 0.070 ppm, the largest value that attains, for 2020–2022, 2021–2023 and 2023–2025, and a violating 0.072 for 2022–2024. Kept as fractions, the three attaining three-year means are

$$\frac{211}{3000},\ \ \frac{212}{3000},\ \ \frac{211}{3000}\ \mathrm{ppm}\;=\;70\tfrac{1}{3},\ \ 70\tfrac{2}{3},\ \ 70\tfrac{1}{3}\ \mathrm{ppb}.$$

All three truncate to 0.070 and attain only because the comparison is “less than or equal to.” The middle one also attains only through truncation, since rounding $70\tfrac{2}{3}$ as the same regulation prescribes for PM2.5 would give a published value of 0.071; its determination turns on two conventions together.

Chart with the vertical axis labeled three-year mean, New Haven monitor (ppb), ticks at 70.00, 70.50 and 71.00, and the horizontal axis labeled evaluation period, with ticks 2020 to 2022, 2021 to 2023 and 2023 to 2025. A solid dark line at 70.00 is labeled level of the standard, 70 ppb (a value equal to it attains). A light violet band runs from 70.00 up to a dotted line at 71.00 and is labeled in violet: truncated, reads 0.070 ppm and attains (whole shaded band). A dashed orange line at 70.50 with orange hatching above it up to 71.00 is labeled in orange: rounded, would read 0.071 ppm, a violation (hatched). Three violet dots: at 2020 to 2022, height 70.33, labeled 211/3000 ppm = 70 1/3 ppb; at 2021 to 2023, height 70.67, inside the hatched region, labeled 212/3000 ppm = 70 2/3 ppb; at 2023 to 2025, height 70.33, labeled 211/3000 ppm = 70 1/3 ppb.

The New Haven monitor’s three attaining three-year means, computed from the hourly data as exact fractions and drawn in parts per billion (violet dots; in 2022–2024 the site violated at 0.072 ppm, off the chart). Anywhere in the shaded band a truncated value reads 0.070 ppm and attains; above the dashed orange line at 70.5 ppb a rounded value would read 0.071 ppm and violate (hatching). The two outer means, 70⅓ ppb, attain under either convention, and only because a value equal to the level attains. The middle one, 70⅔ ppb, attains only because the rule truncates and the comparison is inclusive: two conventions at once. (Redrawn from Figure 2 of the paper.)

What turns on the eight-hour truncation

At the Cook County, Illinois, monitor in Chicago (site 17-031-4007) the final digit does not matter at all. As written, its annual fourth-highest values for 2020–2022 are 0.072, 0.069 and 0.070 ppm, the mean is $211/3000$, which truncates (and would also round) to 0.070, and the site attains at 70 ppb. Keep the reported hourly values but round the eight-hour averages and the final value, and each year’s fourth-highest rises by a full thousandth, to 0.073, 0.070 and 0.071; the mean becomes $214/3000$ and the published value 0.071, a violation at 71 ppb. Carry the eight-hour averages untruncated and cut once at the end, as EPA proposed in 2010, and the mean before that final step is $853/12000$ ppm, or 71.08 ppb, above the limit whether the final step truncates or rounds. So the site can legally sit 1.08 ppb above the written limit, and no treatment of the last digit changes that, because the excess is removed earlier, when the eight-hour averages are truncated. This particular monitor did not decide its area’s status, however: the Chicago area’s 2020–2022 design value was 0.075 ppm, set by two other monitors.

Over all 190 valid borderline ozone values, rounding at both steps, procedure (b), changes 148–149 determinations, against 61 for the final digit alone. EPA’s 2010 proposal, (c), changes 140, and (d), which removes only the intermediate truncation, 52–53. (The ranges reflect a choice between two admissible data series for exceptional-eventdays whose data EPA has agreed to exclude from the calculation because an unusual event, such as a wildfire, affected the readings days, which moves the determination at two site-periods.) Every change runs from attainment to violation, since a truncation never increases a number. Counted by core-based statistical areaa federal statistical unit: one or more counties tied by commuting to an urban center of at least 10,000 people; every metropolitan area is one rather than by monitor, most changes would not alter a status, because another monitor of the area already violates, as at Chicago. Of 1,558 areas attaining as published, 17 would violate under a final rounding and 41 under (b).

Dot chart. Horizontal axis: three-year mean with the eight-hour averages left uncut (ppb), from 70.0 to about 71.6. Vertical axis: three-year mean as written, before the final cut (ppb), with three rows labeled 70, 70 1/3 and 70 2/3, separated by thin gray lines. Each dot is one monitor in one evaluation period; legend: filled dark dots, would violate if both steps rounded; open dots, would still attain. A solid dark vertical line at 70.0 is labeled 70: the limit, nothing cut. A dotted orange vertical line at 70.5 is labeled from this line on: violates under one final rounding (EPA's 2010 proposal). A dashed violet vertical line at 71.0 is labeled from this line on: violates under one final cut of either kind. A solid gray vertical line near 71.54 is labeled largest possible 71.54. Bottom row (70): stacks of mostly open dots between 70.04 and 70.5 and filled dots from about 70.33 to 70.83. Middle row (70 1/3): mostly filled dots from about 70.46 to 71.08, one labeled Chicago monitor, 71.08. Top row (70 2/3): all filled dots from about 70.71 to 71.42, with a stack at 71.42 labeled 71.42: Kaufman County TX and two others.

All 190 valid borderline ozone design values of 2020–2025, one dot per monitor and evaluation period. Each dot sits at the three-year mean the monitor would have if its eight-hour averages were left uncut (horizontal axis), in one of three rows by its mean as written: 70, 70⅓ or 70⅔ ppb. The top row holds the 61 values that a final rounding alone would turn into violations. Every dot attains as written, and every one lies right of 70 ppb, the limit with nothing cut. Filled dots would violate if both the eight-hour and the final step rounded. Dots on or right of the dotted orange line at 70.5 ppb, 140 of the 190, would violate under EPA’s 2010 proposal of a single final rounding. Dots on or right of the dashed violet line at 71 ppb would violate under a single final cut of either kind. The gray line at 71.54 ppb is the largest uncut mean an attaining value can have for a fixed set of valid days. The Chicago monitor discussed above sits at 71.08, and three site-periods share the observed maximum, 71.42. (Redrawn from Figure 3 of the paper.)

The largest untruncated mean among the 190 is $857/12000$ ppm, or 71.42 ppb, reached at three site-periods: Kaufman County, Texas (site 48-257-0005, 2022–2024), Hunterdon County, New Jersey, and Suffolk County, New York (both 2023–2025). At Kaufman County the published value is 0.070, and the untruncated mean of the same reported measurements is 1.42 ppb above the written limit. That is nearly three times the half part per billion at issue at the final digit, and under each alternative the site violates. The excess has a ceiling: truncating an eight-hour average discards at most $7/8$ ppb, a loss that the later maxima and means cannot enlarge, and a value that attains as written has a pre-truncation mean, a mean of three integers, of at most $212/3$ ppb. So for a fixed set of valid days the largest untruncated mean an attaining value can have is

$$\frac{212}{3}+\frac{7}{8}\;=\;\frac{1717}{24}\;=\;71.5417\ \mathrm{ppb},$$

and the bound can be reached; the observed 71.42 lies just inside it. The simplest alternative of all would carry the computed value through and compare it with the limit once, truncating and rounding nothing. Since the truncations can only lower the value, that is also the strictest reading of the standard, with an effective level of exactly 70.000 ppb.

What the paper does and does not say

None of these counts argues that either convention is wrong or that any area’s designation is environmentally inappropriate. Truncation and rounding each have defensible rationales, and which of them should govern a legal boundary is a policy question that arithmetic cannot decide. Nor do the counts assess the consequences of either convention. EPA’s stated uncertainty of the design value, approximately 0.001 ppm, is as wide as the whole truncation-versus-rounding band, but that figure is quoted here for scale only. The counts, finally, are of site-level design values and not of formal area designations.

What is proposed instead is a list: whichever convention is kept, EPA could state beside each design value in its Reports whether the site’s status depends on the treatment of digits, on the inclusive comparison, or on the completeness waiver. Such a list would serve the states that write implementation plans, the industries whose permits turn on a designation, and commenters on both sides, who could aim their argument at the provision on which a particular site depends. Appendix A of the paper contains that list for every valid borderline site-period of 2020–2025. Counts of this kind could be made wherever a legal status is assigned by comparing a computed statistic with a threshold; two sibling pages under Health policy and medicine treat Medicare star ratings and adaptive trial designs.

The paper

Supplementary material

Every input is public, but because EPA regenerates its AirData files from its current database, the computation is preserved in a reproducibility package: the code, the regulatory text, the digests of all 67 public input files as retrieved, the extracted records of every site counted, every machine-readable result the paper’s numbers are read from, and independent reimplementations and tests.

References

D. P. Chock and B. Nance, A Monte-Carlo simulation of the ozone attainment process, Air & Waste 43 (1993) 995an early statistical study of the ozone attainment test and its stringency
D. P. Chock, Issues regarding the ozone air quality standard and the design value, J. Air Waste Manag. Assoc. 45 (1995) 893on the construction of the fourth-highest design value
U.S. Environmental Protection Agency, ozone NAAQS final rules, 62 FR 38856 (1997) and 73 FR 16501 (2008)the two rulemakings in which EPA took comment on the convention and kept it
D. Fairley, Overshoot bias and the national ozone standard, J. Air Waste Manag. Assoc. 49 (1999) 370concluded that rounding may misclassify nonattainment areas as attainment
M. Greenstone, The Impacts of Environmental Regulations on Industrial Activity: Evidence from the 1970 & 1977 Clean Air Act Amendments and the Census of Manufactures, NBER Working Paper 8484 (2001); J. Polit. Econ. (2002)what nonattainment cost counties in jobs, capital and output, 1972–1987
North Carolina v. EPA, 531 F.3d 896 (D.C. Cir. 2008)the one lawsuit found in which the digit treatment was contested; truncation upheld
U.S. Environmental Protection Agency, ozone reconsideration proposal, section V.G, “Truncation Versus Rounding,” 75 FR 3031 (2010)EPA’s own proposal to carry all digits and round once; withdrawn in 2011
U.S. Environmental Protection Agency, Responses to Significant Comments on the 2014 Proposed Rule on the NAAQS for Ozone, Docket EPA-HQ-OAR-2008-0699 (2015)EPA’s answer that the convention was already accounted for in setting the level
U.S. Environmental Protection Agency, Determinations of Attainment by the Attainment Date, Extensions of the Attainment Date, and Reclassification of Areas Classified as Marginal for the 2015 Ozone National Ambient Air Quality Standards, final rule, 87 FR 60897 (2022)the 2022 determinations: Atlanta attained at 0.070, three areas failed at 0.071
Sierra Club, comment EPA-HQ-OAR-2018-0279-0596 (May 31, 2022)the pending objection: no scientific basis, up to about 1.6 ppb of under-protection
Code of Federal Regulations, Title 40, Part 50: National Primary and Secondary Ambient Air Quality Standards, Appendices H, K, N, and U, eCFR, snapshot of 2026-07-16the regulation itself: Appendix U truncates for ozone, Appendix N rounds for PM2.5
U.S. Environmental Protection Agency, Air Quality Design Values (Design Value Reports, 2020–2022 through 2023–2025) and Air Quality System AirData pre-generated files, as retrieved in July 2026the published design values and the public hourly and daily monitoring data recomputed in the paper

← back to the web summaries