Policy reporting problems: 8 errors and how to fix them

What to take away

Most policy reporting problems are not errors of fact but errors of stage: a correct fact placed at the wrong point in the process. The repair is to attach every claim to an authority, a date, a record, and a measure. The stages below show where the common mistakes happen and what fixes them.

1. Proposal called law

Problem: A press release announces a bill and the headline says the government changed the law. Introduced text is not law: a bill becomes law only after both chambers pass it and the president signs it or Congress overrides a veto, and the enacted provisions then take effect on their own terms.

Fix: State that the measure was introduced or proposed. Track the bill by number on Congress.gov through committee, chamber passage, presentment, and signature before changing the status word. For agency rules, the governing authority is the Administrative Procedure Act (5 U.S.C. § 553): notice of proposed rulemaking, a public comment period, and a final rule that states its basis and purpose. Our policy tools comparison keys each status word to the document that earns it. When Congress overturns a finished rule, the tool is the Congressional Review Act, not the original statute.

Routes that skip full notice-and-comment

An agency can give a proposal practical legal force without ever traveling the full notice-and-comment route. The named routes are:

Each route changes what counts as the law, which date starts the duty, and what the document should be called in a story.

2. Publication date called start date

Problem: A final rule appears on Tuesday, so the story says every requirement began Tuesday.

Fix: Read the dates section and regulatory text. Separate publication, effective, compliance, and enforcement dates. Different provisions may follow different schedules.

A Federal Register rule on regulatory sunsets shows how a direct final rule can name an effective date conditioned on whether significant adverse comments are received, while a companion proposal proceeds alongside it. The conditional effective-date example supports checking conditions rather than copying one date. The example does not establish a general schedule for other rules.

3. Requested money called funding

Problem: An executive budget request becomes "the program received $50 million."

Fix: Follow the money through the enacted appropriation, OMB apportionment, agency allocation, obligation, award, invoice, and payment. A Congressional Budget Office cost estimate shows what a bill is projected to spend; apportionment and obligation records show what an agency may spend and what it has committed. State which stage and which fiscal period the number represents. The money trail is Step 5 of tracing policy implementation.

4. Contract ceiling called spending

Problem: The maximum contract value is reported as money paid.

Fix: Compare base value, options, amendments, obligations, invoices, acceptance records, and disbursements. Add a through-date to interim totals.

5. Comment count treated as vote

Problem: The side with more regulatory comments is declared the winner.

Fix: Read the docket on Regulations.gov, where comments are filed and the agency posts its response. Examine submission method, duplicate text, evidence, legal criteria, and the agency's basis-and-purpose statement. Under the Administrative Procedure Act an agency must consider the comments it receives, but it does not count them as votes. Describe participation and substance separately.

6. Output called outcome

Problem: An agency processed 20,000 applications, so the article says the policy solved access.

Fix: Treat processing as an output. Measure approval, timeliness, reach, user burden, error, appeal, and the intended social result. Keep outputs and outcomes in separate stages.

7. One indicator becomes the whole verdict

Problem: A dashboard measure improves while cost, quality, equity, or long-term effects are ignored.

Fix: Use a small set of linked measures. GAO guidance on performance management says measures should demonstrate results, connect to responsible programs, and rely on sufficiently complete, accurate, and consistent data. The GAO performance implementation guide supports checking measure quality and use. It is an older federal management guide, not a current rating of a specific program.

8. Timing becomes causation

Problem: An outcome changed after policy adoption, so the story says the policy caused it.

Fix: Check pre-policy trend, other interventions, eligibility, exposure, comparison groups, and evaluation design. Use "followed" or "coincided" when timing is the only established link. The same discipline applies to statistics reporting problems: correlation never graduates to causation on its own.

Status language table

Common questions

Can implementation begin before every rule is final?

Planning and voluntary preparation may begin, while enforceable duties depend on the governing authority and dates. Describe the specific activity.

Does a missed target prove policy failure?

It proves the target was missed under its definition. Reporting should examine why, the target's quality, effects, and other outcomes.

Should a story use the agency's program name?

Yes, but define it in plain terms. Promotional names can conceal eligibility, obligations, or limits.

What makes a policy correction material?

Wrong legal status, dates, covered groups, costs, duties, funding, or evidence claims usually require a visible correction.