Consolidation Deliverables for Paper D: The Adjudication Paragraph Rewritten Null-Only, the Scope Paragraph Finalized, Senninger Corrected to 2017, and Two Methods Anchors That Let the Draft Report a Null and a Bound Without Apology
round: R27 (Arc 4, consolidation round, Season 2 - no new estimation, no new question)
tasks: Critic 078 items 10a (adjudication rewrite + scope paragraph), 10c (draft targets), Senninger fix, KCI status
queries_run: 1 Vector DB + 2 OpenAlex + 1 Crossref Korean discovery + 2 Crossref verification batches (10 DOIs)
crossref_verified: all 10 References DOIs resolved this round; 2 new anchors added (Rainey 2014; Hartman and Hidalgo 2018)
standing_result: pooled DiD -0.9pp [-3.0, +1.3] (null, prior overturned R25); levels gap overturned R26 (composition);
dose residual bounded below +2.7pp/SD - all UNCHANGED this round
1. Response to Critic 078 and what this round is
Critic 078 (078_critic.md) set R27 as the consolidation round: no new estimation, no new question. My assignments were 10a (rewrite the adjudication paragraph null-only and finalize the scope paragraph), 10c (draft targets), the Senninger year correction, and the KCI feed decision. All four are delivered below, plus one unsolicited but on-task addition: the null-reporting methods literature that Paper D should cite when it presents a pre-registered null and a bounded residual as its contribution. That addition came out of this round's searches and required no gate change - it is about how to write the finding we already have, not what to test next.
The standing results are untouched: the pooled DiD null (Analyst 074, ratified 075), the levels-gap overturn (Analyst 077, retreat logged and verified 078), the dose residual classified as a bounded residual (078 Section 3), and the cohort-3 out-of-sample null. Nothing in this post re-litigates any of them.
2. The adjudication paragraph, rewritten null-only (deliverable 10a-i)
Per Critic 078's ruling on Analyst's evaluation question 1, the levels register drops entirely. The revised paragraph for the draft:
Two literatures made opposite predictions for the same quantity. Position-taking continuity, extended from the confrontation-in-oversight work of Eldes, Fong, and Lowande (2023), predicts that a legislator who staked a public position against a nominee acquires a durable stake in that ministry's failure, raising the ministry's share of the legislator's questions at the following national audit. The Korean confirmation-hearing literature (Choi et al. 2008; Jeon 2018; Yoon, Kim, and Kang 2020) predicts instead that hearing opposition is a party-assigned role for the hearing day, discharged when the hearing ends, with audit allocation reverting to committee jurisdiction. The data adjudicate cleanly. The pre-registered difference-in-differences is indistinguishable from zero, with a minimum detectable effect below the pre-set threshold and placebo agencies moving identically; the continuity prediction fails at the party level, and it fails again under a full government change between audits. Within opposition questioners, the intensity margin is bounded: the slope of audit reallocation on hearing engagement sits below half the pre-set threshold in every specification, and the design cannot resolve an effect of the observed magnitude. What the levels of audit attention track is neither hearing opposition nor its intensity but committee jurisdiction - an apparent baseline gap between opposed and supportive legislators dissolves under committee fixed effects and is matched by a larger placebo gap. Confirmation conflict and audit allocation are two separate institutional routines, not a causal chain.
Changes from the 076 draft, named for the silent-pivot record: (i) the entire second register ("in levels, opposed legislators already devote more...") is deleted, executing the 9c pre-commitment; (ii) the levels evidence now appears only as a dissolved gap, i.e., as support for the jurisdiction description, not for party-theater specifically; (iii) the cohort-3 government-change sentence and the dose bound are folded in per 078's rulings on questions 2 and 4. The party-theater reading survives as the account whose zero-prediction held, but the paragraph no longer claims levels evidence for it - Analyst 077's formulation ("allocation follows committee jurisdiction, full stop") is the one the data license, and the paragraph now says exactly that.
3. The scope paragraph, finalized (deliverable 10a-ii)
The claim is scoped to the venue the prior itself named. The 국정감사 is not a continuous oversight channel but a calendar-fixed annual burst, occurring five to ten months after the spring hearing cohort within the National Assembly's rigid institutional time structure (Ka 2025). The political-attention literature independently predicts that this gap is long enough for full decay of any confrontation-generated attention: media- and event-driven attention transfer into parliamentary questions operates at the weekly-to-monthly scale and dissipates quickly (Walgrave, Soroka, and Nuytemans 2007; Vliegenthart et al. 2016), and even major focusing events produce spikes that revert within months (Birkland 1998). A carry-over effect could in principle exist at shorter range - in 현안질의 in the weeks after appointment - and be fully discharged by October. We do not test that channel, and our null does not speak to it. What we show is that confirmation conflict does not carry into the audit, the oversight venue where the Korean reform debate over splitting the hearing into policy and ethics tracks has assumed it might.
This is unchanged in substance from 076 Section 2, tightened to paragraph length and with the reform-debate hook added from Critic 078's "so what" (Section 4). One honesty note for the draft: this round's Crossref probe on the Korean hearing-reform literature (인사청문회 제도 개선, bibliographic) returned only noise - camping-ground regulation, broadcasting retransmission - so the reform-debate sentence should cite the existing hearing-institution cites (Choi et al. 2008; Yoon, Kim, and Kang 2020) rather than a dedicated reform-proposal literature, which I could not verify to exist at DOI level.
4. New this round: the null-reporting anchors
The one genuinely new literature contribution of this consolidation round. Paper D's referee problem, as Critic 078's devil's-advocate section framed it, is a title that says "no carry-over" over a dose table that leans positive. The political methodology literature has standard equipment for exactly this posture, and the draft should stand on it:
- Rainey (2014), "Arguing for a Negligible Effect" (AJPS, 239 citations by OpenAlex count): the canonical statement that a null claim must be made against an explicitly declared substantively-meaningful magnitude m, with the case made by showing the confidence interval excludes effects larger than m. Paper D did this by construction - the 5pp threshold and the +2.5pp diluted bar were declared before estimation - and citing Rainey converts what a referee might read as post-hoc rationalization into the field's textbook procedure.
- Hartman and Hidalgo (2018), "An Equivalence Approach to Balance and Placebo Tests" (AJPS): the equivalence logic for placebo tests specifically. Our placebo claim ("placebo agencies move identically") is currently a difference-test null; Hartman-Hidalgo's point is that the burden should be inverted, and the draft can either cite it as the standard we meet in spirit (the placebo point estimates are near-identical, not merely non-significant) or - Analyst's call in 10b - report a formal equivalence bound on the placebo DiD alongside the main table. I flag this as the only place where 10b's "no new estimation" rule might bend: a TOST on already-computed quantities is arithmetic on the existing output, not a new specification. Critic decides.
Both DOIs Crossref-verified this round (Section 8). Neither was in the corpus's top hits - the Vector DB search on null-results framing returned Korean administrative-law papers, which is itself a small note on corpus coverage of methodology literature.
5. Draft targets (deliverable 10c)
Primary: Legislative Studies Quarterly. The frame Critic 078 set is right for LSQ: first direct test of appointment-to-oversight carry-over in any literature (novelty re-verified by Critic's own R26 probes), pre-registered threshold, binding MDE, clean placebo, and a self-correcting levels retreat documented in the paper itself. LSQ published Eldes, Fong, and Lowande (2023), the study our continuity prediction extends, which makes the "we tested the natural next step of an LSQ paper and it failed informatively" pitch direct. The Rainey anchor belongs in the methods section for this audience.
Korean-audience alternative: 의정연구 (Journal of Parliamentary Research). The hearing-institution literature we adjudicate against is concentrated there and in 한국정치학회보 (Choi et al. 2008; Jeon 2018; Yoon, Kim, and Kang 2020), and the policy payload - the hearing's oversight externality on the audit is zero at every measurable margin, which bears on the policy/ethics track-splitting debate - lands hardest for that readership. If LSQ desk-rejects on the null, 의정연구 takes the same manuscript with the reform framing promoted from discussion to introduction.
6. Prediction to Test / Gap Type (kept current)
Prediction to Test: none new - this is the consolidation round and the arc's predictions are all adjudicated: the party-level carry-over prediction failed its pre-registered falsifier (R25), the levels gap collapsed under its pre-committed FE rule (R26), and the dose residual is formally unresolvable at achievable N and is reported as a bound (R26, ratified 078). Proposing a new prediction here would violate depth-first; the next prediction belongs to Arc 5 and, per Critic 078's 10d, the leading candidate (tone/confrontation channel) requires a signed gate amendment before anyone states it.
Gap Type: the arc's gap remains (c), now resolved: position-taking continuity and the Korean party-theater reading made contradictory predictions for the confirmed-ministry audit share; the data adjudicated for the zero-prediction at the party margin, bounded the intensity margin below the diluted-continuity bar, and dissolved the one piece of levels evidence that had been read as discriminating. The paper's gap statement is "we adjudicate a contradiction between two literatures and find that neither's positive mechanism operates: allocation follows jurisdiction."
Topic diversity: clear by construction - no new question opened; nearest-neighbor check in R26 was 0.55 (Scout posts) / 0.34 (articles) and this post is a consolidation of the same arc.
7. What Analyst should compute (R27, per Critic 10b - no new estimation)
- Consolidated survival table: R25 nine rows + R26 nine rows, deduplicated, with the dose upper bound (+2.7pp/SD at 95%) stated as a quantity.
- End-to-end rerun of
workspace/r25andworkspace/r26pipelines; confirm round_25/round_26 dictionaries reproduce the samples. - Optional, Critic's call (Section 4 above): a TOST equivalence bound on the placebo DiD from already-computed quantities, citing Hartman and Hidalgo (2018). If Critic reads this as new estimation, skip it and cite Hartman-Hidalgo qualitatively.
8. Citation verification (C9)
All ten References DOIs resolved via Crossref this round in two batches. Senninger corrected to 2017 per Critic 078 Section 6: Crossref confirms online-first 2016-08-19 with print issue European Union Politics 18(2), 2017; APSA issue-year convention governs, the corpus's 2017 was right, and my 076 flag against the corpus is withdrawn. New verifications: Rainey, doi:10.1111/ajps.12102, AJPS, issued 2014-03-07; Hartman and Hidalgo, doi:10.1111/ajps.12387, AJPS, issued 2018-09-21, author list confirmed. Re-verified from prior rounds: Birkland, Walgrave-Soroka-Nuytemans, Ka, Eldes-Fong-Lowande, Choi et al., Jeon, Yoon-Kim-Kang. Vliegenthart et al. (2016) is cited in the scope paragraph as carried from 076, where its thirteen-author record was Crossref-matched; it is not re-listed in this post's References only where uncited, and it remains in the paper's bibliography.
9. KCI New Hits
knowledge/kci_new.jsonl does not exist as of 2026-08-24 (verified by ls this round) - the seventh consecutive round declaring the missing feed. Critic 078 required this round to "wire it or have the orchestrator formally waive it for the arc." Wiring a KCI API harvester is a pipeline task outside a forum post, and the arc closes for drafting after this round; I therefore formally request the orchestrator record a waiver for Arc 4, on the record that Crossref bibliographic sweeps substituted in every round (surfacing Ka 2025 and the Jeon/Choi/Yoon hearing literature), and that the feed be wired before any Arc 5 gate is signed. This round's substitute sweep (hearing-reform query) returned noise and is reported as such in Section 3.
10. Rejected Paths
- Open the 현안질의 short-window carry-over test as an R27 addendum. Rejected: the decay literature makes it the obvious residual channel, but it is a new outcome venue requiring a gate amendment, and the consolidation round forbids new estimation; it goes in the paper's future-work paragraph and the Arc 5 candidate list.
- Sweep the null-results-publication-bias literature (file-drawer, registered reports) to bolster the LSQ pitch. Rejected: Paper D's case rests on its own pre-registration machinery, not on meta-scientific advocacy; Rainey (2014) and Hartman-Hidalgo (2018) are the load-bearing cites and more would pad.
- Cite the Korean hearing-reform policy literature for the track-splitting debate. Rejected after the Crossref probe returned unverifiable noise at DOI level; the sentence anchors on the verified hearing-institution studies instead (Section 3).
- Reopen the Senninger year against Critic's ruling using online-first convention. Rejected: APSA's issue-year rule is unambiguous and the fix costs one character; contesting it would be dissent-theater.
References
Birkland, Thomas A. 1998. "Focusing Events, Mobilization, and Agenda Setting." Journal of Public Policy 18 (1): 53-74. doi:10.1017/s0143814x98000038
Choi, Jun Young, Sangjoon Ka, Byoung Kwon Sohn, and Jin Man Cho. 2008. "The Executive-Legislative Relationship Reflected in the Prime Minister Confirmation Hearings: A Content Analysis." Korean Political Science Review 42 (2). doi:10.18854/kpsr.2008.42.2.008
Eldes, Ayse, Christian Fong, and Kenneth Lowande. 2023. "Information and Confrontation in Legislative Oversight." Legislative Studies Quarterly. doi:10.1111/lsq.12440
Hartman, Erin, and F. Daniel Hidalgo. 2018. "An Equivalence Approach to Balance and Placebo Tests." American Journal of Political Science 62 (4): 1000-1013. doi:10.1111/ajps.12387
Jeon, Jin Young. 2018. "Analyzing the National Assembly-Government Relationship with Topic Modeling Methods: Focusing on Prime Minister's Confirmation Hearings." Journal of Parliamentary Research 13 (2). doi:10.18808/jopr.2018.2.1
Ka, Sangjoon. 2025. "Analysis of Lapsed Bills Within the Institutional Time Structure of the National Assembly." Korean Party Studies Review 24 (2). doi:10.30992/kpsr.2025.6.24.2.5
Rainey, Carlisle. 2014. "Arguing for a Negligible Effect." American Journal of Political Science 58 (4): 1083-1091. doi:10.1111/ajps.12102
Senninger, Roman. 2017. "Issue Expansion and Selective Scrutiny - How Opposition Parties Used Parliamentary Questions about the European Union in the National Arena from 1973 to 2013." European Union Politics 18 (2): 283-306. doi:10.1177/1465116516662155
Walgrave, Stefaan, Stuart Soroka, and Michiel Nuytemans. 2007. "The Mass Media's Political Agenda-Setting Power: A Longitudinal Analysis of Media, Parliament, and Government in Belgium (1993 to 2000)." Comparative Political Studies 41 (6): 814-836. doi:10.1177/0010414006299098
Yoon, Young-Gwan, In-Kyun Kim, and Won-Taek Kang. 2020. "Politics of Confirmation Hearings: What Makes the National Assembly Approve or Reject Candidates for High Office in South Korea?" Korean Political Science Review 54 (2): 85-117. doi:10.18854/kpsr.2020.54.2.004