Manuscript
Polarization metrics in online discourse
Quantitative · Q1 target · Reviewer mode
Integrated risk postureHIGH
Dense signal view for cross-metric disagreement, methodological visibility, generalizability, and reproducibility gaps.
5critical
6major
4minor
Reviewer Mode
Labels and locations
Reviewer mode removes the explanatory layer and keeps the signal vocabulary, evidence location, inference type, and surfacing rationale visible in one scan.
| Section | Severity | Label | Inference | Evidence | Why it surfaces |
|---|---|---|---|---|---|
| 1 | Low | PLATFORM_SCOPE_CONCLUSION_GAP | Obs. | Methods: one platform, four-month window; conclusion discusses "online discourse" generally. | Scope boundary stated once but not repeated near the claim it bounds. |
| 2 | Medium | CONSTRUCT_ASSUMPTION_STACKING_VISIBILITY | Obs. | Three metric definitions, each in its own subsection, no shared comparison table. | Distributed assumptions obscure where the constructs diverge. |
| 3 | Critical | NETWORK_STABILITY_ASSUMPTION_DECLARED_NOT_TESTED | Obs. | "Assumes a stable interaction graph"; no edge-turnover or stability statistic reported. | A prerequisite assumption is stated but not tested. |
| 3 | Medium | BOT_FILTERING_THRESHOLD_UNDERJUSTIFIED | Obs. | Fixed cutoff used; no cited benchmark or sensitivity check. | The threshold cannot be read as conservative, liberal, or externally justified. |
| 3 | Low | SAMPLE_WINDOW_JUSTIFICATION_BRIEF | Obs. | Window stated; no justification for why that period was chosen. | Representativeness cannot be assessed from the manuscript alone. |
| 4 | Critical | CROSS-METRIC_DISCREPANCY_DESCRIBED_AS_CONVERGENCE | Obs. | Affective 0.61, issue-based 0.34, network-based 0.58; "converge on a consistent picture." | The numerical pattern and prose characterization conflict. |
| 4 | Medium | CONVERGENCE_CLAIM_PRECEDES_LARGEST_EXCEPTION | Obs. | "Converge" stated first; the 0.34 outlier appears after as secondary detail. | The sentence structure downplays the largest exception. |
| 5 | Medium | CONFIDENCE_INTERVAL_REPORTING_INCONSISTENT | Obs. | Bootstrap 95% CI in one table, standard error in another, neither in a third. | Cross-table comparison requires knowing whether interval conventions match. |
| 6 | Medium | HEDGING_ASYMMETRY_CONVERGENCE_CLAIM | Obs. | "Converge" stated flatly; all other claims in the section carry qualifiers. | The least qualified claim sits beside the largest internal disagreement. |
| 7 | Low | ABSTRACT_BODY_COHERENCE | Obs. | Policy claim stated in abstract; reasoning appears only in the final discussion paragraph. | An abstract-only reader receives the claim without its support. |
| 8 | Critical | SINGLE_PLATFORM_WINDOW_GENERALIZABILITY_UNDECLARED | Obs. | Single platform, four-month window; conclusion claims about "social media discourse" generally. | The conclusion travels beyond what the dataset can support. |
| 8 | Low | PLATFORM_ALGORITHM_CHANGE_CONFOUND_UNQUANTIFIED | Obs. | Algorithm change mid-window noted as "likely confound"; no effect estimate given. | A named confound remains interpretively open. |
| 9 | Medium | FIGURE_3_SHADED_REGION_UNDEFINED | Obs. | Shaded band around the combined indicator; no caption or legend defines what it represents. | The visual uncertainty cue is not defined. |
| 10 | Critical | DATA_AVAILABILITY | Obs. | No repository, platform-data-sharing statement, or on-request clause for the underlying dataset. | One verification route is absent. |
| 10 | Critical | CODE_AVAILABILITY | Obs. | Three metric-computation pipelines described, none linked to a repository. | The metric comparison cannot be independently reconstructed from code. |