Reporters Without Borders published its 2026 World Press Freedom Index last month and declared press freedom at a "25-year low." India was placed 157th out of 180 countries. The headlines wrote themselves. The commentary was predictable. What nobody did — what almost nobody ever does — is read the survey instrument that produces these numbers.
I have. All 88 questions across five pillars. And I can tell you, as someone trained in mathematics and formal logic: the RSF index does not measure press freedom. It measures what a small group of people believe about press freedom. The distinction matters. It is the difference between a thermometer and a guess about the temperature.
Every Single Question Is an Opinion
The RSF methodology rests on a questionnaire sent to selected "experts" — country correspondents, media professionals, researchers, and lawyers chosen by RSF itself. The questionnaire covers five pillars: political context, legal context, economic context, socio-cultural context, and safety.
Here is a representative question from the political context pillar: "Do government officials and other politicians act in a way that guarantees press freedom?" The answer options are: Yes, completely / Yes, somewhat / Not really / Not at all / I don't know.
Here is one from the legal context: "Are the aforementioned laws enforced in a way that safeguards the rights they proclaim?" Same Likert scale. Same subjective framing.
Here is one from the economic context: "Is a significant portion of the media and journalists corrupt?" The answer options include: Not at all / A small portion / A large portion / Yes, completely.
Across 88 questions and approximately 180 sub-questions, there is not a single item that asks for a number. Not one question requests a verifiable fact. No question asks: how many journalists were arrested? How many media outlets operate? What is the internet penetration rate? What is the media ownership concentration ratio? The entire instrument is a structured collection of subjective impressions.
The Formal Logic Problem
In classical logic — as Peter Smith's Introduction to Formal Logic lays out — the validity of an argument depends on whether the conclusion follows necessarily from the premises. The RSF index constructs the following inference:
Premise: An RSF-selected expert believes press freedom in Country X is limited.
Conclusion: Press freedom in Country X IS limited.
This is not a valid deductive inference. The conclusion does not follow from the premise. The expert might be wrong, biased, misinformed, or operating from a framework that defines "press freedom" in ways that systematically disadvantage certain political systems. The inference is, at best, inductively weak — and its weakness compounds when you realise that RSF does not disclose how many experts evaluate each country, does not publish inter-rater reliability scores, does not blind respondents to previous years' rankings, and does not randomise its panel selection.
In formal terms: the argument is unsound. The premises are not established as true. And an unsound argument with a precise-looking numerical output is more dangerous than an openly vague one, because it borrows the authority of quantification without earning it.
The Statistical Problem
Jordan Ellenberg, in How Not to Be Wrong, warns against a specific error: treating imprecise qualitative judgments as though they were precise quantitative measurements. This is exactly what the RSF index does.
When an expert selects "Yes, somewhat" on whether the government guarantees press freedom, RSF converts this into a number. When multiple experts' numbers are aggregated, RSF produces a score to two decimal places. When 180 countries are ranked by these scores, the index implies that the difference between rank 156 and rank 157 is meaningful.
It is not. The conversion from "Yes, somewhat" to a numerical score is arbitrary. The aggregation assumes that different experts' "Yes, somewhat" means the same thing — a heroic assumption that no psychometric validation supports. And the ranking treats ordinal data as interval data, which is a basic statistical category error. As Ellenberg would put it: you cannot manufacture precision. You can only pretend to have it.
The Gatekeeper Fallacy
The RSF framework defines press freedom through the lens of professional journalists and media organisations. Its questions ask about "media outlets," "broadcasters," "editorial boards," and "news editors." This was perhaps defensible in 1985. It is not defensible in 2026.
India has over 900 million internet users. More than 500 million are on social media. The country has the world's cheapest mobile data — under two dollars for a monthly plan that provides unlimited access. There are an estimated 100,000 active YouTube news channels in Indian languages. Every citizen with a smartphone and an internet connection is a publisher.
The RSF framework does not account for this. Its questions about "independent media outlets" and "editorial boards" belong to a world where information flows through institutional gatekeepers. In India's information ecosystem — arguably the largest and most linguistically diverse on Earth — the gatekeepers are being bypassed every second of every day. To measure "press freedom" by asking whether professional journalists feel free is like measuring literacy by asking whether scribes feel employed.
The Palestine Paradox
The internal incoherence of the RSF index is best illustrated by its own results. In 2025, 129 journalists and media workers were killed worldwide, according to the Committee to Protect Journalists. Two-thirds were killed by the Israeli military in Gaza. Palestine experienced the deadliest year for journalists in recorded history.
Yet in the 2026 RSF index, Palestine — a territory where journalists were bombed, starved, and cut off from communications — ranks higher than India, where the state killed zero journalists in the same period. RSF attributes this to a "ceasefire" and improvements in "economic" and "political" indicators.
This is not a minor anomaly. It is a structural failure that reveals what the index actually measures: not the empirical reality of information access or journalist safety, but the ideological conformity of a country's media environment to a particular set of normative assumptions about how governments and media should relate to each other.
What an Empirical Index Would Look Like
A genuine press freedom index — one that would survive scrutiny from a first-year statistics student — would measure things that can be counted, verified, and reproduced. Every indicator would come from public data sources. No expert opinions. No Likert scales. No "I don't know."
Here is what we propose — the IWE Empirical Press Freedom Index, built on five pillars of measurable data:
1. Information Access (20%) — Internet penetration rate (ITU), mobile broadband affordability (Alliance for Affordable Internet), social media users as percentage of population (DataReportal), active news domains per million population (SimilarWeb), and Right to Information request fulfilment rates where available.
2. Media Plurality (20%) — Number of registered media outlets per million population (national regulators), media ownership concentration using the Herfindahl-Hirschman Index, linguistic diversity of news media as a ratio of languages served to languages spoken, and number of community radio stations and citizen journalism platforms per capita.
3. Legal Framework (20%) — Constitutional guarantee of press freedom (binary), existence and functionality of Right to Information law (OECD/national data), defamation regime (civil versus criminal), internet shutdown count and total hours (Access Now), and VPN legality.
4. Safety (20%) — Journalists killed per million population (CPJ verified data), journalists imprisoned per million population (CPJ), impunity rate for journalist murders (UNESCO), and documented physical attacks per million (IFJ/CPJ). All normalised per capita — because a country of 1.4 billion will have more incidents in absolute terms than a country of 5 million, and any index that does not normalise for population is not measuring rates but magnitudes.
5. Digital Freedom (20%) — Government content removal requests per million users (Google, Meta, and X transparency reports), DNS/IP blocking rate (OONI — the world's largest open dataset on internet censorship, with 3 billion measurements from 242 countries), average internet speed (Ookla), and proportion of online content accessible without VPN.
Every one of these indicators is publicly available. Every one can be independently verified. Every one produces a number, not an opinion. And every one can be updated annually by anyone with an internet connection — no hand-picked panel of experts required.
What Changes When You Use Data
Consider what happens when you apply even a few of these metrics to India. Internet penetration: 52 percent and rising rapidly — higher than the global median for its income group. Media outlets: India has over 100,000 registered newspapers and periodicals, more than 900 television channels, and hundreds of thousands of digital news platforms across 22 official languages. Journalists killed by state action in 2025: zero (CPJ data). Internet shutdowns in 2025: 65 — the lowest since 2017, and India is the only major country that legally requires shutdown orders to be published.
None of this means India's information environment is perfect. Sixty-five shutdowns is sixty-five too many by any standard. Media ownership concentration in television is a real concern. Criminal defamation law is archaic and should be reformed. But these are empirical observations that can be measured, tracked, and debated — not the output of an opaque survey sent to an undisclosed panel whose composition and biases RSF never reveals.
The Burden of Proof
In logic, the burden of proof lies with the person making the claim. RSF claims to measure press freedom for 180 countries. The minimum requirements for such a claim are: a transparent methodology, reproducible data, disclosed margin of error, and external validation.
RSF meets none of these requirements. Its methodology converts opinions into numbers. Its data cannot be reproduced because the expert panels are secret. It publishes no confidence intervals. And the only "validation" is that RSF itself declares the results valid.
This is not science. It is not even social science. It is an opinion survey dressed in the language of measurement — and the sooner the world's newsrooms recognise this, the sooner we can build something that actually tells us where information flows freely and where it does not.
IndiaWorldEye will publish the full methodology of the IWE Empirical Press Freedom Index in the coming weeks, along with pilot scores for all 180 countries. We invite researchers, data scientists, and journalists worldwide to scrutinise, critique, and improve it. Unlike the RSF index, ours will be fully open — because a measurement that cannot be checked is not a measurement at all.




