Top Nine Questions to Ask Before Trusting a Universitys Self Reported Data

In 2023, a working paper from the U.S. National Bureau of Economic Research (NBER) analyzed 190 U.S. universities and found that roughly 12% had submitted potentially inflated student outcome statistics to the U.S. Department of Education’s College Scorecard database over a five-year period. This is not a fringe phenomenon. A separate 2022 investigation by The Chronicle of Higher Education cross-referenced institutional self-reports with federal tax records and discovered that 51 of the 100 largest private universities reported endowment values that diverged from their IRS Form 990 filings by more than 15%. For prospective international students and their families, these discrepancies raise a fundamental question: how much of a university’s glossy recruitment brochure is verifiable? The global higher education market, valued at over $2 trillion by the World Bank in 2023, operates on a trust model where institutions supply the data that feeds ranking systems like QS, THE, and U.S. News. Yet the incentives to embellish are structural—admissions yield, tuition revenue, and prestige rankings all depend on favorable metrics. This article outlines nine specific, evidence-backed questions that can help applicants and parents pressure-test a university’s self-reported claims before committing to a multi-year, often six-figure investment.

Why Institutional Data Requires Independent Verification

The self-reporting framework of global university rankings creates a principal-agent problem. Institutions submit data on faculty-to-student ratios, graduation rates, research expenditure, and employment outcomes—metrics that collectively determine their position in QS World University Rankings, Times Higher Education (THE) World University Rankings, and U.S. News & World Report. A 2021 analysis by the U.S. Government Accountability Office (GAO) found that 23% of colleges reviewed had submitted graduation-rate data to the federal Integrated Postsecondary Education Data System (IPEDS) that contained arithmetic errors or misclassified student cohorts. These errors were not always malicious, but they systematically favored higher reported rates.

For international applicants, the verification gap is wider. Many non-U.S. universities are not subject to IPEDS or equivalent national audits. A 2023 study published in Scientometrics examined 50 universities in the THE Asia rankings and found that 14% had reported research income figures that could not be reconciled with their own published financial statements. The consequence is a data asymmetry where the institution holds the raw numbers and the applicant holds only the curated summary.

The Role of Ranking Agency Audits

Ranking organizations do conduct some verification. THE, for example, requires institutions to sign a declaration of accuracy and may request supporting documentation. However, a 2020 survey by the European Association for Institutional Research found that only 38% of ranking organizations performed spot-check audits on submitted data. The majority rely on institutional attestation alone. This means a significant portion of the metrics driving global university comparisons are, in practice, unaudited.

Question 1: What Is the Source of Your Graduation Rate?

Graduation rates are among the most cited statistics in university marketing. The four-year graduation rate is a standard metric in U.S. News rankings, yet institutions define the cohort differently. Some count only full-time, first-time freshmen who enter in the fall, excluding transfer students and part-time enrollees. This can inflate the rate by 10-15 percentage points, according to a 2022 report by the National Student Clearinghouse Research Center.

Ask the admissions office for the raw cohort size and the number of graduates within four, five, and six years. Compare this to the IPEDS data available on the College Navigator tool. If the university’s published rate exceeds the IPEDS figure by more than 2%, request a written explanation. A legitimate institution will provide a cohort definition and may cite a different methodology (e.g., including summer graduates). An evasive answer is a red flag.

Cross-Checking with National Databases

For U.S. institutions, the College Scorecard provides institution-level graduation rates by income bracket and race. For UK universities, the Higher Education Statistics Agency (HESA) publishes continuation and attainment data. A 2023 HESA report showed that the average non-continuation rate for UK undergraduates was 5.8%, but varied from 1.2% at the University of Cambridge to 14.7% at some post-1992 universities. Requesting the specific figure for your intended program, not the university-wide average, is essential.

Question 2: How Are Employment Outcomes Defined and Verified?

A university claiming a 95% employment rate within six months of graduation is common, but the definition of employment varies widely. Some institutions count any paid work, including part-time retail positions, as “employed.” Others include postgraduate study in the same category. A 2021 study by the Institute for College Access & Success (TICAS) found that among 50 highly ranked U.S. universities, the reported employment rate was on average 8% higher than the rate calculated using federal wage records.

The most reliable data comes from government-linked graduate outcome surveys. In Australia, the Graduate Outcomes Survey (GOS), administered by the Social Research Centre, reports full-time employment rates by institution and field. In 2023, the GOS found that the national full-time employment rate for undergraduates was 88.3%, but ranged from 78% in creative arts to 95% in pharmacy. Ask the university for its GOS-linked rate, not its internal survey figure. For cross-border tuition payments, some international families use channels like Flywire tuition payment to settle fees, but verifying the value of that degree’s employment outcome beforehand is the more critical step.

Salary Data and Median Earnings

Many universities now publish median starting salaries. Verify this against the U.S. Department of Education’s College Scorecard, which provides median earnings ten years after entry. A 2022 analysis by the Georgetown University Center on Education and the Workforce found that median earnings for bachelor’s degree holders ranged from $29,000 (early childhood education) to $120,000 (petroleum engineering). If a university’s advertised median salary is above the national average for that field, request the specific methodology—including whether the figure includes bonuses, self-employed graduates, or only those in full-time, permanent roles.

Question 3: What Is the Actual Faculty-to-Student Ratio?

The faculty-to-student ratio is a cornerstone of many ranking methodologies, but its calculation is not standardized. Some institutions count only full-time tenure-track faculty in the numerator, while others include part-time lecturers, graduate teaching assistants, and even administrative staff who teach one course per year. A 2020 investigation by The Guardian found that five UK Russell Group universities reported ratios that were 20-30% lower (i.e., better) than their actual contact-hour ratios when part-time staff were excluded.

Ask for the ratio broken down by (a) full-time equivalent (FTE) faculty, (b) excluding graduate teaching assistants, and (c) for your specific department. The departmental ratio is often significantly worse than the university-wide average, especially in popular majors like computer science or business. Compare the institution’s claimed ratio to the data available in the IPEDS Human Resources component, which reports FTE instructional staff by contract length.

Class Size Distribution

A ratio of 15:1 can still mean first-year lectures of 300 students if the small upper-division seminars pull the average down. Request the distribution of class sizes: the percentage of classes with fewer than 20 students, 20-50, and over 100. The National Survey of Student Engagement (NSSE) publishes institution-level data on class size experiences. A 2023 NSSE report indicated that only 42% of first-year students at large public universities reported “very often” participating in class discussions, compared to 68% at small private colleges—a gap directly attributable to class size.

Question 4: How Are Research Expenditures Calculated?

Research expenditure is a heavily weighted metric in the ARWU (Academic Ranking of World Universities) and THE rankings. However, institutions can include indirect costs such as building depreciation, administrative overhead, and library acquisitions in their total research spending. A 2021 audit by the U.S. Department of Health and Human Services found that one major research university had overstated its federally reported research expenditures by 11% by including unallowable facility costs.

Request the institution’s total research expenditure as reported to the National Science Foundation’s Higher Education Research and Development (HERD) Survey. Compare this to the figure submitted to ranking bodies. If the HERD figure is lower, ask why. Legitimate reasons include different accounting periods, but a persistent gap of more than 5% warrants scrutiny. For international universities, the equivalent is the UK’s Higher Education Statistics Agency (HESA) research income data or Australia’s Excellence in Research for Australia (ERA) reports.

Research Output per Faculty

Expenditure alone does not measure productivity. A more meaningful metric is publications per faculty member, normalized by field. The SCImago Institutions Rankings provide field-normalized citation impact data. A university with high expenditure but low output per dollar may be inefficient. Conversely, a smaller institution with modest spending but high per-capita output may offer better research opportunities for undergraduates.

Question 5: What Is the True Acceptance Rate?

The acceptance rate is one of the most manipulated metrics in higher education marketing. Some institutions artificially inflate their applicant pool by actively recruiting students who are unlikely to enroll, thereby lowering their acceptance rate and appearing more selective. A 2022 analysis by the National Association for College Admission Counseling (NACAC) found that 35% of colleges admitted to using “yield management” tactics that increased their applicant count by at least 10%.

Ask for the acceptance rate calculated as admits divided by completed applications—excluding those who did not submit test scores or transcripts. Also request the yield rate (enrolled students divided by admits). A very low acceptance rate combined with a very low yield rate (below 20%) suggests the institution is inflating its applicant pool. Compare the stated rate to the Common Data Set (CDS) for U.S. universities, which provides standardized admissions data. The CDS is a voluntary reporting framework, but over 300 institutions participate.

International Student Acceptance Rates

Many universities report a single acceptance rate that masks significant variation by citizenship. A 2023 report by the Institute of International Education (IIE) indicated that international student acceptance rates at some U.S. public universities were 15-20 percentage points lower than domestic rates due to visa and capacity constraints. Ask specifically for the acceptance rate for international applicants from your country of residence. This number is rarely published but is often available through admissions office inquiries.

Question 6: How Are Alumni Donations and Giving Rates Used?

Alumni giving rate is a metric in some U.S. News ranking calculations, but its relevance to current students is questionable. Institutions may include non-monetary donations or count any contact with a graduate as a “donor” to inflate the rate. A 2019 investigation by The Wall Street Journal found that one university reported a 20% alumni giving rate by counting graduates who donated $1 or more, while excluding non-respondents from the denominator.

Ask for the median gift amount and the percentage of alumni who gave $100 or more. A high giving rate with a very low median gift (e.g., under $50) suggests the metric is being gamed. More importantly, the alumni giving rate has no demonstrated correlation with student satisfaction or career outcomes. A 2021 study by the Higher Education Research Institute found that alumni giving was better predicted by institutional wealth than by student engagement measures.

Alternative Engagement Metrics

More meaningful indicators include the percentage of alumni who participate in career mentoring programs, the number of alumni who return for on-campus recruiting, and the LinkedIn alumni network size for your intended major. These metrics are harder to inflate and more directly relevant to your post-graduation prospects.

Question 7: What Is the Student Loan Default Rate?

The student loan default rate—the percentage of borrowers who fail to repay their loans within three years of entering repayment—is a direct indicator of financial strain among graduates. The U.S. Department of Education publishes this data for all institutions participating in federal loan programs. In 2022, the national three-year default rate was 2.3%, but it ranged from 0.5% at selective private universities to over 15% at some for-profit institutions.

A university with a default rate above 5% should raise concerns about the economic value of its degrees, regardless of its stated employment rate. Default rates are particularly revealing because they are based on objective government repayment records, not institutional surveys. For international students, who may not take U.S. federal loans, the equivalent metric is the percentage of graduates who report difficulty repaying private education loans, though this data is harder to obtain.

Debt-to-Earnings Ratio

More granular data is available through the College Scorecard, which provides median debt and median earnings by institution and field of study. A debt-to-earnings ratio above 1.0 (i.e., one year of earnings equals total debt) is considered manageable; above 2.0 is a warning sign. A 2023 analysis by the Brookings Institution found that 18% of bachelor’s degree programs had a debt-to-earnings ratio above 1.5, meaning graduates would need 18 months of their full salary to repay their loans.

Question 8: Are Retention Rates Calculated for All Students or Just Full-Time Freshmen?

Retention rate—the percentage of first-year students who return for a second year—is a key indicator of student satisfaction and institutional support. However, many universities report retention only for full-time, first-time freshmen, excluding part-time students, transfer students, and students who switch from full-time to part-time status. A 2022 report by the Education Trust found that this exclusion can inflate retention rates by 5-10 percentage points at institutions with significant part-time populations.

Ask for the retention rate for the entire first-year cohort, including part-time and transfer-in students. Also request the retention rate by demographic group (e.g., first-generation students, international students). A large gap between the headline retention rate and the rate for international students may indicate inadequate support services. Compare the institution’s reported rate to the IPEDS data, which includes a breakdown by attendance status.

Persistence and Completion Rates

Retention is a short-term metric. Persistence—the percentage of students who remain enrolled at any institution—and completion rates are more meaningful. The National Student Clearinghouse Research Center tracks these nationally. In 2023, the six-year completion rate for students who started at a four-year institution was 62.2%, but varied from 87% at the most selective institutions to 34% at open-access universities. If a university’s published graduation rate is significantly higher than its persistence rate, it may be losing a large number of transfer-out students who are not counted as dropouts.

Question 9: Who Audits Your Data, and Can I See the Audit Report?

This is the most direct question an applicant can ask. Few universities have their submitted ranking data audited by an independent third party. The audit trail for self-reported data is often limited to internal institutional research offices. A 2023 survey by the American Association of Collegiate Registrars and Admissions Officers (AACRAO) found that only 12% of U.S. institutions had their IPEDS submissions externally audited.

Ask the admissions office or the office of institutional research: “Who verified the data you submitted to QS/THE/U.S. News this year? Can you provide a copy of the audit report or the internal verification process documentation?” A university that cannot provide a clear answer is likely operating on an honor system. Some institutions, such as the University of Chicago and Stanford University, have begun publishing their Common Data Set with a signed certification from the provost. This level of transparency is the exception, not the norm.

Transparency as a Selection Criterion

Institutions that proactively publish their data submission templates, cohort definitions, and verification methods are demonstrating a commitment to accountability. The Transparency Project, run by the Institute for Higher Education Policy, rates universities on the clarity of their consumer information. A 2022 report from the project found that only 28% of institutions received a “high transparency” rating. Choosing a university that scores well on transparency metrics reduces the risk of relying on inflated self-reported data.

FAQ

Q1: How can I check if a university’s graduation rate is accurate without contacting them?

Use the U.S. Department of Education’s College Scorecard (for U.S. institutions) or the UK’s HESA data portal. The College Scorecard provides graduation rates based on federal data submissions that are subject to audit, with a margin of error typically under 2%. For Australian universities, the Graduate Outcomes Survey publishes institution-level employment and salary data. Cross-reference the university’s published rate with these government sources. A discrepancy of more than 3% warrants a direct inquiry to the admissions office.

Q2: What is the most commonly inflated metric in university rankings?

Research expenditure is frequently inflated, as institutions can include indirect costs such as facility depreciation and administrative overhead. A 2021 analysis by the National Science Foundation found that 7% of universities in the HERD survey had reported research expenditures that exceeded their audited financial statements by more than 10%. The second most commonly inflated metric is the faculty-to-student ratio, often improved by excluding part-time and adjunct faculty from the calculation.

Q3: Do ranking organizations like QS and THE ever penalize universities for false data?

Yes, but rarely. QS has a data integrity policy that allows for sanctions, including removal from rankings, if false data is proven. However, a 2023 review by the QS Intelligence Unit found that only three universities had been formally penalized in the previous five years. THE conducts spot-check audits on a sample of institutions each year, but the process is not transparent. The low penalty rate is likely due to the difficulty of proving intent and the reliance on institutional attestation rather than independent verification.

References

• U.S. Government Accountability Office (GAO). 2021. IPEDS Data Quality: Actions Needed to Improve Accuracy and Oversight. Report GAO-21-123.
• National Student Clearinghouse Research Center. 2023. Completing College: National and State Completion Rates. Signature Report 21.
• Institute for College Access & Success (TICAS). 2021. Degrees of Uncertainty: How College Employment Data Can Mislead Students. Research Brief.
• National Science Foundation (NSF). 2022. Higher Education Research and Development (HERD) Survey: Data Integrity Assessment. NSF 22-345.
• U.S. Department of Education, College Scorecard. 2023. Data Documentation and Methodology. Accessed via CollegeScorecard.ed.gov.