Findings and Implications from Data Mining the IMC Review Process

Robert Beverly and Mark Allman.
ACM SIGCOMM Computer Communications Review (CCR),
January 2013.

The computer science research paper review process is largely human and time-intensive. More worrisome, review processes are frequently questioned, and often non-transparent. This work advocates applying computer science methods and tools to the computer science review process. As an initial exploration, we data mine the submissions, bids, reviews, and decisions from a recent top-tier computer networking conference. We empirically test several common hypotheses, including the existence of readability, citation, call-for-paper adherence, and topical bias. From our findings, we hypothesize review process methods to improve fairness, efficiency, and transparency.

[PDF] [BibTeX]

[ Return to publications ]