Panos Ipeirotis

Panagiotis G. Ipeirotis
Παναγιώτης Ηπειρώτης
Born (1976-05-03) May 3, 1976[3]
CitizenshipGreek, American
AwardsLagrange Prize (2015)[1]
ACM SIGKDD Test of Time Award (2020)[2]
Academic background
Alma materUniversity of Patras (BSc)
Columbia University (MSc, PhD)
ThesisClassifying and Searching Hidden-Web Text Databases (2004)
Doctoral advisorLuis Gravano
Academic work
DisciplineComputer science
InstitutionsNew York University Stern School of Business
Main interestsCrowdsourcing; human computation; Data quality; Text mining
Websitebehind-the-enemy-lines.com

Panagiotis G. Ipeirotis (also known as Panos Ipeirotis; born May 3, 1976, in Serres, Greece) is a Greek-American computer scientist and the Merchants' Council Professor of Technology and Business at the New York University Stern School of Business.[5][6] His research focuses on data mining, crowdsourcing, human computation, and the economics of online information systems.[7]

Ipeirotis received the Lagrange Prize in Complex Systems (2015)[1] and the ACM SIGKDD Test of Time Award (2020).[2] His research on Amazon Mechanical Turk and crowdsourcing quality management has been discussed in publications including The New York Times, The Economist, and Bloomberg Businessweek.[8][9][10]

In addition to his academic career, Ipeirotis co-founded the AI consulting firm Detectica in 2015, which was acquired by Compass, Inc. in 2019.[11] He has also held research positions at Google (2013–2014), where he conducted research on crowdsourcing methods to improve the Google Knowledge Graph,[12][13] and at Meta's Reality Labs division (2024–2025), where he worked on machine learning deployment for wearable devices.[5][14] Ipeirotis also authors the blog "A Computer Scientist in a Business School," which has been cited in media coverage.[15][16]

Early life

Ipeirotis was born on May 3, 1976, in Serres, Greece.[4] In 1994, he won a Gold Medal at the 8th National Greek Competition in Chemistry.[17] Later that year, he represented Greece at the 26th International Chemistry Olympiad in Oslo, Norway.[18]

Education

Ipeirotis earned his Diploma in Computer Engineering and Informatics (CEID) from the University of Patras in 1999.[5] He pursued graduate studies at Columbia University under the supervision of Luis Gravano, receiving his M.Sc. in 2001, M.Phil. in 2003, and Ph.D. in Computer Science in 2004.[5]

Academic career

Ipeirotis began his academic career as a graduate research assistant at Columbia University (1999–2004). In 2004, he joined the Department of Information, Operations, and Management Sciences at the New York University Stern School of Business as an Assistant Professor. He was promoted to Associate Professor in 2010 and Full Professor in 2016. He holds a courtesy appointment at the Courant Institute of Mathematical Sciences[19] and is an associated faculty member at the NYU Center for Data Science.[20]

Ipeirotis has served as Program Co-Chair for the 13th ACM Conference on Electronic Commerce in 2012,[21] as General Co-Chair of the AAAI Conference on Human Computation and Crowdsourcing (HCOMP) in 2015,[22] and as Technical Program Co-Chair for The Web Conference 2018 (WWW 2018).[23] He has served on the editorial boards of Management Science and IEEE Transactions on Knowledge and Data Engineering, and was a founding co-Editor-in-Chief of the journal Collective Intelligence launched in 2022 as a collaboration between SAGE Publications, the Association for Computing Machinery, and Nesta.[24][25]

His research has been discussed in publications such as The New York Times,[8][26] The Economist,[9] Bloomberg Businessweek,[10] The Wall Street Journal,[27] Financial Times,[28] MIT Technology Review,[29] and TIME.[30][31][32] In 2013, Bloomberg Businessweek profiled him as the "data dude" of business analytics.[33] He has also been profiled in Greek media, including a 2014 interview with Kathimerini discussing Greek higher education and his career.[34]

Academic lineage and doctoral students

Ipeirotis completed his PhD at Columbia University under the supervision of Luis Gravano, himself a student of Hector Garcia-Molina at Stanford. According to the Mathematics Genealogy Project, Ipeirotis has advised seven doctoral students at NYU and Columbia.[35]

His former students include Beibei Li, now a professor at Carnegie Mellon University's Heinz College and recipient of the 2019 INFORMS ISS Sandra A. Slaughter Early Career Award,[36] and Marios Kokkodis, recipient of the 2020 INFORMS ISS Gordon B. Davis Young Scholar Award.[37] Former postdoctoral researcher Djellel Difallah is now Assistant Professor and Program Head at New York University Abu Dhabi and previously served as a Research Scientist at the Wikimedia Foundation.[38]

Research

Ipeirotis's work explores the intersection of computer science and economics, an approach he and collaborators have termed "EconoMining." His research has been published in venues such as Management Science, Information Systems Research, and IEEE Transactions on Knowledge and Data Engineering.[5]

Crowdsourcing and human computation

Ipeirotis has published research on Amazon Mechanical Turk (MTurk). His 2010 paper "Running Experiments on Amazon Mechanical Turk,"[39] co-authored with Gabriele Paolacci and Jesse Chandler, provided methodological guidance for using crowdsourcing platforms in behavioral research.

In 2010, his studies revealing that approximately 40% of tasks posted by new requesters on MTurk involved spam or low-quality content received media coverage.[30][29][32][31] His 2010 demographic analysis of the MTurk workforce provided early data on worker motivations, geographic distribution, and income levels, and has been cited by researchers studying crowdsourcing platforms.[40][41] In 2018 and 2019, media outlets continued to cite Ipeirotis's research on MTurk data quality as concerns about automated responses on the platform grew.[42][26] This line of work led to the development of quality management techniques for crowdsourcing, including the "Get Another Label" framework for improving data quality using multiple noisy labelers, which received the SIGKDD Test of Time Award in 2020.[2]

His research on crowdsourcing best practices also influenced journalism; ProPublica published a "Guide to Mechanical Turk" for investigative reporters that drew on Ipeirotis's research and blog posts, citing his work on data quality through multiple worker verification.[43]

To support this research, Ipeirotis developed "MTurk Tracker," a set of tracking tools for the MTurk platform. The first tool tracked workforce demographics using capture-recapture techniques to estimate the size and composition of the workforce in near real-time. The second tool periodically downloaded all tasks posted on the platform, enabling analysis of the crowdsourcing marketplace's size and activity; Amazon eventually blocked this tracker. The Pew Research Center's 2016 report "Research in the Crowdsourcing Age" drew on data from the task tracker, explicitly crediting "the online tool mturk-tracker, which is run by Dr. Panagiotis G. Ipeirotis."[44][45]

During a 2013–2014 sabbatical at Google, Ipeirotis co-developed "Quizz," a gamified crowdsourcing system for improving the Google Knowledge Graph. The system presented data collection as trivia quizzes targeted by domain expertise, using calibration questions with known answers to assess user reliability in real-time.[12][46]

Data quality and record linkage

Ipeirotis has published research on duplicate record detection and data quality. His 2007 survey "Duplicate Record Detection: A Survey" in IEEE Transactions on Knowledge and Data Engineering, co-authored with Ahmed Elmagarmid and Vassilios Verykios, has been cited in the database research community.[47]

Online reputation and user-generated content

His collaborative work with Anindya Ghose on the economic value of textual content in product reviews quantified the pricing power derived from user-generated content.[48] A related 2011 study demonstrated that the quality of spelling and grammar in product reviews significantly affects perceived helpfulness and product sales.[49] This finding was discussed in Forbes, Harvard Business Review, Slate, and Freakonomics.[50][51][52][53]

Applied research and industry

Early industry work (2009–2014)

Beginning in 2009, Ipeirotis served as an early advisor to Integral Ad Science (originally AdSafe Media), contributing to the development of machine learning systems for detecting inappropriate web content and advertising fraud.[54] In 2011, working with AdSafe engineers, he uncovered a click fraud scheme that used hidden iframes to generate fraudulent ad impressions, which he termed "traffic laundering."[55] The investigation, which estimated the scheme generated hundreds of thousands of dollars monthly, was reported by The Wall Street Journal and MIT Technology Review and led to an FBI referral.[27][55]

In 2011, Ipeirotis co-founded Tagasauris, a media annotation startup where he served as Chief Scientist until 2013.[33] The company combined crowdsourcing with semantic graph technology to tag photo archives. A notable accomplishment was the discovery of approximately two dozen "lost" photographs from the 1973 filming of "American Graffiti" in the Magnum Photos archive; the system identified the photos by using crowdworkers to tag individuals and machine learning to connect them via shared film appearances.[56][57]

He also served as Academic-in-Residence at Upwork (then oDesk) in 2012 and as a Visiting Scientist at Google from 2013 to 2014.[5]

Policy research and World Bank

In 2015, Ipeirotis collaborated with the World Bank on a report titled "The Global Opportunity in Online Outsourcing," which examined the potential of digital labor markets to provide employment pathways in developing nations.[58] Drawing on his empirical research from Mechanical Turk and oDesk, the report estimated the online outsourcing market would grow to $15–25 billion by 2020 and identified barriers preventing workers in the Global South from accessing these jobs, including lack of reliable internet infrastructure and the "reputation cold start" problem. The report has been cited in subsequent policy frameworks by the International Labour Organization and the RAND Corporation.[59]

Detectica and Compass (2015–2022)

In 2015, Ipeirotis co-founded Detectica with Foster Provost and Josh Attenberg, offering AI strategy consulting and machine learning solutions for business applications.[60] The company developed AI-driven compliance monitoring systems for financial institutions. Prior to founding Detectica, the team had designed and built the founding data science architecture for Integral Ad Science.[60]

Detectica was acquired by Compass, Inc. in November 2019.[11] At Compass, the Detectica team developed "Likely to Sell," a predictive analytics system that identifies properties likely to enter the market; the company cited the tool as a significant revenue contributor in earnings calls.[61][62]

Public engagement and pedagogy

Academic integrity debates

In July 2011, Ipeirotis published a blog post titled "Why I will never pursue cheating again," describing his experience using Turnitin software to detect that about 20 percent of the students in his roughly 100-person "Information Technology in Business and Society" course had plagiarized.[63] The post criticized the administrative burden placed on faculty who enforce academic integrity policies and went viral.[64] Ipeirotis temporarily removed the post after a complaint alleged potential violations of the Family Educational Rights and Privacy Act (FERPA) due to included student communications.[64] Business Insider reported that Ipeirotis said his student evaluations declined after the plagiarism cases, costing him part of his annual raise;[65] NYU Stern vice dean Ingo Walter responded that faculty are not penalized for enforcing academic integrity and that student evaluations from such cases are excluded from review.[63] The incident prompted discussion about academic integrity enforcement, faculty incentives, and student privacy.[63][64] The case was subsequently cited in Nature in a 2012 commentary on plagiarism detection in academia.[66]

Security vulnerability discovery

In April 2012, Ipeirotis accidentally discovered a vulnerability in Google Spreadsheets that he termed a "Denial of Money" attack. While running a crowdsourcing experiment that required image classification, he uploaded 25,000 image URLs (hosted on his Amazon S3 bucket) into a Google Spreadsheet. Google's Feedfetcher bot aggressively re-downloaded all images from his S3 bucket every time the spreadsheet was processed, generating massive outgoing bandwidth. Ipeirotis reported receiving an Amazon Web Services bill of $1,177.76—approximately ten times his normal monthly rate.[67]

The incident highlighted a novel attack vector: a malicious actor could create a Google Sheet with thousands of links to a victim's large files, causing Google's servers to repeatedly request the files, resulting in either financial damage or a denial of service. The discovery was covered in technology publications including Wired and The Economist.[68][67][69][70] Amazon subsequently forgave the charges, and Google investigated the behavior.[67]

AI-powered assessment

In December 2025, Ipeirotis developed an AI-driven oral examination system using ElevenLabs voice agents to address concerns about students using generative AI tools to submit assignments while lacking deeper understanding. The system, which cost approximately $0.42 per student to administer, used a voice AI agent to call students and ask personalized questions about their submitted work.[71][72]

Awards and honors

  • 2020: ACM SIGKDD Test of Time Award for Research (with Foster Provost and Victor S. Sheng). The Test of Time Award honors papers from approximately ten years prior that have had lasting impact on the field of knowledge discovery and data mining. The award recognized their 2008 paper "Get Another Label? Improving Data Quality and Data Mining Using Multiple, Noisy Labelers" "for their approach to selective acquisition of multiple labels."[2]
  • 2018: Selected as one of "45 under 45" Greek scientists producing the highest-impact publications worldwide by the Greek newspaper Kathimerini. The recognition identified researchers born after 1974 whose work ranks in the top 0.1% globally by citations.[73][74]
  • 2015: Lagrange Prize in Complex Systems (shared with Jure Leskovec), awarded by the CRT Foundation and ISI Foundation. The prize recognized Ipeirotis's "pioneering work in the field of crowdsourcing and human computation" and research "[combining] economic, social psychology and automatic text analysis methods to quantify the economic value of the content generated by users on the Internet."[1][75]
  • 2014: Best Paper Award, Second AAAI Conference on Human Computation and Crowdsourcing (HCOMP), for "STEP: A Scalable Testing and Evaluation Platform".[76][77]
  • 2014: INFORMS Information Systems Society (ISS) Best Paper Award (Management Science), for "Deriving the Pricing Power of Product Features by Mining Consumer Reviews" (2011).[78]
  • 2012: Google Focused Research Award ($1.5 million), with Serge Belongie and Pietro Perona.[79]
  • 2011: Best Paper Award, 20th International World Wide Web Conference (WWW 2011), for "Towards a Theory Model for Product Search".[80]
  • 2007: National Science Foundation CAREER Award (Grant IIS-0643846), "Towards a Text-Centric Database Management System."[81]
  • 2006: Best Paper Award, ACM International Conference on Management of Data (SIGMOD 2006) — "To Search or to Crawl? Towards a Query Optimizer for Text-Centric Tasks".[82]
  • 2005: Best Paper Award, 21st IEEE International Conference on Data Engineering (ICDE 2005), for "Modeling and Managing Content Changes in Text Databases".[83]

Selected publications

  • Sheng, Victor S.; Provost, Foster; Ipeirotis, Panagiotis G. (2008). Get another label? Improving data quality and data mining using multiple, noisy labelers. Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. doi:10.1145/1401890.1401965. (KDD Test of Time Award, 2020)
  • Paolacci, Gabriele; Chandler, Jesse; Ipeirotis, Panagiotis G. (2010). "Running experiments on Amazon Mechanical Turk". Judgment and Decision Making. 5 (5): 411–419. doi:10.1017/S1930297500002205.
  • Ghose, Anindya; Ipeirotis, Panagiotis G. (2011). "Estimating the helpfulness and economic impact of product reviews: Mining text and reviewer characteristics". IEEE Transactions on Knowledge and Data Engineering. 23 (10): 1498–1512. doi:10.1109/TKDE.2010.188.
  • Archak, Nikolay; Ghose, Anindya; Ipeirotis, Panagiotis G. (2011). "Deriving the pricing power of product features by mining consumer reviews". Management Science. 57 (8): 1485–1509. doi:10.1287/mnsc.1110.1370.
  • Elmagarmid, Ahmed K.; Ipeirotis, Panagiotis G.; Verykios, Vassilios S. (2007). "Duplicate record detection: A survey". IEEE Transactions on Knowledge and Data Engineering. 19 (1): 1–16. doi:10.1109/TKDE.2007.250581.

References

  1. ^ a b c "Press Release: Lagrange Prize 2015". ISI Foundation. 2015-10-06. Archived from the original on 2015-10-06. Retrieved 2025-12-22.
  2. ^ a b c d "2020 SIGKDD Test of Time Award Winners". ACM SIGKDD. Retrieved 2025-12-22.
  3. ^ "Panagiotis G. Ipeirotis". ORCID. Retrieved 2026-02-12.
  4. ^ a b "Πάνος Ηπειρώτης: Ο Σερραίος καθηγητής που διαπρέπει στη Νέα Υόρκη" [Panos Ipeirotis: The Serres-born professor excelling in New York]. Aveserres.gr (in Greek). 2025-04-11. Retrieved 2026-02-04.
  5. ^ a b c d e f "NYU Stern - Panagiotis Ipeirotis - Merchants' Council Professor of Technology, Operations, and Statistics". www.stern.nyu.edu. Retrieved 2025-12-22.
  6. ^ "TOPS | Full-time Faculty - NYU Stern". www.stern.nyu.edu. Retrieved 2025-12-22.
  7. ^ Ghose, Anindya; Ipeirotis, Panagiotis (2009). "The EconoMining project at NYU: Studying the economic value of user-generated content on the internet". Journal of Revenue and Pricing Management. 8 (2–3): 241–246. doi:10.1057/rpm.2008.56. S2CID 154923072.
  8. ^ a b Segal, David (2011-05-22). "A Rave, a Pan, or Just a Fake?". The New York Times. Retrieved 2026-02-04.
  9. ^ a b "Turks of the World, Unite!". The Economist. 2011-05-24. Retrieved 2026-02-04.
  10. ^ a b Weise, Karen (2011-11-10). "Humans Plus Computers Equals Better Crowdsourcing". Bloomberg Businessweek. Archived from the original on 2014-11-09. Retrieved 2026-01-27.
  11. ^ a b "Real-Estate Brokerage Compass Buys AI Startup Detectica". The Wall Street Journal. 2019-11-19. Retrieved 2025-12-22.
  12. ^ a b Ipeirotis, Panagiotis G.; Gabrilovich, Evgeniy (2014). Quizz: targeted crowdsourcing with a billion (potential) users. Proceedings of the 23rd International Conference on World Wide Web. ACM. pp. 143–154. arXiv:1506.01062. doi:10.1145/2566486.2567988.
  13. ^ Tan, Chun How; Agichtein, Eugene; Ipeirotis, Panos; Gabrilovich, Evgeniy (2014). Trust, but verify: predicting contribution quality for knowledge base construction and curation. Proceedings of the Seventh ACM International Conference on Web Search and Data Mining. ACM. pp. 553–562. doi:10.1145/2736277.2741681.
  14. ^ "CCI Seminar Series 2024-25: Panos Ipeirotis". MIT Center for Collective Intelligence. Retrieved 2026-02-02.
  15. ^ "A Computer Scientist in a Business School". Behind the Enemy Lines. Retrieved 2025-12-22.
  16. ^ Agger, Michael (2011-05-10). "Awsum Shoes!". Slate. ISSN 1091-2339. Retrieved 2025-12-22.
  17. ^ "8η Ολυμπιάδα Χημείας" [8th Chemistry Olympiad]. Χημικά Χρονικά (Chemical Chronicles) (in Greek). 56 (8): 233. 1994. Archived from the original (PDF) on 2026-02-13. Retrieved 2026-02-02.
  18. ^ "26th IChO 1994 Results". International Chemistry Olympiad. Archived from the original on 2026-01-10. Retrieved 2026-02-02.
  19. ^ "Faculty". NYU Courant Institute of Mathematical Sciences. Retrieved 2025-12-22.
  20. ^ "Associated Faculty". NYU Center for Data Science. Retrieved 2025-12-22.
  21. ^ "13th ACM Conference on Electronic Commerce". 13th ACM Conference on Electronic Commerce. Retrieved 2026-02-05.
  22. ^ "HCOMP 2015: Organizers". AAAI Conference on Human Computation and Crowdsourcing. Retrieved 2026-01-31.
  23. ^ "Research Tracks CFP – TheWebConf 2018". The Web Conference 2018. Retrieved 2026-01-31.
  24. ^ "Editorial Board". Collective Intelligence. SAGE Publications. Retrieved 2026-01-31.
  25. ^ "SAGE, Association for Computing Machinery Announce Collective Intelligence, New Open Access Journal in Collaboration with Nesta". Association for Computing Machinery. 2020-08-18. Retrieved 2026-01-31.
  26. ^ a b Newman, Andy (2019-11-15). "I Found Work on an Amazon Website. I Made 97 Cents an Hour". The New York Times. Retrieved 2026-02-04.
  27. ^ a b "Off Screen, Porn Sites Trick Advertisers". The Wall Street Journal. 2011-03-18. Retrieved 2026-01-31.
  28. ^ "Something for the Weekend". Financial Times. 2011-10-28. Retrieved 2026-02-04.
  29. ^ a b Mims, Christopher. "How Mechanical Turk is Broken". MIT Technology Review. Archived from the original on 2011-12-12. Retrieved 2025-12-22.
  30. ^ a b Walsh, Bryan (2011-01-31). "On Crowdsourcing: Pennies for Your Thoughts". TIME. Archived from the original on 2018-08-10. Retrieved 2026-02-03.
  31. ^ a b Rosenwald, Michael S. (2011-01-30). "How you and Google are losing the battle against spam in search results". The Washington Post. ISSN 0190-8286. Retrieved 2025-12-22.
  32. ^ a b "40% Of Amazon's Mechanical Turk Is Spam". Business Insider. 2010-12-17. Retrieved 2025-12-22.
  33. ^ a b "The Data Dude: NYU Stern's Panos Ipeirotis". Bloomberg Businessweek. 2013-01-24. Retrieved 2026-02-04.
  34. ^ "Παναγιώτης Ηπειρώτης: «Θαυμάζω όσους παράγουν έργο στα πανεπιστήμια με τις συνθήκες που επικρατούν»" [Panagiotis Ipeirotis: "I admire those who produce work in universities under the prevailing conditions"]. Kathimerini (in Greek). 2014-07-21. Retrieved 2026-02-03.
  35. ^ "Panagiotis Ipeirotis - Mathematics Genealogy Project". Mathematics Genealogy Project. Retrieved 2026-02-03.
  36. ^ "ISS Sandra A. Slaughter Early Career Award". INFORMS. Retrieved 2026-02-03.
  37. ^ "ISS Gordon B. Davis Young Scholar Award". INFORMS. Retrieved 2026-02-03.
  38. ^ "Djellel Difallah". NYU Abu Dhabi. Retrieved 2026-02-03.
  39. ^ Paolacci, Gabriele; Chandler, Jesse; Ipeirotis, Panagiotis G. (2010). "Running experiments on Amazon Mechanical Turk". Judgment and Decision Making. 5 (5): 411–419. doi:10.1017/S1930297500002205. ISSN 1930-2975.
  40. ^ Ipeirotis, Panagiotis G. (2010). "Demographics of Mechanical Turk". NYU Stern School of Business. Retrieved 2026-02-04.
  41. ^ Fort, Karën; Adda, Gilles; Cohen, K. Bretonnel (2011). "Amazon Mechanical Turk: Gold Mine or Coal Mine?". Computational Linguistics. 37 (2). MIT Press: 413–420. doi:10.1162/COLI_a_00057.
  42. ^ Dreyfuss, Emily (2018-08-17). "A Bot Panic Hits Amazon Mechanical Turk". Wired. Retrieved 2026-02-03.
  43. ^ "ProPublica's Guide to Mechanical Turk". ProPublica. 2010. Retrieved 2026-02-03.
  44. ^ "Methodology: Mechanical Turk". Pew Research Center. 2016-07-11. Retrieved 2026-02-04.
  45. ^ "The size of the Mechanical Turk marketplace". Pew Research Center. 2016-07-11. Retrieved 2026-02-04.
  46. ^ Slawski, Bill (2014-08-25). "Good Bye Knowledge Graph, Hello Google Knowledge Vault?". Go Fish Digital Blog. Retrieved 2026-02-04.
  47. ^ Elmagarmid, Ahmed K.; Ipeirotis, Panagiotis G.; Verykios, Vassilios S. (2007). "Duplicate Record Detection: A Survey". IEEE Transactions on Knowledge and Data Engineering. 19 (1): 1–16. doi:10.1109/TKDE.2007.250581. ISSN 1558-2191.
  48. ^ Archak, Nikolay; Ghose, Anindya; Ipeirotis, Panagiotis G. (2011). "Deriving the Pricing Power of Product Features by Mining Consumer Reviews". Management Science. 57 (8): 1485–1509. doi:10.1287/mnsc.1110.1370. ISSN 0025-1909.
  49. ^ Ghose, Anindya; Ipeirotis, Panagiotis G. (2011). "Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics". IEEE Transactions on Knowledge and Data Engineering. 23 (10): 1498–1512. doi:10.1109/TKDE.2010.188. ISSN 1558-2191.
  50. ^ Savitz, Eric (2011-06-08). "Zapos, Zappoz, or Zappos: Why Typos Are Good For Your Brand". Forbes. Archived from the original on 2011-07-11. Retrieved 2025-12-22.
  51. ^ "The Value of Teaching Your Customers How to Spell". Harvard Business Review. 2011-05-26. Archived from the original on 2013-07-18. Retrieved 2025-12-22.
  52. ^ Agger, Michael (2011-05-10). "Awsum Shoes!". Slate. ISSN 1091-2339. Retrieved 2025-12-22.
  53. ^ "Does Reviewer Quality Matter?". Freakonomics. 2011-04-12. Retrieved 2025-12-22.
  54. ^ "About Us". Detectica. Retrieved 2026-01-31. Panos served as an early advisor of Integral Ad Science.
  55. ^ a b Mims, Christopher (2011-03-21). "A Web Scam That Makes $500,000 a Month". MIT Technology Review. Retrieved 2026-01-31.
  56. ^ "Hidden Treasure: Lost Photos From the Set of American Graffiti". Wired. 2011-07-01. Retrieved 2026-02-03.
  57. ^ Mims, Christopher (2011-06-20). "How Six Degrees of Kevin Bacon Unearthed Lost Photos From American Graffiti". MIT Technology Review. Retrieved 2026-02-03.
  58. ^ "The Global Opportunity in Online Outsourcing". World Bank Open Knowledge Repository. 2015. Retrieved 2026-02-03.
  59. ^ "Online Outsourcing: Prospects for Increasing Youth Employment and Reducing Poverty in Indonesia". RAND Corporation. Retrieved 2026-02-03.
  60. ^ a b "Detectica - Enabling organizations to adopt effective AI strategies". Techweek. 2019-12-19. Retrieved 2025-12-22.
  61. ^ "Compass, Inc. (COMP) Q4 2021 Earnings Call Transcript". The Motley Fool. 2022-02-17. Retrieved 2025-12-22. In 2021, $151 million gross commission revenue was from listings that the likely to sell tool recommended to our agents before the listing was created. We expect this number to exceed $400 million in 2022.
  62. ^ "Compass, Inc. (COMP) Q1 2023 Earnings Call Transcript". The Motley Fool. 2023-05-09. Retrieved 2025-12-22. Since launching in 2020, we have handed out millions of recommendations that be attributed more than $100 million of annual incremental revenue to these recommendations over each of the last two years.
  63. ^ a b c Jaschik, Scott (2011-07-22). "Who Is Punished for Plagiarism?". Inside Higher Ed. Retrieved 2026-01-31.
  64. ^ a b c Parry, Marc (2011-07-21). "NYU Prof Vows Never to Probe Cheating Again—and Faces a Backlash". The Chronicle of Higher Education. Retrieved 2026-01-31.
  65. ^ "NYU Professor Catches 20% of His Students Cheating, And He's The One Who Pays For It". Business Insider. 2011-07-20. Retrieved 2026-02-03.
  66. ^ "Science publishing: How to stop plagiarism". Nature. 481 (7378): 21–23. 2012-01-04. doi:10.1038/481021a. Retrieved 2026-02-04.
  67. ^ a b c McMillan, Robert (2012-04-27). "Oops! Amazon Web Services Customer Unleashes 'Denial of Money' Attack – on Himself". Wired. Retrieved 2026-02-04.
  68. ^ "Twice shy, once bitten". The Economist. 2012-05-28. Retrieved 2026-02-04.
  69. ^ Bort, Julie (2012-04-30). "An Amazon Customer Accidentally Ran Up A $1,200 Bill In Just 10 Minutes". Business Insider. Retrieved 2026-02-04.
  70. ^ "Accidentally invented – Dos attack using Google Spreadsheets". The Hacker News. 2012-04-28. Retrieved 2026-02-04.
  71. ^ ""An NYU professor who hates that students' work reads like McKinsey memos held AI oral exams to 'fight fire with fire'"". Business Insider. 2026-01-05. Retrieved 2026-01-31.
  72. ^ Bastian, Matthias (2026-01-06). "NYU professor fights AI cheating with AI-powered oral exams that cost 42 cents per student". The Decoder. Retrieved 2026-01-31.
  73. ^ "Έλληνες στην κορυφή της επιστήμης" [Greeks at the Top of Science]. Kathimerini (in Greek). 2018. Retrieved 2026-02-03.
  74. ^ "Professor Panos Ipeirotis is Recognized as One of '45 Under 45' Greek Scientists Producing Highest-Impact Publications". NYU Stern. Retrieved 2026-02-02.
  75. ^ "Research Highlight: Panos Ipeirotis - 2015 CRT Foundation Lagrange Prize". NYU Stern. Retrieved 2026-01-31.
  76. ^ "Past Meetings". AAAI Conference on Human Computation and Crowdsourcing. Retrieved 2025-12-22.
  77. ^ Christoforaki, Maria; Ipeirotis, Panagiotis (2014-11-05). STEP: A Scalable Testing and Evaluation Platform. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing. Vol. 2. AAAI.
  78. ^ "Management Science—2014 Best Paper Awards". Management Science. INFORMS. 2015-01-15. doi:10.1287/mnsc.2014.2122. Retrieved 2025-12-22.
  79. ^ "$1.5 Million Google Research Grant Awarded to Professor Panos Ipeirotis & Colleagues". NYU Stern. 2013-02-22. Retrieved 2025-12-22.
  80. ^ "The Twentieth International WWW Conference (WWW 2011) – Best Paper Award". International World Wide Web Conference Archives (IW3C2). Retrieved 2025-12-22.
  81. ^ "Award Search: Award #0643846 – CAREER: Towards a Text-Centric Database Management System". National Science Foundation. Retrieved 2025-12-22.
  82. ^ "SIGMOD Best Paper Award". ACM SIGMOD. Retrieved 2025-12-22.
  83. ^ "ICDE 2005 Best Paper Awards". 21st IEEE International Conference on Data Engineering. Retrieved 2025-12-22.