Dear researchers: Is AI all you've got? - Austin Z. Henley

Austin Z. Henley

I build tools for people

austin.henley@microsoft.com

@austinzhenley

github/AZHenley

Home |<br>Publications |<br>Teaching |<br>Blog

Dear researchers: Is AI all you've got?

2/22/2026

This is a draft of my upcoming article in the Dear Researchers column in the Journal of Systems and Software (JSS). I'm a co-editor of the column, and we invite industry practitioners to contribute articles addressed to researchers about practical challenges in technology transfer. Email me if you're interested!

What important problems have software engineering researchers abandoned so that they could focus on AI instead?

In the early 1900s, bacteriophage therapy was a popular topic in medical and biological research for its potential to target specific bacteria1. However, after the discovery of penicillin in 1928, the research community shifted its attention to antibiotics, mostly abandoning bacteriophage research by the 1950s2. Interest surged again in the 2000s as antibiotic resistance grew more common and the highly targeted nature of phage therapy became more appealing3.

Is a similar phenomenon happening in the software engineering community? Are researchers over-indexing on AI? At ICSE '25, one-third of research-track papers and two-thirds of industry-track papers involved AI. In contrast, a study of research trends from 1992 to 2016 in software engineering did not even include AI or ML in the top-10 most popular topics4. Furthermore, AI conferences have grown exponentially, with AAAI going from 9000 submissions in 2022 to 29,000 submissions for the 2026 conference.

What might be missed?

My concern is not that AI doesn't have considerable value (I have worked on AI in both academia and industry) or that it isn't a huge innovation for the field, but rather that other topics are important too. What innovations might we miss? What problems will continue to go unsolved? What daily pain points exist beyond AI?

As software engineers build highly distributed systems, architectural and implementation decisions play a critical role in system resilience. In 2025, we saw several significant outages from Google Cloud, AWS, Azure, Cloudflare, and Cloudflare again. It felt like the entire internet was down! These outages impacted Spotify, Discord, ChatGPT, Zoom, Venmo, Reddit, Amazon, LinkedIn, Shopify, Fortnite, Square, banks, airlines, and even brick-and-mortar retailers.

Given that approximately 20% of all websites use Cloudflare and that AWS, Azure, and GCP account for 62% of the global cloud infrastructure, this is of huge concern. The AWS outage was estimated to have cost businesses upwards of $581 million dollars in just 15 hours and one of the Cloudflare outages to have cost $300 million dollars in less than 4 hours. In fact, I argue that it is a global catastrophe waiting to happen and we have seen repeated warning signs, yet I do not see researchers flocking to solve the problem as if lives depend on it. Has AI dramatically increased the reliability of software?

From my experience in industry, most recently at a startup that went through an acquisition, the problems we faced were fundamentally human problems. For example, convincing business partners, customers, and lawyers that our software does what we say that it does and that it won't have major disruptions was a huge challenge that we spent considerable time on. AI allowed us to scale faster, but it did not help us convince others to trust our system.

Looking over the keynote talks from ICSE and FSE leading up to the release of ChatGPT in late 2023, we can remind ourselves of the topics that were once top of mind for researchers: software safety, reliability, runtime monitoring, testing, industry impact, software engineering education, research rigor and reproducibility, socio-technical coordination, ethics and privacy, environmental impacts, etc. Several of these talks are relevant to the global cloud outages we have been experiencing, such as Marsha Chechik's keynote at FSE 2022 on the safety and reliability of software. Unfortunately, it seems that her call to action was not enough.

Follow the incentives

But perhaps there are innovations out there that we aren't even thinking about. Clayton Christensen, in his seminal book, Innovator's Dilemma5, argues that as fields mature, they often optimize and sustain existing innovations while also overlooking novel, disruptive innovations. He goes on to state that disruption often begins in places that others dismiss as too small, too immature, or too orthogonal, which are the exact areas that risk being neglected when AI becomes the default answer to every research question.

A straightforward explanation for why researchers would jump on the AI bandwagon lies in incentives. There has been an incredibly strong force pulling everyone into AI, including funding agencies asking for AI-related proposals, conferences adding multiple topics in AI...