Last updated: 2026-09-25

U
Undergraduate level

Funding Blue-Sky Research to Survive the Trough

Does a Research Field Sleep? shows AI research surviving two winters because specific foundational work — Werbos's backpropagation thesis, Pearl's Bayesian networks, LeCun's early convolutional networks, Vapnik's statistical learning theory — kept going while public attention and applied funding collapsed. The obvious lesson to draw is that state-sponsored blue-sky research is what survives a Trough that commercially-funded work doesn't. That lesson is too simple, and the same history that supports it also refutes it: the funding cuts that triggered both AI winters were themselves government decisions. State money isn't a reliable exemption from the Hype Cycle. One agency's own history shows both sides of this at once.

DARPA's Two Faces

The Advanced Research Projects Agency, founded in 1958, funded the packet-switching research that became the ARPANET starting in the mid-1960s — J.C.R. Licklider's early vision, Bob Taylor's 1966 project, Larry Roberts's network design, the first host-to-host connection in 19691. There was no product, no near-term application, and no public narrative demanding results; it took decades for that research to become anything resembling the internet the term now describes. That's blue-sky funding working as advertised: a specific programme, evaluated by a programme manager against technical milestones, on a horizon long enough that no Hype Cycle had time to form around it at all.

The same agency's Speech Understanding Research funding was cut in the mid-1970s, directly contributing to the first AI winter Does a Research Field Sleep? describes. Same agency, same broad funding mandate, opposite outcome. Whatever explains the difference, it isn't "government-funded" versus "not."

What Actually Made the Difference

The Lighthill Report is the sharpest illustration of the actual mechanism. James Lighthill's 1973 review, commissioned by the UK's Science Research Council specifically to inform funding decisions, concluded that "in no part of the field have the discoveries made so far produced the major impact that was then promised"2 — and that single report drove a near-decade collapse in UK academic AI funding. This is a Trough-of-Disillusionment correction happening at the level of national science policy: one committee's revised model of the field's utility, produced under exactly the kind of small-sample, hype-inflated extrapolation the second-order framing describes, propagating into a funding decision that affected an entire country's research base at once.

Japan's Fifth Generation Computer Systems project shows the same mechanism with an even more explicit publicity input. MITI committed roughly ¥54 billion over 1982–1992, framed from the outset as a national-prestige project — establishing Japan as a technologically advanced, internationally contributing nation, not just building a computer3. Tying a research programme's justification to national competitive standing makes public sentiment about that standing the publicity input driving the whole project's Hype Cycle. When the parallel-inference-machine approach was overtaken by conventional CPU improvements, the correction was as total as the ambition had been.

Contrast this with the ARPA/DARPA funding model's better-documented mode: mission-oriented programmes with a specific technical goal, a programme manager given real authority to run it, and continuation decisions made against that programme's own technical milestones rather than the political mood about the field as a whole4. Whether a given pot of research money survives a Trough doesn't depend on whether the government or a company wrote the cheque. It depends on whether that money's continuation is coupled to the same hyped narrative currently cycling through the field, or evaluated against something else entirely.

The Deeper Lesson: Diversity of Evaluation, Not Source of Funding

Once the mechanism is stated that way, it's a specific case of a much more general principle. Harry Markowitz's foundational result in portfolio theory is that combining assets whose risks aren't correlated reduces the portfolio's overall risk below any individual asset's own risk, precisely because a shock that hits one holding doesn't automatically hit an uncorrelated one5. A field's research funding is a portfolio in exactly this sense: Werbos's Harvard thesis, Bell Labs' internal signal-processing work, Pearl's book, Vapnik's statistical learning programme, and DARPA's SUR funding were not one asset, but the crash that hit SUR didn't automatically hit the others, because their continuation wasn't tied to the same evaluative narrative SUR's was tied to. Scott Page's independent result from collective problem-solving is the same principle from a different angle: groups that bring genuinely different evaluative perspectives to a hard problem systematically outperform groups of highly capable people who all evaluate it the same way6. Connecting Markowitz's uncorrelated-risk result and Page's diversity-of-perspective result to research-funding design specifically is this page's own extension — neither author makes that application themselves.

Bell Labs is the cleanest illustration that the mechanism, not the state/private label, is what's doing the work. Its research budget came from AT&T's regulated telephone monopoly, insulated from quarterly market discipline in a way ordinary commercial R&D isn't, and LeCun's early convolutional-network work was pursued there through the second AI winter on exactly that insulation7. That's not state funding at all — it's a different structural trick producing the identical decoupling from the field's own publicity cycle. Vannevar Bush's 1945 case for federal basic-research funding, which created the US National Science Foundation, and Mariana Mazzucato's more recent argument that state investment underwrites exactly the high-risk, long-horizon work private capital won't89 are both real and don't need correcting. What this page adds is the condition Lighthill and Fifth Generation show that argument leaves out: state funding only supplies the insulation those arguments promise if its own continuation criteria are kept separate from whatever public or political narrative is currently cycling through the field it funds. A single large state programme whose survival depends on one report, one election cycle, or one national-prestige narrative is a single point of failure wearing a government logo, not a diversified portfolio.

A Practical Design Principle

Put in the same terms as Managing the Trough's advice to builders: a funding body should treat a Trough-driven funding review the same way a builder should treat its own Peak-driven overclaiming — as a correction to a model that was never a reliable measure of the underlying research's value in the first place, not as a verdict to act on immediately. Concretely, a resilient research ecosystem needs several independent funding lines evaluated against different criteria and different time horizons, not one well-funded programme whose survival depends on a single narrative remaining favourable — whether that money is a government agency's, a monopoly's regulated profits, or, as it was for CNNs, SVMs, and Bayesian networks alike, a specific researcher simply continuing the work regardless of who was or wasn't paying attention.

References


  1. ARPANET's early history — J.C.R. Licklider's founding vision, Bob Taylor's 1966 project initiation, Larry Roberts's network design, and the first host-to-host connection between UCLA and the Stanford Research Institute on 29 October 1969 — per DARPA's own historical account. https://www.darpa.mil/news/features/arpanet ↩

  2. Lighthill, J. (1973). Artificial Intelligence: A General Survey. In Artificial Intelligence: a paper symposium. Science Research Council. Commissioned by SRC chairman Brian Flowers specifically to inform UK AI funding decisions. ↩

  3. Feigenbaum, E., & Shrobe, H. (1993). The Japanese national Fifth Generation project: Introduction, survey, and evaluation. Future Generation Computer Systems, 9. ↩

  4. Azoulay, P., Fuchs, E. R. H., Goldstein, A., & Kearney, M. (2018). Funding Breakthrough Research: Promises and Challenges of the "ARPA Model." NBER Working Paper No. 24674; also in Innovation Policy and the Economy, Vol. 19 (2019). ↩

  5. Markowitz, H. (1952). Portfolio Selection. The Journal of Finance, 7(1), 77–91. https://doi.org/10.1111/j.1540-6261.1952.tb01525.x ↩

  6. Page, S. E. (2007). The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies. Princeton University Press. ↩

  7. Gertner, J. (2012). The Idea Factory: Bell Labs and the Great Age of American Innovation. Penguin Press. ↩

  8. Bush, V. (1945). Science, The Endless Frontier: A Report to the President. United States Government Printing Office. Led directly to the creation of the US National Science Foundation. ↩

  9. Mazzucato, M. (2013). The Entrepreneurial State: Debunking Public vs. Private Sector Myths. Anthem Press. ↩