The CCCR 2022 was held as a hybrid in-person and online conference 19–21 April 2022.
Opened by Lord Martin Rees, the conference attracted researchers and policymakers with an interest in global catastrophic risks such as biological threats, artificial intelligence, nuclear war, volcanic eruption and food shortages. Attendees engaged with keynote speakers, panel discussions, workshops and 7 minute lightning talks.
Efforts to prevent nuclear war should be greatly intensified – but we must also consider what happens if prevention fails. NZ is often cited as somewhere most likely to preserve a thriving society through a nuclear aftermath. However, our society is a complex adaptive system heavily dependent on trade. Major perturbations triggered by nuclear war could shift the state of NZ society from one of flourishing to one of mere survival. We detail these risks of societal failure and conclude with a set of first steps NZ could take to strengthen its societal systems.
“I had a dream, which was not all a dream. / The bright sun was extinguish’d, and the stars / Did wander darkling in the eternal space” (Byron ‘Darkness’)
Byron penned what could be a striking vision of nuclear winter 129 years before the atomic age. Holed up in a Swiss mansion during the ‘year without a summer’ following the eruption of Mt Tambora, he composed ‘Darkness’ (1816) on a day in which ‘the fowls went to roost at noon’.
‘Darkness’ imagines the severe cascading calamities that might ensue if the sun were obscured, as following nuclear war. We detailed these potential climate impacts and the consequences for NZ food production in a recent blog post, Putin and the Bomb.
However, in his poem Byron envisions the cascading impacts sun-blocking might have on energy supply, communications, resources, ecology, social cohesion, and conflict. In 1987 the NZ Nuclear Impacts Study examined the potential for similar cascading impacts (Green, Cairns, & Wright, 1987). This study involved 300 industry experts, government officials, a public survey, and role plays with citizens. In 35 years, nothing remotely as sophisticated has been done to update the findings for the NZ context.
Contrary to common misconception, radiation is not a major risk to NZ in a Northern Hemisphere nuclear war. It is commonly assumed that far flung Southern Hemisphere islands like NZ may fare comparatively well. For example, existential risk scholar Toby Ord writes in The Precipice, “if we consider somewhere like NZ… It is hard to see why they wouldn’t make it through with most of their technology (and institutions) intact” (Ord, 2020).
In what follows we question Ord’s assumption, reiterate the salience of nuclear war as a global catastrophic risk, its far-reaching impacts on society and industry and what NZ might do to mitigate the threat, including reprising the work of the 1980s with up-to-date understandings.
“the wildest brutes / Came tame and tremulous; and vipers crawl’d / And twin’d themselves among the multitude, / Hissing, but stingless—they were slain for food”
A typical human needs around 2,100 kcal of food energy per day to avoid losing weight. NZ produces something in the order of 9,500 kcal/capita/day (Schramski, Woodson, Steck, Munn, & Brown, 2019), and exports the majority of this food. Although modelling of severe nuclear winter reported in a preprint indicates NZ food production could fall 58% (Xia et al., 2021), New Zealanders should, in principle, be able to be fed. However, orderly production and distribution of this supply assumes that people understand there will be enough, that there is sufficient energy to maintain production and distribution, that crop substitutions are appropriate, that essential machinery does not irrevocably break down, that unforeseen cascading socio-ecological impacts do not wreak havoc and that the country is not likely to be overcome by refugees.
Covid-19 and the war in Ukraine has taught us that complex interdependent human systems are often fragile – and trade can be vulnerable. Even, when just one ship blocked the Suez Canal, there were global trade disruptions. In a severe nuclear (or volcanic, or asteroid) winter key infrastructure in the Northern Hemisphere may lie in ruin, including ports, airports, fuel stores, fibre optic cables, satellites, factories, and data centres. Food production could collapse in breadbaskets such as the US and Ukraine. This would massively strain a world where two-thirds of countries are currently not food self-sufficient (Schramski et al., 2019). There may be hoarding, reluctance or inability to trade, severe food and fuel shortages, and ongoing conflict.
Research on volcanic eruptions at global ‘pinch points’ indicates that an unfortunately located eruption could disable world trade (Mani, Tzachor, & Cole, 2021). We must assume the same following dozens, scores, or even hundreds of nuclear detonations. Remote NZ may be on its own. At the very least Northern Hemisphere markets could be inaccessible and trade networks with Australia, Indonesia, the Philippines, Chile or Peru would need to be strengthened or forged.
Communications and governance
“And they did live by watchfires—and the thrones, / The palaces of crowned kings—the huts, / The habitations of all things which dwell, / Were burnt for beacons; cities were consum’d”
People will panic. This is natural. But actions hinge on information held. The nuclear impact study in NZ found that people were often mistaken, they thought radiation was the most important threat (46%) followed by cold weather (11%) (Green et al., 1987). This is probably not the case in NZ. Authorities must anticipate and provide clear, relevant information about nuclear winter, with two-way dialogue. We need a shared mental model that there should be enough food, but medicines and fuel might need to be rationed. At the beginning of the Covid-19 pandemic, communication in NZ was very successful, but eventually mis/dis-information crept in, the shared mental model was lost and tension arose.
However, in a nuclear aftermath standard communication by NZ authorities might not be possible. There could be widespread international internet and cloud outages, an electromagnetic pulse (EMP) targeted at Australia could potentially disable electronic equipment in NZ (Green et al., 1987), and over time NZ’s telecommunications infrastructure will likely degrade as parts break down and replacements are not available.
Energy and transport
“Forests were set on fire—but hour by hour / They fell and faded—and the crackling trunks / Extinguish’d with a crash—and all was black”
When considering total generic units of energy, NZ superficially appears self-sufficient (IEA 2021). However, NZ exports low-grade coal but imports refined oil; produces hydroelectric power, but this is partly configured to supply to an aluminium smelter; there is geothermal energy but a small electric vehicle fleet; and a single point of failure (one cable) spans the interisland strait. The system may not be resilient to major shocks. Without trade there would be extreme fuel shortages, compounded as the only oil ‘refinery’ has just shut its refining business. Overseas reserves would be useless without the ability to retrieve them. Even if refining were restored, a single key fault could cripple it again without imported parts and international expertise. The effects of an EMP could make the energy situation worse. Critically, energy is needed for food processing and distribution. Milk needs to be transported every day, without electric trucks this requires refined fuel. The energy system will degrade over time and beyond a certain threshold there could be catastrophic cascading effects throughout every other system.
Conflict and Refugees
“And War, which for a moment was no more, / Did glut himself again… / …The crowd was famish’d by degrees; but two / Of an enormous city did survive, / And they were enemies”
Internal conflict may arise if there are concerns about ongoing supply of food or energy, or if inequality is perceived. People seeking escape from war and famine may try to arrive by force, or bring novel infectious diseases (eg, if bioweapons are released in a Northern Hemisphere conflict). Although NZ is sheltered by a huge natural moat, the country must plan for the possibilities of such challenges. We need to calculate how many can be fed. En masse arrivals may be unlikely in a world without commercial transportation, but NZ’s vulnerability might require alliances with other survivors such as Australia, Indonesia, or Chile.
Ecology and flourishing
“The rivers, lakes and ocean all stood still, / And nothing stirr’d within their silent depths”
Ecological systems are complex adaptive systems with many interacting parts. Models of the impact of nuclear winter cannot account for all variables, and we know that ecological systems sometimes exhibit sudden and unpredictable shifts in state. Algal blooms or tropical storms exemplify these processes. It is possible that severe climate impacts of nuclear winter might disrupt global ecology for decades or forever. Human societies are part of this complex adaptive system (Walker & Salt, 2006). We must understand that as human systems degrade accumulating stresses across a range of tightly coupled and interdependent sectors can manifest as cascading failures (Homer-Dixon et al., 2015). As one of the havens most likely to survive comparatively intact after a nuclear war, NZ must avoid tipping into pre-digital, pre-industrial, or pre-agricultural states. Persisting institutions and technological systems will be needed to help ‘reboot’ a flourishing humanity across the years and decades after a catastrophic nuclear winter.
A possible solution for NZ?
NZ may have some inbuilt cultural resilience especially in Māori and Pasifika communities. Communitarian efforts via marae and other social networks have successfully distributed food and information in the past, such as during the Covid-19 pandemic and Kaikoura earthquake. NZ’s ‘social cohesion’ score is very high. But we can’t take this for granted in an information environment where risks are classified, and misinformation is rife.
Unfortunately, nuclear war matters because it is not improbable. Nuclear safety depends on a system of rational actors, perfect information, and fail proof systems that operate without error in perpetuity. The risk of nuclear war lies in human error, component failures, violent catalysis, irrational leaders, accident, miscalculation, and cyber vulnerabilities (see Nuclear Threat Initiative president Joan Rohlfing’s interview from 24 Feb here).
Nuclear winter especially matters because there is still a small possibility that it could lead to human extinction, not directly, but via cascading effects on food, energy, transport, trade, disease, and conflict. Study of these cascading interdependencies is very neglected.
NZ has a chance to both survive and sustain a thriving hub of complexity through nuclear winter. With promising baseline conditions, there is an argument NZ has an obligation to humanity to maximise its chances. This could be achieved by undertaking the following:
Repeat the 1987 Nuclear Impacts Study in today’s context and prioritise intervention according to experts, science and modelling (see Green et al. 1987 for initial policy suggestions).
Make a detailed local study of food production and distribution under nuclear winter and zero trade/scarce fuel conditions, as well as manage marine stocks to ensure surplus in times of need.
Research and prepare communication materials and plans, with redundancies, collaborate with the public and generate a shared mental model.
Incentivise distributed renewable energy sources, electric vehicle uptake, cycle infrastructure, home insulation, and reduce oil dependence, while maintaining refining capability until zero-oil reached.
Conduct simulations/walk-throughs of critical functions such as restoring systems after an EMP, or storing, rationing, and distributing food, fuel, medicines.
Reduce reliance on Northern Hemisphere export markets by diversifying regionally – particularly with Australia, the Pacific and Southeast Asia.
Study the potential irreplaceable failure points of NZ industry and crowdsource solutions and workarounds, eg, 3D printing.
Model the co-benefits of resilience measures against nuclear winter on climate targets, inequality, health, the economy.
Include nuclear war, nuclear winter, and NZ trade isolation in national risk assessments and make public NZ’s national risk register (the contents of which are currently classified).
Establish a Parliamentary Commissioner for Extreme Risks to provide resource, responsibility and political neutrality for assessing and governing nuclear risks and other extreme risks. We have previously made this case (Boyd & Wilson, 2021).
Research actions NZ might take to increase the chance of rebooting a collapsed global civilization, such as developing local digital manufacturing, renewable energy, and other independent high-tech sectors.
If nuclear war led the world to a collapsed, even pre-industrial state, all the gains in healthcare, life-expectancy, social institutions, and other domains of human endeavour attained in the last 200 years would be at risk. There is no guarantee they would be quickly recovered, and could even be lost forever.
At present nuclear war and winter impacts are much neglected (the word ‘nuclear’ did not appear in the ‘Summary of Public Consultation’ for NZ’s National Security Long-term Insights Briefing 2022). Also, when these type of impacts are examined internationally, there seems to be too much focus on just the climate and food impacts, as opposed to issues such as systems interdependencies, governance and communication. There are knowledge gaps about the dynamic cascading effects of nuclear war. It is inconceivable that any present government could successfully manage this kind of situation. We must build better systems that reduce inherent risks of nuclear war eg, better diplomacy and technical safeguards. Better yet, we should greatly intensify efforts to eliminate nuclear weapons. Until that day, we should nurture the changing mindset around climate change and expand this to all catastrophic risks, so we can anticipate them and be better ancestors.
Risk communication is critical. Citizens need to understand risks and have some concept that solutions are possible. This will encourage cooperation and coordination rather than conflict and degradation of social cohesion. No solution to a major risk will succeed without some degree of social cohesion. This is why the problem of mis/dis-information must be solved in parallel with work on catastrophic risks. No risks, nuclear or otherwise, exist in isolation and many of the measures we suggest above have wide-ranging co-benefits.
* Author details: Dr Boyd is a catastrophic risk researcher and Director of Adapt Research Ltd. He has funding support for work on this topic from the Centre for Effective Altruism’s Long-Term Future Fund. Prof Wilson is with the Department of Public Health, University of Otago, Wellington. Views are the authors’ own.
To enable more content on these topics, please consider donating below the References list.
Boyd, M., & Wilson, N. (2021). Anticipatory Governance for Preventing and Mitigating Catastrophic and Existential Risks. Policy Quarterly, 17(4), 20–31. doi:10.26686/pq.v17i4.7313
Green, W., Cairns, T., & Wright, J. (1987). New Zealand After Nuclear War. Wellington: New Zealand Planning Council.
Homer-Dixon, T., Walker, B., Biggs, R., CrÈpin, A.-S., Folke, C., Lambin, E. F., . . . Troell, M. (2015). Synchronous failure: the emerging causal architecture of global crisis. Ecology and Society, 20(3), 6. doi:10.5751/ES-07681-200306
Mani, L., Tzachor, A., & Cole, P. (2021). Global catastrophic risk from lower magnitude volcanic eruptions. Nature Communications, 12(1), 4756. doi:10.1038/s41467-021-25021-8
Ord, T. (2020). The Precipice: Existential Risk and the Future of Humanity. London: Bloomsbury.
Schramski, J. R., Woodson, C. B., Steck, G., Munn, D., & Brown, J. H. (2019). Declining Country-Level Food Self-Sufficiency Suggests Future Food Insecurities. BioPhysical Economics and Resource Quality, 4(3), 12. doi:10.1007/s41247-019-0060-0
Walker, B., & Salt, D. (2006). Resilience Thinking: Sustaining Ecosystems and People in a Changing World. Washington, DC: Island Press.
Xia, L., Robock, A., Scherrer, K. J. N., Harrison, C., Jaegermeyr, J., Bardeen, C., . . . Heneghan, R. F. (2021). Global Famine after Nuclear War. Research Square – Preprint. doi:10.21203/rs.3.rs-830419/v1
In this blog we briefly review the literature on the probability of nuclear war and what various models estimate to be the potential global climate impacts (eg, of nuclear winter). Although New Zealand is relatively well placed as a major food producer – a range of mitigation strategies could increase the probability of sustaining food security during a recovery period. To get the ball rolling the Government needs to perform a national risk assessment on this topic and commission work on identifying the most cost-effective preparations.
Putin’s Ukraine invasion and nuclear weapons
Does Russian President Vladimir Putin intend to use nuclear weapons, under what circumstances, and what would be the impact of such aggression?
This question is important because days after Russia’s invasion of Ukraine began in February 2022, Putin ordered Russia’s nuclear forces to high alert. It is also important because of the potentially dire consequences following a nuclear war, given that Russia possesses approximately 4500 nuclear warheads, not counting ‘retired’ weapons.
Below, we address the probability of nuclear war, the modelling work around its potential consequences, and some mitigation strategies that could minimise the impact of nuclear war on New Zealand.
How likely is nuclear war?
Since 1945 when nuclear weapons were used to end The Second World War, none have been used in combat. Unlike many natural phenomena there is no frequency distribution to base probability estimates upon. However, subjective estimates have been published.
In 2008 Hellman estimated the probability of full-scale nuclear war between the US and Russia in any given year at 0.02–0.5% (Hellman, 2008), however this calculation included a 6% annual probability of an ‘initiating event’ that could lead (with 33% probability) to a ‘Cuban missile crisis type’ event. If we follow Hellman’s assessment and consider Putin’s move to nuclear high alert in the context of the Ukraine invasion to be an ‘initiating event’, then the annualised probability of ‘a nuclear weapon being detonated’ rises to 3.3–16.5% and that of nuclear war to 0.3–8.3% (or higher if Putin’s Ukraine posture is considered an actual Cuban crisis-type event).
In 2013, Barrett et al estimated the annualised probability of inadvertent US-Russia nuclear war at 2% (90% CI, 0.02–7%) or 1% (0.001–5%) if it is assumed launch could not occur during ‘calm’ geopolitical periods (Barrett, Baum, & Hostetler, 2013). Half of the total risk was contained in periods of US-Russia tensions (perhaps the Ukraine war for example), but importantly this means the other half of the risk lies in peacetime. This is due to risks such as systems faults, miscalculations, malice, and third-party interference.
Several, other assessments put the probability in a similar range. However, these assessments usually focus on one possible scenario (eg, US-Russia war, inadvertent war, regional war between Pakistan and India, etc) and so the true probability of any kind of nuclear war between any nuclear armed nations will necessarily be higher. Baum et al have elaborated a full model (see p.21) for the factors which must be included to deduce the total probability of nuclear war (S Baum, de Neufville, & Barrett, 2018). However, multiple war games have concluded that Putin would probably use a nuclear weapon if he felt his regime was threatened (Civvis, 2022).
The crowd forecasting organisation Good Judgment has reported the estimated number of nuclear weapons detonated conditional on a nuclear weapon being used. Results were: 84% probability of 1–9 weapons detonating, 13% to 10–99, 2% to 100–999, and 1% to 1000 or more (Beard, Rowe, & Fox, 2020).
So, the risk of nuclear war is generally considered to be low in any given year, but certainly not trivial, and it may be elevated to the concerning level of several percent per annum in times of crisis. This makes the annual risk of nuclear war in times of US-Russia tensions possibly greater than the risk of a Covid-19-like pandemic, which has an estimated return time of 59 years (Marani, Katul, Pan, & Parolari, 2021).
Models suggest nuclear war would have significant climate impacts
Nuclear war would have impacts that reach far beyond the mass deaths and destruction from blast, thermal and radiation impacts from the bombs themselves at explosion sites. Baum and Barrett systematically collated these impacts in a model of nuclear war (S Baum & Barrett, 2018). The impacts include: ‘fire, blocked sunlight, damage to infrastructure, water supply disruption, agriculture disruption, food insecurity, healthcare disruption, infectious disease, transportation disruption, transportation systems disruption, energy supply disruption, satellite disruption, telecommunications disruption, shifted norms, and general malfunction of society’.
Since the 1980s it has been supposed that the greatest of these wider impacts would result from climate disruption. Nuclear firestorms would burn combustible material in cities and loft black carbon (soot) far into the stratosphere, where it would spread globally, and could persist for years imposing a global ‘nuclear winter’.
A regional nuclear war (such as between India and Pakistan where up to 100 bombs are used) might loft up to 5 teragrams (Tg) of soot, whereas a full-scale global war (eg, between the US and Russia where hundreds to thousands of weapons are exploded) might push as much as 150 Tg of soot into the stratosphere.
Modelling the effects of this in the 1980s relied on computing capacity that did not allow models to ‘look’ beyond the very short term or perform numerous model runs. However, in 2007 Robock et al modelled nuclear climate impacts with a, then, modern climate model, NASA’s ModelE. They found that 5 Tg, 50 Tg and 150 Tg scenarios would have significant climate impacts with severe reductions in surface temperature, precipitation and solar radiation (Robock, Oman, & Stenchikov, 2007; A. Robock et al., 2007). The climate changes were predicted to be large and long-lasting. At the lower end of the spectrum the impact might be similar to the impact from the worst volcanic climate impacts in recorded history, for example the civilisation altering impact of the Late Antiquity Little Ice Age (536–556CE) and at the upper end (150 Tg) could impose a ‘nuclear winter’ which might see summer time temperatures in the northern hemisphere 20–30 degrees C below normal, with an 8–9 degree C drop in mean global temperature spanning a decade. The 150 Tg case is very much a worst case scenario given that it assumes the use of almost the entire global nuclear arsenals, which is probably unrealistic given that many reserve warheads would need to be mobilised and deployed.
More recent modelling of both the regional nuclear war scenario (Reisner et al., 2018; Wagman, Lundquist, Tang, Glascoe, & Bader, 2020), and the global scenario (Coupe, Bardeen, Robock, & Toon, 2020), using more sophisticated climate models such as the WACCM, generally concur with these earlier estimates. Nevertheless, the regional war case might produce lesser impacts than previously thought, yet still have an impact on global agriculture and food trade ‘unmatched in modern history’ (Jagermeyr et al., 2020). Even so, the potential impacts are still highly uncertain and depend on the behaviour of the relevant fires and the material that is available to be burned, which in turn depends on where the weapons are targeted.
What is generally agreed is that the worst-case scenarios would devastate ordinary global agriculture. Results of global modelling of 150 Tg scenarios, currently available as a preprint (Xia et al., 2021), suggest yield losses for major food crops (maize, rice, soybean and spring wheat) and marine fish, averaged over the first five years, might hit 79% loss globally and approach 100% loss in the northern hemisphere, (see also Jagermeyr et al 2020 for related peer-reviewed estimates pertaining to regional war). The impact on global food trade would be disastrous and billions of people would be at risk of starvation.
Additionally, ozone could be catastrophically depleted by stratosphere heating and the UV index at the Earth’s surface could rise to 35–45, or more, in places for several years (yes, this is the index reported by weather forecasters where 11+ is considered ‘severe’). The impact of this on global agriculture is unknown (Bardeen et al., 2021), but could be important.
Despite these catastrophic impacts, these models suggest that some places might be comparatively unscathed. This is because regions between the equator and 30 degrees south are not likely to be as impacted by climate changes. Although the equatorial monsoons may be greatly diminished, the growing seasons in some regions of Africa and South America may persist (Coupe et al., 2020). Additionally, remote southern hemisphere islands like New Zealand and Australia appear in the models to suffer less severe temperature drops (Coupe et al., 2020; A Robock et al., 2007), and some regions such as the Caribbean might even see increased fish catch (Scherrer et al., 2020).
What could be done to mitigate nuclear winter in New Zealand?
As with pandemics, prevention of nuclear war would be vastly better than being forced to respond. Immense diplomatic efforts are needed to resolve the situation in Ukraine. However, just as the world ought to be planning to mitigate the impacts of the next pandemic, we ought to address the potential impacts of nuclear war. In particular, policy should address food insecurity. This can be done by striking the right mix between the following three strategies (S. Baum, Denkenberger, Pearce, Robock, & Winkler, 2015):
Food stockpiles (which while expensive can allow for transition to a new normal in the event)
Agricultural adaptation including winter hardy crops
Development of alternative resilient food systems which do not depend on normal levels of sunlight
New Zealand specifically is a vast food overproducer due to its export economy. In a context where global food trade is severely disrupted, New Zealand could retain for domestic use food that is normally exported. Indeed, current volumes of dairy exports alone would be able to supply more than all the dietary energy needs of the whole New Zealand population (calculations by the authors – available on request). However, normal agricultural yields are likely to be diminished after a nuclear war. The calculations by Xia et al suggest that New Zealand might suffer reduced production of major crops of approximately 60% in worst scenarios (Xia et al., 2021). Applied to grass yield, along with the absence of palm kernel extract imports, this would severely impact dairy production. We note that Xia et al’s estimates are extrapolated from crude global macro-indicators and more detailed regional studies should be performed.
Production and distribution might additionally be hampered by lack of fossil fuel and fertiliser imports, and other impacts on machinery and access to parts. In cases where exports are retained for local consumption, there would need to be a plan in place to redistribute the food locally.
But with appropriate foresight, much agricultural production could continue with domestic production of biodiesel for farm machinery (or greater use of electric vehicles on farms), and increased local production capacity of fertiliser. The expansion of household and community gardens could be promoted by both central and local governments. These could focus on such highly efficient crops such as potatoes, but also crops that tolerate lower sunlight levels eg, winter vegetables. Also, the stock of marine food could be managed pre-war to maximise reserves and therefore yield if fishing is ramped up in the near-term aftermath of a nuclear war (Scherrer 2020).
New Zealand could also invest in research and development of alternative foods such as ocean greens (eg, farming seaweed), single-celled protein (García Martínez et al., 2021), synthetic fat (García Martínez, Alvarado, & Denkenberger, 2022), as well as the role of cheap polymer film greenhouses which could be rapidly scaled up in the months after nuclear war (Alvarado et al 2020) – especially if planning for more severe nuclear winter impacts was thought to be worthwhile.
Additional research on nuclear winter is needed
Some government-funded NZ work on the impact of nuclear war was done in the 1980s by the NZ Planning Council (eg Preddey, Wilkins, Wilson, Kjellstrom, & Williamson, 1982; Green et al. 1987). But, as far as we are aware little has been done since then. It is currently unclear whether nuclear winter is contemplated in the country’s National Risk Register, given that the contents of this document is classified. We discovered in February 2020 that New Zealand was very unprepared for a Covid-19-type pandemic. We don’t want to discover that we are just as unprepared for a nuclear winter if it happens.
We have previously argued for transparency around the national risk assessment process, wider consultation and a publicly accessible national risk register, along with the appointment of a Parliamentary Commissioner for Extreme Risks to oversee analysis and planning across a portfolio of risks (Boyd & Wilson, 2021).
These issues around nuclear winter should also be raised at the United Nations (UN), as we have argued before (Boyd & Wilson, 2020), and as would be consistent with the recent UN framework for ‘risk informed sustainable development’ (UNDRR, 2021).
The Royal Society of New Zealand and/or the Department of the Prime Minister and Cabinet (DPMC), should consider doing an updated report on the impacts and responses to nuclear war and nuclear winter, including what the government and citizens might consider doing in anticipation. Engagement with iwi and key New Zealand agricultural and fisheries organisations would be important to shift the perspective on New Zealand’s food supply towards one of long-term resilience ‘no matter what’, beyond anticipated greenhouse gas climate change, by thinking about severe cooling episodes too. These ‘winters’ could be produced not just by nuclear war, but by major volcanic events as well. The eruption of Mt Tambora in 1815 produced 53-58 Tg of SO2 and produced global winter-like effects (it was the ‘year without a summer’). The eruption in January 2022 of Hunga Tonga-Hunga Ha’apai puts this in perspective as it produced only 0.4 Tg.
In summary, the available literature suggests that the risk of nuclear war is far from trivial and is likely to be increased at times of international crisis. Various models have estimated that the potential global climate impacts (eg, of nuclear winter) could be severe – though less so for islands in the southern hemisphere such as New Zealand. Although New Zealand is relatively well placed as a major food producer – a range of mitigation strategies could increase the probability of sustaining food security during a recovery period. To get the ball rolling the Government needs to perform a national risk assessment on this topic and commission work on identifying the most cost-effective preparations.
Bardeen, C. G., Kinnison, D. E., Toon, O. B., Mills, M. J., Vitt, F., Xia, L., . . . Robock, A. (2021). Extreme Ozone Loss Following Nuclear War Results in Enhanced Surface Ultraviolet Radiation. Journal of Geophysical Research: Atmospheres, 126(18), e2021JD035079. doi:10.1029/2021JD035079.
Barrett, A., Baum, S., & Hostetler, K. (2013). Analyzing and Reducing the Risks of Inadvertent Nuclear War Between the United States and Russia. Science and Global Security, 21(2), 106–133.
Baum, S., Denkenberger, D. C., Pearce, J. M., Robock, A., & Winkler, R. (2015). Resilience to global food supply catastrophes. Environment Systems and Decisions, 35(2), 301–313. doi:10.1007/s10669-015-9549-2.
Beard, S., Rowe, T., & Fox, J. (2020). An analysis and evaluation of methods currently used to quantify the likelihood of existential hazards. Futures, 115, 102469. doi:10.1016/j.futures.2019.102469.
Boyd, M., & Wilson, N. (2020). Existential Risks to Humanity Should Concern International Policymakers and More Could Be Done in Considering Them at the International Governance Level. Risk Analysis, 40(11), 2303–2312. doi:10.1111/risa.13566.
Boyd, M., & Wilson, N. (2021). Aotearoa New Zealand would benefit from anticipatory central governance for preventing and mitigating catastrophic and existential risks. Policy Quarterly, 17(4), 20–31. doi:10.26686/pq.v17i4.7313.
Coupe, J., Bardeen, C., Robock, A., & Toon, O. (2020). Nuclear Winter Responses to Nuclear War Between the United States and Russia in the Whole Atmosphere Community Climate Model Version 4 and the Goddard Institute for Space Studies ModelE. Journal of Geophysical Research: Atmospheres, 124(15), 8522–8543. doi:10.1029/2019JD030509.
García Martínez, J. B., Alvarado, K. A., & Denkenberger, D. C. (2022). Synthetic fat from petroleum as a resilient food for global catastrophes: Preliminary techno-economic assessment and technology roadmap. Chemical Engineering Research and Design, 177, 255–272. doi:10.1016/j.cherd.2021.10.017.
García Martínez, J. B., Egbejimba, J., Throup, J., Matassa, S., Pearce, J. M., & Denkenberger, D. C. (2021). Potential of microbial protein from hydrogen for preventing mass starvation in catastrophic scenarios. Sustainable Production and Consumption, 25, 234–247. doi:10.1016/j.spc.2020.08.011.
Green, W., Cairns, T. and Wright, J. (1987). New Zealand After Nuclear War. New Zealand Planning Council, Wellington.
Hellman, M. (2008). Risk analysis of nuclear deterrence. The Bent of Tau Beta Pi, 99(2), 14.
Jagermeyr, J., Robock, A., Elliott, J., Muller, C., Xia, L., Khabarov, N., . . . Schmid, E. (2020). A regional nuclear conflict would compromise global food security. Proceedings of the National Academy of Sciences, 117(13), 7071–7081. doi:10.1073/pnas.1919049117.
Marani, M., Katul, G. G., Pan, W. K., & Parolari, A. J. (2021). Intensity and frequency of extreme novel epidemics. Proceedings of the National Academy of Sciences, 118(35), e2105482118. doi:10.1073/pnas.2105482118.
Reisner, J., D’Angelo, G., Koo, E., Even, W., Hecht, M., Hunke, E., . . . Cooley, J. (2018). Climate Impact of a Regional Nuclear Weapons Exchange: An Improved Assessment Based On Detailed Source Calculations. Journal of Geophysical Research: Atmospheres, 123(5), 2752-2772. doi:10.1002/2017JD027331.
Robock, A., Oman, L., & Stenchikov, G. L. (2007). Nuclear winter revisited with a modern climate model and current nuclear arsenals: Still catastrophic consequences. Journal of Geophysical Research: Atmospheres, 112(D13). doi:10.1029/2006JD008235.
Robock, A., Oman, L., Stenchikov, G. L., Toon, O. B., Bardeen, C., & Turco, R. P. (2007). Climatic consequences of regional nuclear conflicts. Atmos. Chem. Phys., 7(8), 2003–12. doi:10.5194/acp-7-2003-2007.
Scherrer, K. J. N., Harrison, C. S., Heneghan, R. F., Galbraith, E., Bardeen, C. G., Coupe, J., . . . Xia, L. (2020). Marine wild-capture fisheries after nuclear war. Proceedings of the National Academy of Sciences, 117(47), 29748–29758. doi:10.1073/pnas.2008256117.
Wagman, B. M., Lundquist, K. A., Tang, Q., Glascoe, L. G., & Bader, D. C. (2020). Examining the Climate Effects of a Regional Nuclear Weapons Exchange Using a Multiscale Atmospheric Modeling Approach. Journal of Geophysical Research: Atmospheres, 125(24), e2020JD033056. doi:10.1029/2020JD033056.
Xia, L., Robock, A., Scherrer, K. J. N., Harrison, C., Jaegermeyr, J., Bardeen, C., . . . Heneghan, R. F. (2021). Global Famine after Nuclear War. Research Square – Preprint. doi:10.21203/rs.3.rs-830419/v1.
The recent United Nations report ‘Our Common Agenda’ which calls for solidarity, concern for future generations, and collaborative action on global risks including pandemics.
The newly mandated Long-term Insights Briefings (LTIB) that Aotearoa NZ public sector organisations must prepare and some ideas for what could be included in the Ministry of Health’s LTIB.
Overview of our just published research paper calling for a well-resourced NZ Parliamentary Commissioner for Catastrophic Risks to help prioritise action and ensure a safe and flourishing future.
New United Nations (UN) Report: ‘Our Common Agenda’
In September 2021 the UN Secretary General (SG) released a roadmap to a flourishing future, ‘Our Common Agenda’. The report employed the language of long-termism, portrayed wide-ranging concern for future generations and had substantial focus on building immunity to catastrophic risks including pandemics and technological risks.
The SG identified the importance of global public goods, particularly in the wake of the Covid-19 pandemic, thereby setting the UN’s vision for the future and major priorities for the next five years.
The report acknowledges long-term challenges, including existential risks, that are evolving over the course of multiple human life spans. To ensure a thriving future, humanity needs solidarity and to work together for common goals. Institutional leverage can help humanity represent future generations and manage catastrophic and existential risks.
The report proposes mechanisms for protecting future generations and addressing risks:
A Futures Lab for futures impact assessments, megatrend and risk reporting
A Special Envoy for Future Generations to assist on ‘long-term thinking and foresight’
Repurposing the UN Trusteeship Council to represent the interests of future generations
A Declaration on Future Generations
An Emergency Platform to convene key actors in response to complex global crises
A Strategic Foresight and Global Risk Report to be released every 5 years
A 2023 Summit of the Future to discuss topics including these proposals addressing major risks and future generations
Global Public Health
With respect to global public health the SG says the world must fund the governance of global public health, overcoming its siloed nature. The SG endorses the advice of the Independent Panel for Preparedness and Response and calls for a global vaccination plan and sharing of technology and know-how.
On pandemics generally, the SG writes:
‘[G]lobal health security and preparedness (particularly investment in pandemic preparedness, but also for a broader set of potential health challenges) need to be strengthened through sustained political commitment and leadership at the highest level.’
Funding must be made available for an empowered WHO, with systems to ensure early detection, an independent verification capacity, the containment of emerging pathogens, enhanced global health security, an urgent global vaccination plan, and universal health coverage addressing the determinants of health.
Furthermore, when new biological threats arise there must be:
Faster detection and reporting of a novel pathogen
Faster ramp-up of nonpharmaceutical interventions to contain disease
Faster vaccine development and greater manufacturing capacity
More equitable vaccine distribution
The report emphasises that action is needed broadly because:
‘[W]e do not know which extreme risk event will come next; it might be another pandemic, a new war, a high-consequence biological attack, a cyberattack on critical infrastructure, a nuclear event, a rapidly moving environmental disaster, or something completely different such as technological or scientific developments gone awry and unconstrained by effective ethical and regulatory frameworks.’
Overall, the report links concern about future generations with the effects of our generation that most imperil them — existential risks, such as those of nuclear war or engineered pandemics, which could spell the end for humanity. The SG highlights that some countries have established Committees for the Future or Future Generations Commissioners, and suggests that other countries could follow suit.
A detailed summary of the report with a focus on long-term thinking can be read here.
Long-term insights briefings
Given the UN’s call for a long-term and coordinated approach, how is NZ placed? On the one hand it is notable that the shortfall between the UN’s benchmark for overseas development assistance (0.7% of GDP for wealthy nations) and NZ’s actual contribution (less than half that), would easily cover NZ’s fair share of the US$100 billion needed to bring 67 low-income countries up to a minimum level of health security. Promising is NZ’s recent increase to overseas climate assistance.
On the other hand, the NZ Public Service Act 2020 has mandated that every departmental chief executive publish a long-term insights briefing (LTIB) that is independent of ministers every three years, which should cover medium and long-term risks.
The statutory purpose of the Briefings is to make available into the public domain:
information about medium and long-term trends, risks and opportunities that affect or may affect NZ and NZ society
information and impartial analysis, including policy options for responding to these matters.
The Department of Prime Minister and Cabinet (DPMC) provides an overview of the Briefings, which must look at least ten years ahead and are to be tabled in Parliament in June 2022.
There is already some public consultation on the content and scope of the LTIBs. Notably the Ministry of Health (MoH) has not yet put forward proposals for public consultation. However, this means there will still be an opportunity for public input into the shape of the content. We list important opportunities and risks to include in the appendix below.
One possible weakness of the Briefings is that the subject matter doesn’t need to cover a department’s entire portfolio. The LTIBs are also not required to cover issues where there is already work underway. This possibly limits their potential impact.
However, these LTIBs are a significant opportunity for the NZ public and policymakers to articulate a long-term vision and plan for a flourishing rather than crisis-riddled future.
The Briefings appear to be very much the kind of local mechanism that the UN SG’s report envisions. However, there needs to be some kind of mechanism to independently aggregate these futures think pieces, prioritise action, and coordinate internationally on global issues.
A Parliamentary Commissioner for Extreme Risks
In a research paper just published by Policy Quarterly, we argue for exactly this kind of independent central coordination of risk and futures work across the NZ public sector. We propose a well-resourced Parliamentary Commissioner for Extreme Risks working in conjunction with a Parliamentary Select Committee. The argument in our paper proceeds as follows:
As the SG has identified, the world faces many large-scale risks. We describe these global catastrophic and existential risks and identify many challenges in governing the prevention and mitigation of such risks.
We then identify that risk reduction activity in Aotearoa NZ has not appropriately addressed these threats. For example, the NZ Civil Defence National Disaster Resilience Strategy retains a large bias towards natural hazards rather than strategic or anthropogenic risks. Additionally, the activities of the National Intelligence and Risk Coordination team within the DPMC are not sufficiently transparent and the National Risk Register is not open to public scrutiny.
On the basis of the challenges identified, we then deduce the desired features and functions of an entity for effectively governing risk mitigation approaches.
We argue the needed institutional entity must be: anticipatory, central/aggregating, coordinating, apolitical, transparent, adaptive, and accountable.
We offer structural options for such an entity and favour a Parliamentary Commissioner for Extreme Risks.
The fact that the National Risk Register is secret is particularly troubling because looking to the UK, which does have a publicly-facing version, there are oversights and biases (see the Appendix below for examples).
The secrecy is also troubling given published comments by Treasury that call for, ‘a whole-of-government and whole-of-society response… a multi-stakeholder coordinated approach to risk management and resilience-building… a strong relationship between the public, private and civil society sectors is pivotal’ (emphasis added). Similarly, the UN Global Assessment Report on Disaster Risk Reduction (2019) advocates, ‘increased access to risk information’ and that, ‘low risk awareness is one of the main challenges.’ Given that the LTIBs are intended to put risk and opportunity information in the public domain, the argument for transparency of the National Risk Register seems compelling.
A well-resourced, independent, apolitical Commissioner could objectively assess NZ’s approach to catastrophic risks, given that we now know ‘consistent with international best practice’ was nowhere near adequate for the risk of Covid-19. This Commissioner could also help overcome siloed orthodoxy and cognitive biases, through support for the public sector chief executives and the LTIBs process.
A Commissioner could also invest in a public facing interactive tool where users can adjust assumptions and see how various societal values and risk probability and impact assessments lead to different risk prioritisation. Such a communication tool is necessary to unpack some of the opacity of the risk assessment process and provide the language for independent peer-reviewers, stakeholders, and the public to engage with the government on risk mitigation.
To the credit of the UN SG’s report, Covid-19 is framed as an impetus to prepare not just for another pandemic, but for a range of global risks. Fortunately, most of the risk is contained in human activities such as biological engineering, uses of artificial intelligence, nuclear weapons, environmental manipulations, climate emissions, and so on (as per Ord 2020). This means that humanity has the power to vastly reduce the risk and secure a flourishing future.
However, there are key challenges to overcome when implementing these futures mechanisms. For example, we know that a suite of human cognitive biases such as groupthink, inattention bias, and difficulties with probabilistic and exponential thinking work against action to mitigate catastrophic risks. Former Chief Science Advisor Sir Peter Gluckman identified some of these in his report ‘Uncertain but Inevitable’, published earlier in 2021.
The LTIBs and other future oriented work can be leveraged to identify and plan to overcome catastrophic risk. However, the Briefings will not cover every risk, and may be focused on local rather than global threats. It is essential that a central aggregating and prioritisation mechanism exists with a view across the risks, seeing them as a set and seeing their interconnected and global importance.
The UN SG writes:
‘[t]his requires stronger legal frameworks, better tools for managing risks, better data, the identification and anticipation of future risks, and proper financing of prevention and preparedness.’
Hence there is a UN recommendation for countries to establish the sort of thing we are advocating in our paper. This is fortuitous because in our paper we suggest that the Commissioner for Extreme Risks could engage internationally and catalyse collaborative efforts, for example with Australia and Pacific neighbours.
If each country acts according to its strengths, then we can overcome these risks. NZ for example, as a temperate and remote island nation, is well-placed to resist catastrophic pandemics and winter-inducing scenarios such as nuclear war, supervolcanic eruption and comet or asteroid impacts. Policy could focus in part on these natural strengths with programmes aimed at enhancing self-sufficiency and demonstrating effective measures to other islands.
It is notable that many risk reduction activities, such as strengthening health systems, cooperating internationally, or enhancing food security will have tangible impacts here and now, regardless of future risks.
If every country plays their part as the inspiring call from the UN SG requires, then humanity can move more confidently toward a flourishing future, protected from pandemic disease, other biological threats to health and wellbeing and the suite of other catastrophic and existential threats.
Boston, J. (2021) ‘Assessing the options for combatting democratic myopia and safeguarding long-term interests’, Futures, 125, 102668, doi: 10.1016/j.futures.2020.102668
Bostrom, N. and M. Cirkovic (Eds.) (2008). Global Catastrophic Risks, Oxford: Oxford University Press.
Boyd, M., and N. Wilson (2021). Aotearoa New Zealand would benefit from anticipatory central governance for preventing and mitigating catastrophic and existential risks. Policy Quarterly. https://ojs.victoria.ac.nz/pq/article/view/7313
Boyd, M., and N. Wilson (2020) ‘Existential Risks to Humanity Should Concern International Policymakers and More Could Be Done in Considering Them at the International Governance Level’, Risk Analysis, 40 (11), pp.2303–2312, doi: 10.1111/risa.13566
Boyd, M. and N. Wilson (2018) ‘Existential Risks: New Zealand needs a method to agree on a value framework and how to quantify future lives at risk’, Policy Quarterly, 14 (3), pp.58–65, doi: 10.26686/pq.v14i3.5105
Gluckman, P. and A. Bardsley (2021) Uncertain but Inevitable: the expert-policy-political nexus and high-impact risks. Auckland: Koi Tu Centre for Informed Futures. Retrieved from: https://informedfutures.org/high-impact-risks/ (Accessed 31 July 2021)
Ord, T. (2020) The Precipice: Existential Risk and the Future of Humanity. London: Bloomsbury.
Long-term Insights Briefings: NZ Ministry of Health
Using the MoH as an example, the following might all be considered as part of a ten-plus year vision of opportunities and risks:
Bioweapons, bioengineering, synthetic biology and catastrophic risks
Climate disruption and health
Demographic transitions (age-groups, ethnic groups, migrants) and trends in health inequalities
Health system infrastructure
Health workforce needs
Artificial intelligence and health
Democratisation of healthcare
Remote service delivery
Malicious actors and cyber threats at health services
National Risk Register Shortcomings
Examining the UK’s public facing National Risk Register, there are some serious shortcomings including, but certainly not limited to:
The values and assumptions underpinning the summary risk matrix are opaque to a casual observer.
The magnitude of the threat from ‘emerging infectious diseases’ for the UK (ie, Covid-19-like organisms) was ‘up to 100 fatalities’ in the 2017 version, indicating an error of three orders of magnitude in the risk assessment.
Volcanism was only added to the register after the 2010 eruption of the Icelandic volcano Eyjafjallajökull, showing that key risks were not assessed.
The register has been criticised as over securitised and biased by vested interests.
The time horizon of 2–5 years is manifestly inadequate to plan for future risks.
Potentially rare events, such as supervolcanic eruption or nuclear winter, are excluded but may harbour substantial risk (as per work by Ord 2020).
To support more catastrophic risk content on this blog, please consider donating below:
In this post, I summarise and review the book What’s the worst that could happen?: Existential risks and extreme politics – by Australian politician Andrew Leigh (published 9 Nov 2021)
TLDR the TLDR: Populism enhances x-risks
TLDR: Andrew Leigh argues that the short-sighted politics of populism has enhanced existential risk. Populism is driven by problems of jobs, snobs, race, pace and luck. We can control populism by strengthening democratic systems and being stoic. However, Leigh says little about addressing the causes of populism itself.
Intro and purpose of the book
Australian Labour Party representative Andrew Leigh used his time during the Covid-19 disruptions to write a short book on existential risks to humanity (x-risk).
In the book, Leigh leverages longtermist thinking, describes the various x-risks (ie extreme pandemics, climate change, nuclear war, artificial superintelligence, environmental degradation, asteroid/comet impact) and couples this with observations about the rise of populist politics.
He concludes that not only does populism raise the probability of totalitarian dystopia, but it undermines our ability to prevent and mitigate x-risks generally.
In what follows I outline his approach chapter-by-chapter and conclude with thoughts of my own.
Why the future matters
The first chapter starts from the premise that a future utopia is inevitable if humanity survives long enough. This claim emerges by extrapolating a historical trajectory from our tough Iron Age existence through to modern comforts, and then beyond. Leigh rejects discounting the value of future lives, ‘discounting at a rate of 5 percent implies that Christopher Columbus is worth more than all 8 billion people alive today’ (p.8). Similarly, our lives today are no more important than those of future generations and we have a responsibility to those generations.
Leigh notes, however, that our survival is not a given and points out that someone’s risk of dying from an extinction event is higher than many other common risks. He provides psychological (availability heuristic) and economic (campaign contributions) reasons why policy is biased against preventing human extinction.
This situation is exacerbated by the rise of political populism. Leigh defines populists as those who claim to represent ‘the people’ in a challenge to ‘the elites’ who are painted as dishonest or corrupt. Populists can represent the left or right of the political spectrum, have little respect for experts, and tend to champion immediate priorities. They are ‘drivers distracted by back seat squabbles’ (p.14).
Leigh’s use of accessible metaphors involving bar fights, stolen wallets, and football make this introduction simultaneously an easy read, and the most Australian work on x-risk to date.
The next five chapters survey the threats from biorisks, climate change, nuclear war and artificial superintelligence as well as a chapter on probability and risk. Leigh describes each risk and canvasses a suite of standardly recommended policy options specific to them. For those not familiar with such background the chapters are an easy introduction to x-risks.
‘For each of the existential risks we face, there are sensible approaches that could curtail the dangers. For all the risks we face, a better politics will lead to a safer world’ (p.15).
Biological threats, both naturally occurring and human-created, are the focus of Chapter 2. Leigh uses historical examples (plague, cholera, pandemics, biological attacks), tabletop simulations (Clade X, Event 201), and popular culture, ‘someone doesn’t have to weaponize the bird flu–the birds are already doing that,’ says Lawrence Fishburne’s character in Contagion (p.22). Leigh calls out biological weapons programmes, those that skirted the law (the Soviet Union, Saddam Hussein) and acquaints the reader with the risks of synthetic biology.
Repeatedly, Leigh refers to popular fiction to make his points. Anecdotally, biotech entrepreneur Craig Venter recommended the book The Cobra Event, to Bill Clinton and this influenced biorisk policy.
Leigh highlights Scott Galloway’s observation that since more people die from disease than war, it might be reasonable to trade the CDC’s $7 billion budget for the Pentagon’s $700 billion budget (this made me reflect on general criticism of the military-industrial complex as a driver of runaway military spending, based around lobbying and vested interests. One possible future sees Boeing and Lockheed Martin coaxed into healthcare technology, generating the same revenues but with new focus). The chapter ends with a catch-all summary of previously published strategies for minimizing biothreats.
Chapter 3 surveys the issue of climate change. There is only so much that can be said in 21 pages (compare the 40,000 people who attended COP26 recently, and the gigabytes of documents flying around). It is noted that likely increases of 3–4 degrees C will be experienced by 2100, but importantly modelling suggests a 10 percent probability of 6 degrees C. If various ‘tipping points’ and ‘carbon bombs’ (p38–39), lead us to this unlikely but possible destination, then things could get very bad.
In this chapter Leigh really starts to escalate his hints that populist politics is exacerbating x-risk. He cites the actions of Donald Trump and Jair Bolsonaro. However, Leigh also notes that mitigations against climate change don’t hinge on longtermism, there are here-and-now economic reasons to act, as well as common ground across the political spectrum such as tree planting, and efficiency standards.
Chapter 4 conveys the precariousness of the nuclear stalemate. We read the stories of close calls such as the Cuban missile crisis and the role of Vasili Arkhipov in averting nuclear disaster. Tales from Dr Strangelove introduce us to mutually assured destruction (MAD) and the Russian ‘Dead Hand’ retaliatory mechanism.
Leigh argues that the increasingly many nuclear powers make it mathematically more likely there will be conflict. Nuclear conflict could also begin if a terrorist nuclear attack gave the appearance that a nuclear power had launched a strike. These scenarios could lead to a possible nuclear winter and agricultural failure. Again, the actions of populists such as Trump (withdrawing from the Iran nuclear deal) tend towards further destabilisation.
A survey of actions to minimize nuclear risk is given, with Leigh advocating a ‘Manhatten Project II’ (p.72), to denuclearize the world. Although, there is no mention of the economics of the nuclear weapon industry and how vested economic interests might sustain the number of weapons. However, Leigh wittily notes that, ‘By sending Dead Hand to the grave, Russia would make the planet a safer place’ (p.71).
The chapter on AI again follows fairly standard exposition of the risks that superintelligence poses. Hooking the reader into the looming power of AI with further Aussie-as statements such as, ‘playing chess and Go against machines, humans have about the same chance of victory as a regular guy might have of winning a boxing match against Tyson Fury’ (p.76). We read about the ‘intelligence explosion’, the ‘control problem’, and the ‘King Midas’ problem. True to form as a former professor of economics and now politician Leigh notes that, ‘the problem of encoding altruism into a computer is akin to the challenge of writing a watertight tax code’ (p.78).
Among several possible strategies for mitigating the risk of AI, Leigh introduces Stuart Russell’s notion that programmers should focus on, ‘building computers that are observant, humble and altruistic’ (p.84). Such machines would consult humans to learn what we want. As I’ve noted in a previous post, the problem here seems to be engineering the humans not the machines. In the end, Leigh suggests we may need enforceable treaties to ensure embedding of human values, banning of autonomous killing, and promoting collaboration over competition to manage the emergence of great intelligence, not if, but when it occurs.
What are the odds?
Chapter 6 consists of a brief survey of other x-risks, as well as analysis of their probabilities when compared to a range of common risks. It is in this chapter that I felt like Leigh made two mistakes.
Firstly, he expresses the probability of the risks discussed in Chapters 2 to 5 and other risks such as comet/asteroid impact, supervolcanic eruptions, and anthropogenic degradation of the environment, in terms of probability across a century, but then compares these to the ‘reader’s risk of dying from X, in the next year’. This comparison of apples and oranges is flawed for two reasons:
The probability of the anthropogenic risks, in particular, is non-stationary. For example, the risk of AI killing us all is not 1 in 1000 next year (as 1 in 10 ‘this century’) would imply. It is far lower at present, but likely to rise far higher, per annum, across time (until we control it or succumb to it). This reasoning does not necessarily apply to the natural risks, although see posts such as this one arguing that volcanic risk is rising.
Psychologically, it makes more sense to compare per century risks of catastrophe with per lifetime rather than per annum risks to personal wellbeing.
The second mistake I felt Leigh made is to introduce a hodgepodge of risks that have a greater probability in his estimation (which is based on Toby Ord’s), than some of the risks to which he has devoted entire preceding chapters. For example, cascading ecosystem failures appear to have a higher probability of causing human extinction than nuclear war. Arguably, there is some internal inconsistency of communication and emphasis in the book (though I certainly recognise nuclear threat as major).
As an aside, I’ve always found it interesting that the number of humans killed by ‘all natural disasters’ (eg flood, storm, earthquake, volcano, tsunami), as reported by Our World in Data, is approximately 60,000 per year, whereas crude annualization of x-risk probabilities as gestured toward by Leigh (though not made explicit in the book) suggest that the following risks are all greater in expected fatalities than all natural disasters combined: unaligned AI (8 million annualised deaths in expectation), engineered pandemic (2.7 million), nuclear war (80,000), climate change (80,000), environmental damage (80,000). This seems to be another CDC vs Department of Defence situation. Where, really, should we be funnelling our resources?
Regardless of the rhetorical method, Leigh makes it clear that some unlikely risks, such as asteroid/comet impact are already receiving significant government attention. This, coupled with the argument I’ve just outlined, certainly indicates that national risk assessment (NRA) and national risk register (NRR) methodologies may not be fit for purpose.
The crux of the book
Leigh next turns to populism and its relationship to totalitarianism, a threat recognised by the x-risk community because it could permanently curtail the potential of humanity.
We should probably pay more attention to these two chapters, and the penultimate one on democratic systems. This is because Leigh is a politician with over a decade of experience in the Australian House of Representatives. Therefore, we might infer some insider insight into the machinations of power and government, and it would be wise to grant him the floor to express his concerns.
The populist risk
In the preceding chapter, Leigh began to hint at the risk of totalitarianism, but it is here in Chapter 7, the longest chapter, that this threat comes to the foreground. Reiterating the rise of populist politics in recent years, we are reacquainted with the populist’s quest to foster a conflict between, ‘a pure mass of people and a vile elite’ (p.103). Populists can arise from all sides of the political spectrum. Conceptually there are four quadrants:
International egalitarians (Obama, Biden)
International libertarians (Romney, Bush)
Populist egalitarians (Sanders, Ocasio-Cortez)
Populist libertarians (Trump, Palin)
Leigh claims that certain ideas have historically been particularly contagious. These include communism, capitalism, and populism. Furthermore, the world is becoming more populist in recent decades.
According to Leigh, there are five causes of this recent resurgence in populist politics:
Jobs: low quality employment, work and wage insecurity
Snobs: party elites who don’t take the populist threat seriously
Race: fear of difference, impressionable masses responding to racist rhetoric
Pace: rapid, disorienting, technological and cultural transformation
Luck: some elections are very close and could have gone either way
On the issue of ‘snobs’, it certainly appears to me that elections have been stolen, but not as Trump claims, it’s by populists, from inflexible snobs! – see also Thomas Piketty’s arguments about the Brahmin Left and Merchant Right, left wing politicians now appeal to an educated class, rather than their traditional union base.
With respect to ‘luck’, I’m left wondering if this is a one-way valve. Do many populists try their hand, but only a few succeed by luck? However, once they then have power, they tend to rig the system to maintain their control.
Populism allegedly poses a threat to longtermism (and by implication x-risk mitigation), because populists:
reject strong science
reject effective institutions
reject global engagement
reject a sense of cooperation
However, the fact that populists are ‘anti’ these four things is the reason for their electoral appeal! Leigh proceeds to provide numerous examples of populists exhibiting these traits. Anti-internationalism in particular undermines hope of addressing x-risks, which by their nature may require global cooperation. Leigh argues that, therefore, the risk populism imposes on our future is greater than the risk it poses now.
To reiterate, Leigh is arguing that five issues (jobs, snobs, race, pace, luck) have led to the rise in populism and that populism increases the risk from x-risks, due to its short-term focus and ‘anti’ emphasis.
Totalitarianism – the death of democracy
In Chapter 8, we see the potential horror of widespread totalitarianism, which might emerge from the increasing hold that populism has around the world. Leigh says that widespread totalitarianism is, ‘not among [Toby] Ord’s top concerns, but does rank in mine’ (p.96). However, to me there is some equivocation over ‘totalitarianism’ in the works of Ord (The Precipice) versus the present book, with Ord focusing more on x-risk (permanently curtailing the future of humanity), whereas Leigh is more concerned with terrible national or regional states of affairs.
We are led through the histories of Adolf Hitler, Hugo Chavez, and Ferdinand Marcos, in a search for commonalities. What we discover is that these populists initially came to power through fair democratic processes, before devolving their democracies into authoritarian regimes. Recently, in Hungary and Turkey populist outsiders similarly won elections (due to jobs, snobs, race, pace, and luck) then used their acquired power to attack institutions, often in imperceptible steps.
Leigh catalogues ‘seven deadly sins’ (p.138) indicating that a leader is degrading democracy into an authoritarian regime. However, I felt that the inherent tension between the need for totalitarianism to be global for it to ‘permanently curtail the potential of humanity’ and the inward-looking nationalism of populists, seems to preclude populism as a pathway to a global totalitarian x-risk, although things could still get very bad, and populism can no doubt amplify other risks.
Leigh’s roadmap to fixing politics is probably the most disappointing aspect of the book. This is because having identified populism as a driver of x-risk and having identified five causes of populism, he then focuses his remedy on building stronger democracies (presumably to resist degradation by populists) rather than focusing on the underlying causes. Populists win elections in strong democracies and then re-jig the rules to suit themselves. So it’s not so clear how creating better rules is the ultimate solution.
Regardless, we are offered a suite of sensible democratic reforms, tinkering and strengthening of democracies particularly where the necessary continuous tinkering and strengthening has ceased (the last US constitutional amendment favouring democracy was 50 years ago).
Leigh favours mass participation in elections, promoting the compulsory Australian system. He favours convenient voting methods, independent redistricting, and reform of electoral-college systems where the popular vote may not determine who wins. Leigh also favours controls on the export of technologies that can sustain totalitarianism, such as facial recognition systems.
Many of Leigh’s proposals are positive steps, and I support a number, but none of them cut to the heart of the issue, which is the need to address jobs, snobs, race, pace, and luck so that populists cannot win free and fair elections in countries with strong democracies. In only one paragraph on p.153–4 (of 167) does the argument link proposed reforms to these five causes, and only two causes are addressed.
A final chapter summarises the argument with reference to risk and insurance. X-risks are not a concern because they are likely, they are a concern because they would be unbearable. This is why we need insurance against them. To overcome the tendency for politicians to focus on the likely rather than the devastating, we must resist populism, strengthen democracy, and practice more wisdom. In Leigh’s mind, these traits are synonymous with the philosophy of Stoicism and the political philosophy of John Rawls. We need courage, prudence, justice, and moderation.
‘A stoic approach to politics means spending less time caught up in the cycle of outrage and devoting more energy to making an enduring difference’ (p.164)
Perhaps it is through Stoicism that we address jobs, snobs, race, pace, and luck.
I enjoyed this book, but mostly because it was such an accessible summary of things I’d already learned during seven years’ engagement with x-risk content and the x-risk community. The book provides an accessible, entertaining introduction to x-risks for those not already immersed in the field. It benefitted from the simple style, amusing metaphors and Australianisms.
On the other hand, the solutions proposed, in my view, don’t really address the problems identified. We are offered an ambulance at the bottom of the cliff. Or perhaps a more Aussie take might be that we are advised to piss on our houses to protect them from a bushfire.
However, we often imagine that politicians are unreceptive to long-term issues. What’s the worst that could happen? demonstrates that there are representatives sympathetic to the issues of x-risk and future generations. We can try to leverage these politicians, amplify their voice, and connect such individuals with x-risk academic work via policy work on x-risks. Relevant examples of such work includes:
Policy recommendations appendix in Toby Ord’s book The Precipice
I personally also think it is important to continue to develop arguments that demonstrate why x-risk is a priority here and now, not merely through a longtermist lens. Then we can cast the net as widely as possible, and convince those who will never be focused on the long term. Arguments that highlight flaws in national risk assessment and national risk register processes, and remedy these so that x-risk is rationally included under the extant scope of these devices are valuable, as are cost-effectiveness analyses grounded in the same short-termism standardly deployed in government. My back of the envelope calculations indicate this is an approach ripe for elaboration.
However, the work should extend beyond specific policies addressing x-risks separately or in combination, to ways we can strengthen democracies, and perhaps more importantly, reduce the likelihood of populist leaders emerging in the first place by addressing the issues of jobs, snobs, race, pace, and the role of luck. I was disappointed that What’s the worst that could happen? didn’t finish this analysis, yet to be fair, this is a book that you can read in a day and is a worthy introduction to x-risk for the uninitiated.
“COVID-19 has shown that assumptions about disease emergence and transmission and capabilities to respond to infectious disease threats are not only incorrect but pose a risk to global health security.”
A new article in the Lancet (8 November 2021) provides a peer-reviewed chronological analysis of crucial junctures and international obligations in the early days of the COVID-19 pandemic.
What happened day by day, where, why, or why not?
The information was gathered by the Independent Panel for Pandemic Preparedness and Response. The Panel was co-chaired by former New Zealand Prime Minister the Rt Hon. Helen Clark, and Her Excellency Ellen Johnson Sirleaf, former President of Liberia.
The following post blends the findings of this report with my interpretation of the early response to (future) pandemic-threatening outbreaks.
The article provides the following timeline of Covid-19 emergence (much more detail can be found in the Lancet article):
November 2019: human to human transmission was probably occurring in China (later evidenced by phylogenetic studies and epidemic growth rates)
8 Dec 2019: a patient is symptomatic with atypical pneumonia in a Wuhan hospital
24 Dec 2019: the patient’s lung fluid sent to a private laboratory in Guangzhou
26 Dec 2019: a woman with fever and cough in Wuhan has a chest CT suggesting pneumonia of unknown origin
27 Dec 2019: the woman’s husband and son have the same findings
‘Late’ 2019: possible spread of virus outside of China (weak evidence from heterogeneous unverified studies)
30 Dec 2019: Wuhan Municipal Health Commission issues first notices to hospitals with instructions not to share!
31 Dec 2019: Finance Sina reports the story, a machine translated version of the story is published on an emerging diseases monitoring website and picked up by the WHO.
31 Dec 2019: Taiwan and Hong Kong begin preparing interventions and screening travellers from Wuhan.
31 Dec 2019: Wuhan Municipal Health Commission issues a public bulletin describing 27 cases of pneumonia of unknown origin (not sent to WHO!)
5 Jan 2020: WHO notifies all country governments
5–7 Jan 2020: Multiple sequences of viral genome completed
8 Jan 2020: Case detected in Thailand by airport screening
10 Jan 2020: PCR test for virus developed
11 Jan 2020: PCR test for virus deployed
14 Jan 2020: WHO tweet states there is ‘no clear evidence of person-to-person transmission… but “possible”’
20 Jan 2020: confirmed human-to-human transmission (health workers infected)
22 Jan 2020: WHO International Health Regulations (IHR) emergency committee convened
23 Jan 2020: 581 cases confirmed including 10 outside of China
23 Jan 2020: Strict public health measures in Wuhan (retrospective analysis indicates that 86% of cases were undetected at this point)
24 Jan 2020: WHO recommends against travel restrictions
30 Jan 2020: Public Health Emergency of International Concern (PHEIC) declared by WHO Emergency Committee but travel restrictions recommended against, WHO director general states we must ‘protect weaker health systems’ (this perhaps implied that ‘stronger’ ones might not need to prepare much)
Computational models predict virus spread along air traffic routes (which could have allowed mass targeted surveillance testing)
11 March 2020: the word ‘pandemic’ is used by the WHO Director General
11 March 2020: First European country (Italy) enacts national lockdown
An interpretation of this timeline
My interpretation of this timeline goes something like this:
Given the extreme global threat of an out-of-control novel respiratory pathogen, in the future, cases like that admitted to a Wuhan hospital on 8 Dec 2019 should have samples taken immediately and any viruses isolated and sequenced. If the genome bears any remote similarity to respiratory pathogens of concern, then a public health emergency of international concern (or some similar alert) should be issued immediately (ie at least a month before it was for Covid-19).
The family cluster on Dec 27 is suggestive (though not proof of) human-to-human transmission. Given the extreme global threat of an out-of-control novel respiratory pathogen, in the future, human-to-human transmission should be assumed at this point, and the WHO informed. Given the retrospective analysis mentioned above, in the future, we must assume there are many more cases than data suggests at an early stage.
The question of whether the virus was spreading outside of China before 2020 is critically relevant. This is because strong public health measures can quash an outbreak like Covid-19 in its early stages, as measures in countries like Taiwan, New Zealand, Australia, and China have repeatedly shown. And with a limited number of identifiable outbreaks very strong initial measures would be justified to prevent a pandemic. However, with widespread and undetected escape of a virus like Covid-19 the argument for strong lockdowns is weakened.
Given the extreme global threat of an out-of-control novel respiratory pathogen, in the future, we should conduct very widespread and rapid initial testing worldwide (targeting transport hubs). In the future we must ensure:
A substantial supply of testing capacity (this will mean planning to develop and deploy a test at scale within days of outbreak notification)
Dispensing with ‘criteria’ for testing. With Covid-19 many probable cases were not tested because the criteria and case definitions targeted only travellers from Wuhan or those who had contact with travellers from Wuhan.
Speedy action is critical. As evidenced by the fact that Taiwan and Hong Kong had some of the best pandemic responses globally through 2020, and they acted weeks before the PHEIC was finally declared. Given the extreme global threat of an out-of-control novel respiratory pathogen, there is nothing stopping every country in the world acting at the same point in an outbreak (ie the equivalent of 31 December 2019 in the Covid-19 situation) and preferably earlier (as above).
In sum, it should be possible to identify a similar virus of concern at least 16 days earlier (testing on 8 Dec vs 24 Dec as above) and therefore prepare to act internationally on a date equivalent to 15 Dec 2019 (16 days before Taiwan and Hong Kong did). Extreme public health measures at the point of origin could then be enacted on the equivalent of Dec 27–30, when suspicion of human-to-human transmission emerges along with case series reports. This would be nearly a month earlier than Wuhan did in fact lockdown. This apparent ‘overreaction’ would be justified by the global health and financial impact in expectation, conditional on the finding of person-to-person spread of a SARS-like respiratory virus (see ‘cost effectiveness’ below).
Recommendations of the Independent Panel
On the basis of the timeline above the Independent Panel recommends reform of existing laws, governance systems, the IHR, and a pandemic treaty.
The Panel’s notes and recommendations include (a fuller discussion is found in the Lancet article):
That the IHR are less proactive and time-sensitive than is optimal in the face of a high-transmission respiratory pathogen.
Remove constraints on WHO reporting publicly prior to verification
Streamline the WHO verification process
Ensure open and transparent proceedings of the Emergency Committee
Presume assistance/cooperation of States Parties will be needed
There must be a ‘special urgency’ around coordinated, evidence-based, and international governance for zoonotic risk.
Rigorous translational activities, including the use of epidemic simulations that test capabilities, should be used to identify deficiencies to correct (this item seems particularly relevant to New Zealand given the general sense of playing catch up with public health capabilities even when future need is identified – had NZ simulated contact tracing 200 cases per day?)
Proactive global surveillance (not syndromic testing) when a respiratory pathogen suspected
Future outbreaks should be approached with a ‘rebuttable presumption’ of sustained human-to-human and asymptomatic transmission
Assume far wider spread than is evidenced by the data
Full and immediate reporting of any possible high-impact respiratory pathogen to WHO (through a process more expedient than the present IHR requires)
Full authority should be granted to WHO to investigate pathogens with cross-border potential
The WHO Emergency Committee should give greater weight to the potential costs of not declaring a PHEIC
A global pandemic treaty should be created centred on the principle of equity
Generally, much broader deployment of the precautionary principle
Some may question the cost-effectiveness of extreme initial public health measures, given the severe costs imposed by border closures and lockdowns. However, the cost-effectiveness must be seen at a global level. Extended and repeated extreme lockdowns implemented globally are clearly not cost-effective for a Covid-like virus (when using thresholds typical for health interventions, as a number of analyses have shown), but shorter lockdowns targeted to quash the outbreak in its early phases may well be highly desirable (when seen in a global context).
The total global cost of the Covid-19 pandemic is estimated to be well over US$20 trillion. Even if only 1 in 100 concerning outbreaks of respiratory pathogens with suspected human-to-human spread would in fact lead to a Covid-like pandemic, then it is rational to spend up to US$200 billion to ensure we stop each one. Some lockdowns in New Zealand were costing NZ$1 billion per week. Back of the envelope calculations therefore suggest the world could implement extreme public health measures for 6 weeks, across 30 or 40 locations of 5 million people to ensure strict control of an outbreak is obtained, and to do this on 100 separate occasions, and still be better off for it! The proof of concept is the success of even Wuhan’s (late) lockdown. Lesser measures might have worked if enacted a month sooner and simulations of spread via travel hubs points to where we should act.
However, given that the cost-effectiveness must be seen at a global level, there must be mechanisms enacted to ensure just and equitable impact across the world, so that regions that must necessarily undertake extreme public health measures to prevent a global pandemic are compensated for these measures. This is in the interests of all States and should be worked into the refreshed IHR.
However, the critical caveat is that strict public health measures will rapidly become cost ineffective if endlessly repeated during the same outbreak or continued for too long. We must take extreme measures initially but be prepared to rapidly reduce them if they fail. Some a priori public debate around cost-effectiveness of extreme measures, and in particular the value of life in pandemic situations is warranted.
Sometimes creative writing can be leveraged to trigger productive reflection on complex issues. This post includes the full-text of a short story on catastrophic risk, ‘The Sequence Matters’. It is an entry in the Effective Altruism Forum’s Creative Writing Contest.
Effective Altruism is a community that addresses issues such as existential risks to humanity, how to do the most good possible, and what the most rational global priorities are.
EA has been running its creative writing competition because stories have been a key factor driving EA’s growth since its inception. Influential stories include those by: Peter Singer, Eliezer Yudkowsky, and Nick Bostrom.
What follows is my entry in the EA Creative Writing Competition. I hope you enjoy it.
The Sequence Matters
When a structure kills by collapse, investigators search for causes. Perhaps design was flawed. Perhaps maintenance neglected. Perhaps the wrong structure had been built in the first place.
Everton remembered interrogating C in prison. After obtaining his evidence, he chose to leave the heavy cell door unlocked. Clueless then to the consequences of his actions.
Lord Thomas boomed.
‘I cannot help but think, Mr. Everton, that our being here today poses many more questions than we seem to be answering.’
The Supreme Justice shifted on his throne. His every glance captivating onlookers in the gallery. The Justice eyed his peers at the bench, stroked his ample beard and tapped his pen. Pointing at Everton in the witness box he spoke again.
‘It’s clear that we congregate today due to the actions of someone known simply as ‘C’. And I cannot fathom why no one is able to tell me more about them than an initial. But what is even less clear, Mr. Everton, is the role that you played in what can only be described as the catastrophic events of six months past.’ Thomas paused and checked his papers.
‘C was a woman,’ said Everton.
‘What’s that?’ hissed Thomas.
‘I’m telling you more about her,’ said Everton. ‘C was a woman’.
Thomas carried on, ‘Furthermore, as Justice Parata has significantly brought to our attention, we must ask had this disaster never been predicted by the mysterious C, would it even have occurred at all. And if it weren’t to have occurred at all, would it have ever been predicted? You see the awkward position we all find ourselves in. Such are the questions that stalk our collective minds. And,’ Justice Thomas drew a breath, ‘We are well aware that C did not survive these events, so we have no recourse to an interrogation of… her. Indeed, it seems no key witnesses remain alive, except, mysteriously it must be said, for you Mr. Everton.’
‘C had a moral heart,’ said Everton. ‘But more than that she had a moral mind.’
‘It is not some disembodied mind that is on trial here Mr. Everton…,’ Thomas spoke with force.
‘And just who is on trial Jeremy?’ The gallery breathed a collective gasp as Everton addressed Justice Thomas in the familiar. ‘Who is on trial? The dock stands empty like some gaping sore.’
‘Mr. Everton, we don’t need a defendant to hold court. As we proceed the defendant will take shape. We seek justice in its purest form. Words easily bring that which does not yet exist to life. The papers will write about it and the defendant will be as real as you or I. As real as her alleged crimes, and as real as the Law itself.’
‘And the wound will ooze, responsibility will fade in phantoms.’
‘Mr. Everton, you walk a very fine line!’
‘You have no idea how fine that line is Jeremy. You have not heard what I have now heard, have you? That’s why I’m here today after all. I mean how could you have. When did you last leave these chambers? Ever since your appointment you have been preoccupied with your precedents and papers, nothing more. You are the prisoner here!’
The gallery gasped again.
‘I stand here wondering,’ Everton continued, ‘how all this came to pass. We sat side by side, you and I, the same lecture halls, the same exams, with the same ideals and hopes. But that was a long time ago, and now you sit there as Chief Justice and I stand pleading with you, offering truth after truth and you cannot hear me. What made you so different from me?
‘We are the ones asking the questions here. All you need do is answer,’ said Justice Thomas.
‘Don’t lecture me of all people on interrogation Jeremy. If it weren’t for my methods you wouldn’t even have chambers to preside over.’
‘Everton. What exactly is it that you believe we need to know? I am listening. Forget all this theatre. Explain it to me.’
‘I fear that some lessons seem simply unable to be learned. But I am willing to take you through the evidence. Step by step.’
As Everton began to relate the story, a small girl in the public gallery gripped her mother’s hand and a tear slid from the corner of her eye.
C opened her eyes. A scuttle of rats’ claws vanished in a corner. She turned on the light. She was sitting at her desk. She had dreamed of an open door and a masked face. Now she was awake, wide awake. The windowless room around her was sharp with detail, but unfamiliar, older somehow, or more distant. Her mind wandered far from the desk in front of her. C had not remembered falling asleep.
The tower is unstable, she thought. It’s going to collapse.
C rose from the desk. She felt grounded. Before she stepped toward the door she could see herself opening it. Her movements like a lagging image, but lagging forward.
The corridor was a swarm of construction. Panels missing, pipes and girders exposed. An organic lattice of curves and fractals. A welder focused solely on an incandescent arc.
When she got to Chad Schwartz’ office she already knew Schwartz wouldn’t understand. He’d repeat the mantra, the algorithm says it will work, the tower supports our flourishing.
‘Wait a moment,’ said Chad Schwartz holding up his hand at C’s entry. His attention and that of his aide was directed at a glass tank. In it a rat sat on a platform surrounded by water. The rat was gnawing on a stack of hard uncooked spaghetti. On another platform was a large stack of food, and the exit.
‘Wait for it…’ said Chad, ‘there!’
The rat was inching the last stick of spaghetti across the span between the two platforms. Sniffing the air, it took a nimble step onto the hard pasta. But the single pasta couldn’t support the weight. It snapped dumping the rat into the water.
Chad exploded in laughter, waved the aide away and turned to C.
‘There were times C, when your concerns were figured with pencil and paper. But the structure must expand, it’s our priority, and we have the algorithm now.
C said nothing. Dismissed before she’d begun. A glance at the letterhead of some paper in the trash as she departed. Schwartz Corp, with an inky black swan of a logo.
C returned to her office, clambering over cable spools and toolboxes in the hall. An arched ceiling reinforced with spidery piping. A worker unscrewing a railing, placing it in a carton of scavenged metal. Intent on a sheet of instructions.
C shooed a rat away from her desk and sat in the chair. The upholstery had been removed some time ago. Stalked by anxious thoughts of some distant disaster, she opened the book again.
C woke. The room around her seemed crisper than ever. Perfect contrast despite the low light. She felt herself drifting through hallways, climbing ladders, gazing to an unseen horizon, even as she sat in the chair.
The collapse could be soon, sudden, and sharp she thought.
She tried to decide if her mother would believe her. Or if it’d be like the time she’d found a dead rat in the kitchen drawer. She should’ve kept the stinky thing as evidence.
C began to write. She wrote about the problem of space, the uncertainty of the iron stack, the bottomless chasm, the bridge that had once been started, the reconfigurations of the tower, the doctrine of upward expansion, the calculations of balance and stability, she speculated about the outside, though she had never seen it. And these days she included the rats. With her new information, she projected forward, far forward.
She tried to sleep, occasionally a sudden sense of falling, halted by a gasp and the stutter of her heart. She wasn’t dreaming but everything looked different now.
She reached for the phone to dial her friend Nadia. But she quickly hung up. She wondered who might be listening.
The bulb of her desk lamp fizzled. The door to the office swung open. Silhouetted, a masked figure appraised her. Ten years working here she thought. This was something she had never predicted.
‘This is so much more important than everything else,’ C said.
A strong breeze flowed through Nadia’s office. Nadia, focussed on the details of one of her origami birds, seemed not to notice. Black polythene fluttered against one wall. Rusted beams had been pushed through the wall into the office, realigning the structure’s skeleton.
‘Did you hear me?’ said C.
The figure in the mask shadowed her two steps behind. It had wordlessly followed her here.
‘Remember those jellies we shared as children,’ said Nadia without looking up. ‘Where was that, level twenty? The atrium balcony, I don’t remember the past so clearly.’
‘The level eighteen storeroom. Before it was sealed.’
‘Yes, that’s right. You stacked those paint buckets so high.’ Nadia laughed. ‘Oh the mess!’
C couldn’t help but laugh, ‘we should’ve taken our time, got the trolley first. Mum was furious.’
Nadia didn’t seem to notice the masked figure.
‘Anyway,’ Nadia said. ‘We have the algorithm now. One thousand elegant levels by the end of the year if you believe the forecasts. Which of course we must.’
‘But what about next year?’ said C. ‘Or a hundred years from now?’
‘Do you think this one’s pretty?’ said Nadia, still focused, and holding out an origami bird, ‘or should I start again?’
‘People will die,’ said C. She knew that was an understatement. But glancing at the masked figure she said no more.
C rode the elevator, traversing a cubic kilometre of the tower. The carriage now just a flimsy cage, its panels scavenged for the upper levels. Levels slid past in a blur. Rats clung to the exposed cables hitching a ride. The whole structure shuddered briefly.
C updated her prediction. The collapse was imminent.
She thought of Gustav and remembered a conversation they once had. The old man, her colleague, had been fussing over his coffee.
‘Gustav, I’m sorry, but I need to know about the rats,’ C had said.
‘No, no. None of that matters now, not like then, back then when we had a choice… I’ll tell you something else.’
‘Gustav this is important.’
‘Many things are important my dear. Your obligation to drink coffee with an old friend is important. Here, drink, focus on the moment. Most employees of this company have never taken leave you know. They have never stepped outside the levels of their offices and apartments, never sought to exit the tower, let alone seen the chasm. But why should they? What do they want for in here? Yes, there is a world beyond these walls. A world of endless resource. But people don’t covet what they know nothing of.’
‘Tell me about the rats Gustav. Have they always been here? Why doesn’t anyone control them?’
‘We used to suffer your structural failures, but they never amounted to much, we might expect similar threats in the future, but as we’ve learned they’re never an existential risk. Besides, we have the algorithm now and its precision is beautiful and flawless. You’ve seen the harmony of the girders we place. Structural stability is its primary goal, there is a counterbalance for everything.’
‘The rats Gustav.’
‘The bridge and the tower were under construction. We flourished, but we needed more space. We’d plundered the iron stack. But there was abundance in the half-finished bridge to repurpose. A structure stands on its core you see. So much else is unnecessary. Fractional reserve building. That was the great innovation. Decoration, furnishings, all repurposed as structural components. The tower continued to expand upon a foundation of clever calculations. And now with the algorithm, we’ve handed design to the machine. You’ve seen the forms it creates, organic designs, unfamiliar geometries. Beautiful, beyond our wildest dreams. Further and taller, and yet just as stable. Ten times the size of the original structure, by rearranging the same components. The algorithm showed us how to drill down you know. Deeper and deeper, expanding into the earth.’
‘Gustav I need to know about the rats.’
‘Yes, yes, I’m getting there. Patience. All these activities create risk. Our new powers, our new ways. Catastrophic risk. But it is managed with the algorithm, every design, every geometry, they always hold. I do remember the old basement. As boys we’d go down there in our grubby shorts and spy on the workers. I remember the day a man in overalls emerged from one of the tunnels, clutching a sack that was writhing with the throws of some living thing. The new drills delving deeper and deeper, unleashing God knew what. One boy had nightmares after that and threw himself from a high window.’
‘A window?’ said C.
‘Fifty years ago they were common. Especially on the upper levels.’
‘I’ve never seen one.’
‘There’s a hatch on the roof too, and ladders descending. There’s been so much expansion of late. Thin wiry extensions to the tower. The old windows were boarded up with the first wild predictions of structural failure. But the algorithm sorted that.’
‘But Gustav, the rats. Tell me more about the rats.’
‘It all changed in ’27 when Chad ordered the basement secured for storage. I suspect a part of him secretly believed in structural failure. He’ll deny it, but the figures in the book can’t be ignored. Couldn’t then, but were, can’t now, but still are. The basement would offer a refuge in the event of failure.
‘But since the drilling the basement became the most complex network of interconnected tunnels and rooms imaginable. Literally thousands of different chambers, dating from different eras. Set up for different power supplies, with different plumbing, faucets, pipes. In starting to explore and clear out the basement on an industrial scale Schwartz-Corp disturbed the rats. Hordes and hordes of rats.’
Gustav had taught C so much about the tower and that day he’d given her the book. She read it twice and it changed everything.
The elevator jolted to a stop.
There was condensation on the glass of Gustav’s door. C wiped her fingers across it and peered inside. The apartment was dark. She opened the door and stepped inside. Dead rats littered the floor and there was stench. But it wasn’t the rats that smelled. Gustav’s large frame lay motionless in the dentist chair he’d taken to napping on. A mug of cold coffee on the spittoon ledge. The surface of the coffee black, reflecting what little light there was. C saw her own reflection, and that of the masked figure behind her. A voice invaded the silence.
‘It’s time. We have come for you.’ The masked figure was now flanked by three rough looking guards.
C knew this moment had been inevitable.
C was blindfolded, carried by strong arms, and taken to a small interrogation room. C’s captors departed. Sitting across a white table from her was Debrovka, Schwartz Corp’s head of legal.
‘Are you here to advise me?’ C asked.
‘No. I am here to prosecute you,’ replied the lawyer. C realized this was the truth.
‘Are you Schwartz Corp’s senior trend analyst?’
‘Do you know Mr Gustav Muller?’
‘Come on Deb, you know I do.’
C felt a strange sense of relief.
‘Nadia Rogers claims that you threatened to kill people this evening.’
‘No. That’s not what I said.’
‘That’s what’s been reported. I am placing you under arrest and charging you with murder. You have the right to say nothing. Under constitutional reform ten zero one one that is your sole right. Do you have anything to say?’
The official record notes that C was silent. In her prison cell, she stood barefoot in a white gown on a cold concrete floor. The ceiling rose high, four triangular panels, sloping and converging in a dome. No doubt the algorithm’s design. She wondered how the walls of the cell would crumble over millennia, where the first cracks might start.
‘What is this?’ the masked figure demanded, a man’s voice. He dropped a stapled sheaf of papers to the floor at her feet. A treatise on the long-term future of Schwartz Corp, with references to dynamics presently in operation. As the document struck the floor the cell shuddered, as if rocked by an earthquake. The pained screech of strained steel pierced the dead air. Then all was still again.
This interrogator saw C’s fear. ‘Don’t worry, the algorithm will intervene. Work crews will be prioritised and redeployed as always.’
‘That’s not what’s worrying me,’ said C.
The masked man snatched with a gloved hand at the collar of her gown, scrunching the stiff starched cloth. He knocked C’s knees from under her with a practised swipe of his boot. Her body folded to the cold stone floor.
‘Why do you persist with this line of thought?’ he asked quietly, kneeling, gesturing to the papers, his lips and hot breath close to her ear. She could smell him and thought, he brushes his teeth, he wears cologne, his uniform is straight, he takes pride in his appearance. He is not like the guards.
C concluded the masked figure is respected, revered as much as feared.
‘Why don’t you forget those calculations?’ A controlled whisper in her ear. ‘It would be easier on all of us. You might even get your job back.’
‘I don’t pick and choose the data,’ she said, ‘What am I supposed to do? Chad set me this task. I…’
‘But you went beyond your remit! A week, a month. Yet here you are writing of decades, millennia.’
‘There is so much to lose,’ she said.
‘Then tell me,’ he said. ‘Hurting you is my role, not my desire.’
C got cautiously to her knees, she opened her mouth but paused.
The interrogator sat on the concrete plinth bed, ‘Go on.’
‘This tower we’re in,’ said C, ‘what does it look like from the outside?’
The masked man considered this strange question. ‘Well it’s… I mean obviously, … it’s…’
‘Well is it square or round, or…?’
‘What does it rest upon? Where does the steel come from?’
These were not questions the interrogator had ever contemplated.
C took a breath and told the interrogator the story of Chad’s rat and the pasta bridge.
When she was done the interrogator nodded and removed the mask. ‘You’re right,’ he said. ‘And it’s obvious really. He can feast, he can walk free, and he can build a bridge. But the sequence matters.’ He paused, thinking, and then added, ‘I need to go, and you should go too.’
The Interrogator closed the door and left.
The tower shivered. The vibrations and groans of a structure stressed. C stood alone in the cell. She pushed the door. It wasn’t locked.
Forward lagging again, with head down, hungry and cold, she hurried to her office. The book still lay on her desk. C took it under her arm and picked a piece of cake from the drawer.
A crash to one side startled her. She turned to see an iron bar jammed through the wall into her office. Jiggling, it levered an opening, and a long metal strut was pushed through. The algorithm was changing things again, maintaining the fine balance of structural integrity. Endlessly trimming the tower like a wing in flight.
A young girl had poked her head through the door at the sound. She looked at C. C looked back. The child was nine or ten years old. As plaster crashed from the office wall, the girl beckoned C. Book secured under one arm, C followed her into the passageway.
‘Over here, I hide in this cupboard when the builders come,’ said the girl.
With the cupboard door closed it was quiet. The girl turned on a flashlight.
‘Why are you dressed funny?’ she asked looking at the prison gown.
‘It’s a disguise,’ said C, ‘someone dressed me up, so people won’t see who I am.’
‘I see who you are,’ said the girl.
‘Yes, but now you’re in on the secret.’ C smiled, ‘Do you want some cake?’
‘Mummy says I’m not allowed it.’
‘But do you want it?’
The girl nodded several quick nods.
‘What’s your name?’ C asked
‘Hi Abi, I’m Cassandra. What do you do in here?’
‘I play with my friends.’
‘In the cupboard?’
The girl nodded again, chocolate icing smudged on her nose.
‘Can I give them some cake?’
‘I suppose so, but…’
‘They’re over here.’ The girl had already run deeper in the storage cupboard to a door. She opened the latch and ducked through.
C followed her into the darkness where there was a smell of urine and wet fur.
‘Shh,’ said the girl. ‘Close the door, they’ll come soon. They like it dark.’
‘The rats are your friends?’
‘But wouldn’t you prefer friends you can talk with?’
‘I can talk with the rats’
‘You can talk with the rats?’
‘What do they say?’
‘Wait and I’ll show you’
‘Look Abi, there’s a big problem. We need to leave this place.’
‘No wait here, the rats have a big problem too. Sometimes I need to call them,’ the girl said and sung a high note. ‘Come on, this way.’
Abi scampered into a shadowy hall accessible through gaps in the structure where a warm draught was blowing. In places the floor was missing too. By some marvel of calculation the algorithm has kept the tower standing for decades as it grew.
The girl was listening now. The hall felt close and hot.
‘Here they come,’ she said, her eyes eager in the faint light.
C heard scuffling and scratching. A chorus of squeaking and peeping followed. A cluster of sleek shadows hustled along a pipe and formed a ring around the girl’s feet. Their chatting high-pitched and constant.
‘Shhh,’ she says to the rats. ‘I’ve brought a friend. Be nice to her.’
There rats sat on their haunches. Their tiny front paws jittered and clawed at the air. Watching with suspicious eyes.
‘He wants to know who you are,’ said Abi pointing to the biggest rat. ‘He wants to know who’s side you’re on.’
The rat squeaked and jittered. Perhaps this girl is lonely thought C. Perhaps she is playing games. Perhaps she is mad.
‘Who is he?’ asked C.
‘He’s their King. He wants to know why you, a big person, will talk to him when the other big people attack and poison his kind?’
‘Tell him I’m sorry for what my people do. Tell him not all of us feel the same way. We don’t all want to kill rats. We’d just rather they didn’t overrun our offices and homes. Those who kill and poison rats do it only to protect their own space.’
The girl whispered to the King. The big grey rat became agitated. He turned around and around on the spot as if chasing his tail. Then he puffed his fur and reared up on his hind paws. He nibbled at the air and hopped up and down.
‘You’ve made him angry,’ said the girl. She watched the rat, listening to his squeaks. ‘Wait, ‘he’s saying more.’
The rat squeaked at length. The girl translating as fast as she could.
‘I am the King of the rats. We lived in those cool quiet tunnels long before your tower arose. At first there was distant rumbling. Our wise elders reflected. They decided that adapting to these vibrations would not do. We were too uncertain of the source, the meaning, what the future held. The elders declared that we must investigate the trembling, and we would have, but the vibrations grew suddenly forceful, and a strange and huge revolving object plundered our great hall. As it withdrew, we saw a tall shaft and light far above us. Investigating this new place, we found the lower chambers of your vast structure. None of us could ever have guessed at the ultimate magnitude of your tower here. For yes, we were beneath the basement of your tower, and we observed your great machines grinding the earth without regard for our tunnels and homes. You drove foundations deep. You set cats and poison upon us. A few of your children heard our pleas, it seemed only they could understand us. But of course, children, though perceptive, lack wisdom and influence. We knew a frontal assault would be futile, so we targeted the weaknesses of your machines. We gnawed cables or wires. For a time, your excavations slowed, but recently you’ve brought more destructive methods. You blast the rock with your fearsome technology and build even greater foundations, in our earth! We have no defence and there was no hope of escape. Until we secured access to the upper floors of your tower.’
C stared at Abi knowing the story could only have come from the rat. She asked, ‘you know how to reach the summit of this tower?’
‘Yes, but we are unable to open the hatch,’ said the Rat King.
In that moment, C foresaw the hatch opening, she had visions of an exodus down endless ladders.
‘Show me the way,’ said C to the rat, ‘I can help you. Abi, find some place safe.’ C handed Abi the book, ‘and take this with you.’
C followed the Rat King. The rats, hordes of them, swarmed from all around and followed the pair. They climbed ladders, walked beams of wood, leaped from girder to girder, swung on dangling cables. Climbing for hours through the maintenance halls of the tower. The horde of rats growing ever larger into a thrashing squealing sea of urgency.
Arriving at the hatch, C was acutely aware that she had never been outside the tower. She wasn’t sure exactly what was outside the tower. She’d heard the stories, read technical reports, and seen drawings. But none of that guaranteed what she might find.
C was sweating as she unscrewed the final nut on the hatch and took its weight as it dropped free from the frame. C looked at the ocean of rats below her. Moisture dripped from holes in iron. The rats looked exhausted. C lowered the panel and let it clang to the floor. A blast of heat and wet buffeted her face.
Wiping her face and eyes of hot stinging rain, C hauled herself onto the roof. Around her stood a disparate array of pylons, antennae and an intricate lattice of catwalks. Yet nothing seemed complete. Whole once-towering needles of steel lay strewn, dismantled. They were sparse metallic skeletons. Gaping holes in the roof revealed canyons of woven iron framework plunging dozens of floors into the interior of the tower. Elevator cables hung idle, their carriages removed. Fixtures and struts and even load bearing girders were gone, wrenched from the fabric of the tower and carried off elsewhere.
Soon there were hundreds of rats swarming beside C, then thousands, millions piling across the roof which creaked.
Looking down, C saw that the tower shot magnificently upwards, kilometres from the rocky ground. It was not symmetrical. Huge spindles of parasitic structures clung to each side. Counterweights dangled from crane-like beams, slowly adjusting to maintain balance. Antenna clawed disorganised craving the sky.
Looking to the distance, C could see a vast land stretched to the horizon, resource rich but empty. The tower stood alone. But it stood on an island of rock. The shores of which were bounded all around by a fearsome precipice. The ruins of a half-finished bridge jutted into the abyss, far short of the land around. The frame of the bridge like some decaying edifice, now a dwindling supply of steel to the ever-hungry tower.
Upon the cracked and broken island of rock around the tower, bound by the precipice, lay twisted iron, cracked concrete, burned and blackened piles of rubber. But there was nothing else. No trees, no birds, no water, no space. The precipice lay between the tower and everything else.
Straining under the untold unbalanced weight of the rat hordes, the structure let cry a sudden wrenching wail. The most violent metallic shudder yet. A plea of agony as steel folded upon itself…
‘And this is the truth?’ said Justice Thomas.
‘It is,’ said Everton.
‘Foolish woman. Half our people have perished. Half the tower is lost over the precipice. What did she think she was doing?’
‘I believe she thought she was saving us from an existential threat.’
‘And what do you think?’ said Thomas.
‘I think it was a good plan. But the algorithm didn’t know. It hadn’t predicted the shifting weight of the rats. Nothing like that was in the training data.’
‘You’ve not spoken like this before Everton. What’s changed you?’
‘C’s story in that cell. In a few words she conveyed the essence of our predicament. That one creative act, though imprecise, perhaps because imprecise, did more to change how I think than a hundred dense short-sighted reports.’
The small girl at the back of the courtroom holding her mother’s hand was deep in thought.
She thought, was Cassandra too foolish or just too late?
She thought, I wonder if the chasm is bottomless?
She thought, it is not the tower that needed stability, but the bridge.
She thought, the sequence matters.
She clutched the book in her other hand.
She knew the word now. The Precipice. One day she would read it.
In 1826 Mary Shelly crafted a vision of humanity’s end in ‘The Last Man’. Depicting a world that persists, indifferent to the demise of our species. The end came at the hands a pandemic, spread by the human technologies of trade and news.
Since the construction of nuclear weapons in 1945 humanity has wielded technological power of extreme destruction, and expert consensus is that the greatest threat to humans are humans themselves.
But given that we are the threat, there is also cause for much hope. Humans are self-reflexive and can change behaviour. Technology has raised the standard of living and human wellbeing worldwide, has provided the tools to escape the Covid-19 pandemic, and promises the foundation for a flourishing future.
Provided we govern and wield technology with appropriate wisdom.
The Existential Risk Observatory, founded in 2021 in the Netherlands, is the latest in a series of global institutions concerned for humanity’s future and with a mission to ensure a thriving global society immune from existential threats.
Driven by optimism for our collective future the Observatory convened a conference on existential risks and invited speakers from around the world.
I had the privilege of presenting my take on biological threats, drawing on research I’d undertaken in conjunction with Nick Wilson of the University of Otago, and others, prior to Covid-19, as well as lessons from New Zealand’s experience with Covid-19, and international research on biological threats.
You can watch my presentation by clicking this link (Session two, talk from 25:10, Q&A from 1:08:55).
Below, I’ve provided the full menu of talks at the conference, which includes:
Existential Risk Observatory (Netherlands) Conference on Existential Risks
25:10 Biological Risks –Matt Boyd (Adapt Research Ltd, New Zealand)
1:26:15 Policy – Rumtin Sepasspour (Cambridge Centre of Study for Existential Risk)
2:52:25 Nuclear Weapons – Susi Snyder (PAX, Nobel Peace Laureate)
3:56:29 Artificial Intelligence Policy – Claire Boine (Harvard & Future of Life Institute)
As Rumtin Sepasspour (Research Affiliate, Cambridge University) noted in his presentation, governments are key stakeholders in the quest for immunity from existential risk, particularly those that arise from accidental or deliberate use of technology. Governments should look at existential risks as a set to be analysed, prioritised and mitigated.
In our quest to understand, prevent, prepare and respond to existential threats every country should hold these meetings of diverse stakeholders to share knowledge and ideas for successfully navigating the period where our technological power outstrips our institutional wisdom.
A new report from the Secretary General of the United Nations ‘Our Common Agenda’, calls on nations to develop foresight and futures capability under an umbrella of coordinated global action.
Aotearoa/New Zealand needs structured foresight, but a well-resourced foresight and risk ecosystem must be funded to support public sector CEOs in producing newly mandated long-term insights briefings.
Long-term insights briefings
The Public Service Act 2020 requires every departmental chief executive to publish a long-term insights briefing (LTIB) independent of ministers every three years, starting in 2022. These LTIBs should include medium and long-term risks.
The briefings are to be tabled in Parliament so all political parties will have access to their content. Public consultation and extensive feedback is expected. The briefings should be think-pieces that can enhance public debate.
On 1 September 2021, Professor Girol Karacaoglu of Victoria University of Wellington chaired a webinar discussion on these LTIBs. Speaking were:
Wendy McGuinness (founder and CEO of the McGuinness Institute)
Roger Dennis (foresight and innovation consultant)
David Skilling (founding Director of Landfall Strategy Group)
McGuinness outlined the history of foresight in Aotearoa/New Zealand, noting the previous existence of a Commission for the Future (disestablished in 1982), which she would like to see returned.
She spoke of the purpose of long-term briefings, they should:
Include foresight andlearnings from hindsight
Be filled with curiosity
Question the status quo
But McGuinness also highlighted ways in which the LTIBs could fail to deliver their intended benefits. CEOs can be busy, shy, humble, uncertain, not foresight experts, risk averse, and desire political safety. Such traits could obstruct the process.
The briefings might be delegated downward, thereby failing to tap into CEOs insights. They might be postponed, rushed, lack sufficient consultation and collaboration.
Roger Dennis noted the volatile, uncertain, complex and ambiguous (VUCA) nature of the world. This state of affairs generates a lot of noise which we must distil.
Past clear examples of inattention blindness underscore the importance of foresight:
Nokia had one billion customers in 2006, but failed to attend to the threat of the iPhone.
The World Economic Forum’s ‘top 10’ global risks did not include pandemic disease
David Skilling highlighted some small developed countries that have good foresight processes. Aotearoa/New Zealand could perhaps learn from Singapore, Denmark, or Finland.
New Zealand is a unique context, but we don’t have to reinvent the wheel at every step and we should approach LTIBs as an international learning and collaboration exercise.
Skilling distinguished three time horizons, the immediate term, the 5-10 year term and the decades-long term, arguing that the medium horizon is of crucial importance, but the right questions must be posed.
Crucially for LTIBs to succeed, Skilling believes there needs to be Ministerial demand for the insights. Though webinar audience members thought demand could and should come from the public, iwi, DHBs, NGOs and so forth.
In contrast to McGuinness, Skilling thought we should avoid relegating important foresight work to a Commission, and we should build strategic capability across government agencies.
There are many reasons why LTIBs (and similar foresight processes) are essential. Such processes can help identify black elephants (a mix between a black swan and the elephant in the room – think COVID-19), they can help guide big important policy decisions to which they relate.
This is particularly important where there are irreversible decisions, such as decisions pertaining to environmental capital. They can help identify and mitigate large-scale risk (think risks as diverse as climate, biodiversity, biological threats, cyber threats, AI, demographic change, antibiotic resistance, workforce, even volcanism at global choke points), provided they are accompanied by a map of broad strokes solution space to scaffold debate and action.
However, LTIBs will not emerge that are fit for purpose unless there is a sufficient eco-system of foresight resources available to CEOs to aid in their production. Additionally, the LTIBs will not have the desired impact unless they can be digested, aggregated and issues prioritised by a sufficiently competent and apolitical central entity.
Such an entity needs to be deeply involved in the process, guiding CEOs with expertise and providing resources so that LTIBs are aligned with current foresight methods, cover appropriate time horizons, include relevant risks, and are sufficiently creative and curious, or we will merely end up with more of the same. Public, transparent consultation with diverse experts in academia, industry and the NGO sector is of absolute importance.
Part of the aim of such consultation should be to ensure the right questions are indeed being answered. The World Economic Forum’s risk report that omitted pandemics prevented the right questions being asked moving forward.
As Roger Dennis noted, an approximate answer to the right question is better than certainty on the wrong one. People tend to refine what they already know rather than casting the net wider. Swiss emergency management demonstrated this during the cold war with more and more precise models of nuclear fall-out, and an infrastructure programme obsessively focused on underground shelters:
“[W]hen looking back at the broader civil defence programme of the period, it is evident that such calculative fastidiousness did not extend to weighing which threats to its security the Swiss nation should pay attention to in the first place. Absent at this point in time are explicit calculations weighing the risk of nuclear war against a plurality of risks. Where evidence of comparative assessment is to be found, the calculative practices at play appear rather loose, and the object of comparison rather limited” (Deville 2018).
Such myopia is dangerous, as New Zealand’s influenza-only pandemic plan demonstrated through 2020, along with a risk register focussed on short time horizons. What is New Zealand’s plan for volcanism at a global logistics choke point? Logistics are a hot topic in a post-Covid world. Or something much more certain and inevitable like the Superannuation burden of our demographic trajectory?
Such fundamental decisions as what to include and exclude from LTIBs must not prevent appropriate public debate on resourcing and prioritisation. I say include it all, in iterative fashion if the task is too great in a first pass. And then facilitate expert debate and prioritisation of the highlights.
A programme of marketing is now needed. Stakeholders should be actively primed to give input to the LTIBs, we should expect to be asked. The briefings themselves should be open to wide peer review.
Wendy McGuinness identified five major foresight think pieces that already exist in the public sector, but that these often fly under the radar. Publicization of the LTIBs when they emerge is critical. Ideally, they should be living documents, with a web-portal where stakeholders can leave feedback in ongoing fashion for the next iteration.
It is my view that without critique, peer-review, public input and societal authorization, these reports may simply serve the status quo.
Moral assumptions should be explicit
The reports should explicitly state the values framework within which they are operating. Why were some future possibilities prioritised for elaboration and not others? They should be accompanied by appendices of topics and themes not included, with an explanation of why not. It is one thing to fail to foresee, but to foresee but ignore must be justified to the public. This is a major shortcoming of one of the existing tools for management of future risks, the National Risk Register, which is classified and not open to scrutiny.
An ecosystem is needed with central aggregation
Unlike other countries, New Zealand lacks a surrounding ecosystem of think-tanks, universities, and large companies developing long-term views on a range of subjects.
For the LTIBs to be done well, to overcome siloed orthodoxy and cognitive biases, support for CEOs will be needed. This support needs to be central and apolitical. Commissions are not sufficiently central to the fundamental mechanics of the public sector, can be ignored, poorly funded or disestablished. Central entities such as DPMC, though apolitical in name exhibit features of politicisation, and a lack of transparency.
A Parliamentary Commissioner, with a well-resourced office of talent, answerable to Parliament (with Select Committee oversight), could be tasked with supporting foresight and risk aspects of these processes. Given the major decisions, some irreversible, about the future that could follow the aggregation of LTIBs, there is value in investing in this capability.
The first round of these reports should be written by experienced multidisciplinary teams, include the possible impacts of extreme risks, as well as a search for as yet unidentified problems. High-level mitigation strategies should be proposed for the public to debate.
LTIBs could be a step towards a very positive future for Aotearoa/New Zealand, but only if executed well.
In the wake of the Covid-19 pandemic, everybody now knows that:
Warnings about pandemic disease had been touted for decades
Myriad organisations had called for increased health security funding
The world ignored all these warnings
SARS-CoV-2 emerged in 2019 with dire consequences
The fact that all these warnings were known, yet action was scant, remains difficult to comprehend. Although somewhat perversely, we even knew we would ignore the warnings. Psychological research has shown that these kinds of rare but devastating events are exactly the ones humans tend to overlook. As if to drive this point home, I noted in the news today that a resident of Westport (a New Zealand town flooded by a ‘1 in 100 year event’) even stated that he knew the area had flooded, but thought “the last one was it”.
The ‘unforeseen’ Covid-19 surprise
International organisations such as the UN, WHO, World Bank, and organisations such as the US National Academy of Sciences had made explicit warnings to governments across many years about pandemic and emerging infectious disease risk.
The human and economic impact of pandemic disease had been detailed, and estimated at half a trillion dollarsper year (Fan 2017). The measures the world needed to take to detect, prevent and respond to infectious disease had been widely circulated and all the States Parties to the International Health Regulations had committed to implementing them (few contributed substantial resources and few had succeeded by the time Covid-19 struck).
No country was adequately prepared for Covid-19 (Dalglish 2021). The risk of coronaviruses had not been appropriately understood by governments, and many pandemic action plans (New Zealand’s included) focused solely on influenza.
A coronavirus pandemic simply wasn’t foreseen many would cry. We were struck by a black swan.
Covid-19 was no black swan
Black swans, are outlier events that comes as a surprise, have a major effect, and are inappropriately rationalised after the fact (Taleb, 2007).
However, coronavirus pandemics had been identified as a ‘time bomb’ after SARS 2003, and had been specifically workshopped in 2019 at the ‘Event 201’ pandemic exercise. This exercise involved leaders from a number of public and private global organisations contemplating how to deal with a coronavirus pandemic that kills 65 million people.
This table-top exercise took place in New York on 18 October 2019, when plausibly the first cases of Covid-19 were emerging half a world away. Within six weeks a handful of concerning cases were being discussed with alarm by experts on the ProMED bulletin board.
None of this fits the ‘surprise’ aspect of a black swan.
In the face of Covid-19 New Zealand lacked public health infrastructure (Baker, Wilson, & Woodward, 2017), lacked surge capacity (Skegg, 2021), and decision-makers had not previously contemplated the most effective measures ultimately deployed. These turned out to be border closure and comprehensive managed isolation.
In fact, as far back as 2017 two New Zealand academics (the author included) had started modelling the threshold criteria for when border closure for pandemics might be economically rational (Boyd 2017, 2018, 2019, 2020). We approached individuals at the Ministry of Health with a research proposal only to be told that border closure in a pandemic would never be a policy option and as such no funding could be provided to explore the policy in more detail.
Had these ‘left field’ organisms (coronaviruses!) and mitigation approaches (border closure) been pre-contemplated, then ‘off the shelf’ solutions, or at least solution outlines, might have been available at the time the pandemic struck. Appropriate border policies enacted in time might have prevented the mind-bogglingly expensive lockdowns New Zealand endured, and appropriate MIQ protocols might have prevented the second Auckland lock-down.
Historical myopia slowed New Zealand’s border control action leading to a troubled and porous approach amid inadequate legislation and the deficient public health infrastructure (Skegg, 2021).
Shortcomings were not unique to New Zealand and structural and textual failures in guiding regulations and processes at the international level, namely the International Health Regulations, and the World Health Organization generally, had been criticised, and continue to be criticised (Boyd & Wilson, 2021).
We knew the threat and we knew there would be a striking lack of global coordination. Covid-19, and its global ramifications, was no surprise, and therefore no black swan.
The black elephant
Indeed, the Covid-19 pandemic was a paradigmatic black elephant, a catastrophe that was extremely likely and widely predicted by experts, but ignored or simply unspoken (Asayama 2021).
Gupta describes a black elephant as:
‘an event which is extremely likely and widely predicted by experts, but people attempt to pass it off as a Black Swan when it finally happens. Usually the experts who had predicted the event – from the economic crisis to pandemic flu—go from being marginalized to being lionized when the problem finally rears its head’ (Gupta, 2009).
Knowledge about human cognitive biases explains why we ignore these kinds of risks (Gluckman 2021).
Overall, and painfully, not only was the threat of Covid-19 known, but we also knew that we would ignore it. There existed a myopic focus on day-to-day health needs, health policy that considers only the health sector, a reactive, response-focused approach, and lack of attention to future welfare. In general, a reluctance to address catastrophic risks, yet these kinds of risks harbour almost all the harm.
Escaping black elephants
By definition, information about black elephants is widely understood. To properly prepare for them governments must look both outwardly and inwardly.
Governments must engage experts not just policy wonks
Looking outward, we need to see crowd-sourced solutions, the power of superforecasters must be harnessed, and governments need to enlist assistance engaging in problem-finding, rather than mere problem-solving activities. These tasks will require close engagement with:
experts in academia
industry leaders & technical experts
Although sensible plans might already be in place, there is always the possibility (or in the case of coronaviruses, probability) that reality will fall beyond the scope of established plans. Red-teaming approaches are needed, experts should be engaged to try to break existing plans. This requires openness and cooperation.
A percentage of preparatory investment should go to diversifying approaches to outlier events, especially when they are inevitable, as is the case with many black elephants. These days a few tens of millions of dollars thrown at understanding these problems, in order to draw the possibility space of mitigation measures, now looks trivial.
Public sector departments must self-critique
Perhaps more important than looking outward is looking inward. Governments must engage in institutional self-reflexivity and this is a process that must be supported from the outside.
Some of the greatest threats are the processes of governance themselves. These processes can become stuck through entrenchment, inertia, historical myopia, status quo, lack of imagination, ignorance, adherence to ‘best-practice’ and corruption by vested interest.
There must be a continual process of self-evaluation and self-critique. In a world of rapidly accelerating technology and human impact, the days of government departments simply justifying post-hoc their pre-formulated plans must end. A radical revision of risk and responsibility is needed, with diverse inputs and ‘crazy ideas’ articulated in detail and held on file for when they are needed.
National and global catastrophic risks must be the purvey of the population not merely the secret notebooks of Cabinet and DPMC spooks.
Asayama, S., Emori, S., Sugiyama, M., Kasuga, F., & Watanabe, C. (2021). Are we ignoring a black elephant in the Anthropocene? Climate change and global pandemic as the crisis in health and equality. Sustainability Science, 16(2), 695-701. doi:10.1007/s11625-020-00879-7
Boyd, M., & Wilson, N. (2021). Failures with COVID-19 at the international level must not be repeated in an era facing global catastrophic biological risks. Aust N Z J Public Health, Feb 23. doi:doi: 10.1111/1753-6405.13082
Boyd, M., Baker, M. G., & Wilson, N. (2020). Border closure for island nations? Analysis of pandemic and bioweapon-related threats suggests some scenarios warrant drastic action. Aust N Z J Public Health, 44(2), 89–91. doi:10.1111/1753-6405.12991
Boyd, M., & Wilson, N. (2019). The Prioritization of Island Nations as Refuges from Extreme Pandemics. Risk Analysis, 40(2), 227–239. doi:10.1111/risa.13398
Boyd, M., Mansoor, O., Baker, M., & Wilson, N. (2018). Economic evaluation of border closure for a generic severe pandemic threat using New Zealand Treasury methods. Aust NZ J Public Health, 42(5), 444–446.
Boyd, M., Baker, M., Mansoor, O., Kvizhinadze, G., & Wilson, N. (2017). Protecting an island nation from extreme pandemic threats: Proof-of-concept around border closure as an intervention. PLoS ONE, 12(6), e0178732. doi:10.1371/journal.pone.0178732. eCollection 2017.
Dalglish, S. L. (2020). COVID-19 gives the lie to global health expertise. Lancet. doi:10.1016/s0140-6736(20)30739-x
Fan, V. Y., Jamison, D. T., & Summers, L. H. (2017). The Loss from Pandemic Influenza Risk. In D. T. Jamison, H. Gelband, S. Horton, P. Jha, R. Laxminarayan, C. N. Mock, & R. Nugent (Eds.), Disease Control Priorities: Improving Health and Reducing Poverty. Washington DC: The World Bank.