View all newsletters
Sign up to our newsletters

Support 110 years of independent journalism.

  1. Spotlight on Policy
7 June 2019updated 27 Jul 2021 2:20pm

Spotlight Leader: The danger of the Black Box

By Spotlight

There are many examples of fiction for previous decades that, with hindsight, seems to have predicted the modern age, but few appear as prescient – and from such a distance in time – as EM Forster’s The Machine Stops, written in 1909. The story begins with a scene that many have argued presaged internet use by a century. A woman sits alone in a room, surrounded by technology. She can summon food or entertainment at the touch of a button, but she is bothered by constant notifications from an unseen community – “she knew several thousand people” – but she never sees anyone in person. In a line every internet user will relate to, she says: “Here I am in the dark, wasting my time”.

But Forster’s story may come to seem even more prescient in the years to come. We already live in an time in which most people are not able to explain more than a superficial amount about the technology by which they are surrounded every day. This is a new situation for humanity, and a confusing one, but it is still possible to learn how things work. As artificial intelligence becomes more sophisticated and more widespread, people will begin to use technology that no human is able to explain.

In fact, this is already happening. It is already the case that engineers and researchers are unable to explain the ways in which the AI algorithms they’ve created reach the conclusions that they do. There are engineers developing self-driving cars who are not able to get the information about why, in a given instant of a journey, the car decided to act in a certain way. Deep learning techniques applied to medical science appear to be very good at predicting the onset of some diseases, but because the software has written itself, researchers are not able to say how they work.

Few technologists worry about a robot uprising. But there is increasing unease that if the technologies that run our world become inexplicable, we may stumble into the situation Forster predicted: “No one confessed the Machine was out of hand. Year by year, it was served with increased efficiency and decreased intelligence. The better a man knew his own duties upon it, the less he understood the duties of his neighbour, and in all the world there is not one who understood the monster as a whole.”

To access the full Spotlight supplement, click here.

Content from our partners
Unlocking the potential of a national asset, St Pancras International
Time for Labour to turn the tide on children’s health
How can we deliver better rail journeys for customers?

Select and enter your email address Your weekly guide to the best writing on ideas, politics, books and culture every Saturday. The best way to sign up for The Saturday Read is via saturdayread.substack.com The New Statesman's quick and essential guide to the news and politics of the day. The best way to sign up for Morning Call is via morningcall.substack.com Our Thursday ideas newsletter, delving into philosophy, criticism, and intellectual history. The best way to sign up for The Salvo is via thesalvo.substack.com Stay up to date with NS events, subscription offers & updates. Weekly analysis of the shift to a new economy from the New Statesman's Spotlight on Policy team. The best way to sign up for The Green Transition is via spotlightonpolicy.substack.com
  • Administration / Office
  • Arts and Culture
  • Board Member
  • Business / Corporate Services
  • Client / Customer Services
  • Communications
  • Construction, Works, Engineering
  • Education, Curriculum and Teaching
  • Environment, Conservation and NRM
  • Facility / Grounds Management and Maintenance
  • Finance Management
  • Health - Medical and Nursing Management
  • HR, Training and Organisational Development
  • Information and Communications Technology
  • Information Services, Statistics, Records, Archives
  • Infrastructure Management - Transport, Utilities
  • Legal Officers and Practitioners
  • Librarians and Library Management
  • Management
  • Marketing
  • OH&S, Risk Management
  • Operations Management
  • Planning, Policy, Strategy
  • Printing, Design, Publishing, Web
  • Projects, Programs and Advisors
  • Property, Assets and Fleet Management
  • Public Relations and Media
  • Purchasing and Procurement
  • Quality Management
  • Science and Technical Research and Development
  • Security and Law Enforcement
  • Service Delivery
  • Sport and Recreation
  • Travel, Accommodation, Tourism
  • Wellbeing, Community / Social Services
Visit our privacy Policy for more information about our services, how New Statesman Media Group may use, process and share your personal data, including information on your rights in respect of your personal data and how you can unsubscribe from future marketing communications.
THANK YOU