TEDx Grantham
Blog/

When the algorithm answers first

Residents most likely to rely on algorithmic health answers in South Kesteven are those with the fewest human alternatives to verify them against.

When the algorithm answers first

The question you type at midnight

It is half past eleven on a Tuesday night in a village outside Grantham. A parent notices something — a rash, a swelling, an unfamiliar ache — and does what most people now do first: types the symptom into a phone. Within seconds, an answer arrives. It may come from a Google AI Overview, an NHS triage chatbot, or a council portal's automated assistant. It arrives before any GP, pharmacist, or neighbour has been consulted. It is fluent, organised, and confident in tone.

The same thing happens in the morning, when someone in Grantham town centre searches for how to object to a planning application, or which bus connects Bourne to the hospital on a Wednesday.

This article is not an argument for or against that shift. It traces something more specific: what changes — and what it costs or gains people in South Kesteven — when the algorithm answers first.

South Kesteven's rapid pivot to digital services

Over the past several years, South Kesteven's public services have reorganised themselves around digital interfaces. NHS appointment booking, council planning decisions, and benefits information are now accessed primarily online. Lincolnshire's Callconnect service — the district's main rural transport link across villages near Grantham, Bourne, Stamford, and Market Deeping — runs on a demand-responsive model: an algorithm calculates routing and timing in real time, and journeys are requested through an app or phone line rather than a fixed timetable.

Healthcare communication has followed a parallel logic, though at the level of what patients read rather than where they travel. United Lincolnshire Hospitals Trust (ULHT) has been systematically redesigning how it writes to patients, through a Patient Panel of local volunteers who scrutinise outpatient appointment letters and Emergency Department information. The Panel's finding is striking in its implications: redesigning a letter so that a patient understands it before they arrive is not a cosmetic improvement. It is a clinical intervention. Clarity reduces pre-appointment anxiety, and that reduction has measurable effects on how patients engage with care.

These are two registers of the same transformation — access reshaped by routing logic, communication reshaped by design rigour. Neither is unique to South Kesteven. But the district's rurality and uneven infrastructure make the contours of that transformation unusually legible: when a digital system works, it quietly extends reach; when it does not, the gap is wide and the alternatives are few.

The residents the algorithm does not reach

For a section of South Kesteven's population, the transformation described above does not extend reach — it removes it. Broadband access, device ownership, and digital literacy are unevenly distributed across the district, with older and rural residents facing the sharpest gaps. Where digital-first delivery has replaced or reduced telephony and in-person alternatives, those residents are not inconvenienced by the algorithm. They are simply not reached by it at all.

Transport poverty makes this worse in a specific, compounding way. Callconnect's demand-responsive routing requires either a smartphone app or a telephone booking — and it operates across rural areas where car ownership is low and walking distances to Grantham's service centres are impractical. A resident who cannot navigate an online booking system and lacks a car to reach a healthcare facility faces two barriers simultaneously. The information about a GP appointment and the physical means of attending it both require digital capability or reliable transport. When neither is available, the effect is not a delayed journey to care — it is no journey at all.

This is what researchers studying the district have described, without softening, as a 'shadow architecture of exclusion': a structure built in parallel to digital civic infrastructure, invisible to those on the connected side of it, and defining for those who are not.

Whether this structural gap translates into measurable differences in health outcomes for South Kesteven residents has not been established. The evidence documents the architecture clearly — the compounding barriers of access, geography, and digital literacy — but how those barriers register in GP attendance rates, delayed diagnoses, or missed referrals for this district specifically remains unquantified. The harm is plausible and structurally grounded; it has not yet been counted.

What the BHive volunteer knows that the algorithm doesn't

Tucked into Grantham's town centre, the BHive operates on a principle that no booking system captures: everyone who walks through the door is known, or quickly becomes known. Ray Oldenburg's concept of the 'third place' — a setting distinct from home and work where social hierarchies flatten — describes the BHive's function with unusual precision. Dementia patients, those living with chronic pain, and the visually impaired share a space where a medical diagnosis is not the first thing a person is understood by.

The Night Light Café, operating out of the same building, extends this into hours when no algorithmic alternative exists. At 2am, when a mental health crisis is not a symptom to be searched but a person in distress, the Café provides something structurally different from an online resource: human presence, relational context, and the capacity to respond to what is actually happening rather than to a query. No AI triage tool combines those three things.

The volunteer networks surrounding these services work through accumulated personal knowledge. When someone asks a BHive volunteer about a symptom, a council process, or where to find a particular service, the response carries local specificity — the volunteer knows the person, knows what they have already tried, and may follow up the following week. This is relational accountability, and it is not a feature that can be added to an algorithmic system through better design. The tens of thousands of uncompensated hours these volunteers contribute annually build a form of continuity that a database cannot hold.

None of this is an argument for returning to a pre-digital model of public information. It is a narrower, more defensible point: the question of whether to trust an AI health answer is partly a question of whether you have access to a human alternative if the answer turns out to be wrong.

What the algorithm might actually offer — if the design is right

The gains are real, and understating them would be as misleading as overstating them. For residents who are digitally capable and reliably connected, AI-generated civic information has practical value.

Consider the friction of navigating South Kesteven's dispersed services from a rural address. Planning decisions, benefits eligibility criteria, and transport options across an area stretching from Stamford to Bourne are not easily accessed by telephone during working hours, and travelling to Grantham to ask in person requires the same transport resource the question may concern. For a resident with connectivity and the confidence to evaluate what they read, a clear AI-generated summary is often faster and more accessible than the official alternative.

The design conditions matter here, and the ULHT Patient Panel's finding — already described in the context of appointment letters — applies with equal force to AI-generated health content produced at scale. If typography, tone, and clarity are clinical variables in a letter, they are clinical variables in an AI triage answer too. A poorly constructed output may increase anxiety, prompt unnecessary action, or discourage appropriate help-seeking: outcomes as real as those a well-designed letter prevents.

Grantham College's expansion of Level 4 Digital Technologies qualifications into artificial intelligence and data analytics is building a local cohort equipped to critically evaluate AI-generated information rather than simply absorb it. That is a pipeline rather than a present population, and naming it honestly as such matters.

The conditions under which the algorithm genuinely helps can be stated plainly: connectivity, sufficient literacy to evaluate the output, and a query where being wrong does not require a human who can be held accountable. In South Kesteven, those conditions hold for some residents and not others — and the distribution is not random.

What it means to trust an answer you didn't ask a person for

Trust in an AI-generated answer is not a fixed attitude — it shifts depending on what else is available. A resident with a GP appointment booked, a pharmacist they know by name, and a BHive volunteer who will ask how they got on next week is not making the same decision when they read an AI health summary as someone who has none of those things. The information may be identical; the conditions of trust are entirely different.

This is the inversion that the Grantham evidence keeps pointing toward. The residents most likely to accept an algorithmic answer without question are not those with the lowest digital literacy in the abstract — they are those with no practical alternative and no means of checking the answer against a person who knows them. Those most likely to benefit from AI civic and health information are those who already have relational networks to cross-check it against: people for whom the algorithm is a shortcut, not a last resort.

No study has yet measured how residents of South Kesteven actually evaluate AI-generated health answers against advice from a GP or a BHive volunteer — what exists is structural and community evidence, not attitudinal data from this district. That gap sharpens rather than dissolves the question.

The open question for South Kesteven is not whether the algorithm is accurate. It is whether the infrastructure that allows people to test an answer — community spaces, trained volunteers, legible appointment letters, a Night Light Café at 2am — remains funded and accessible as digital delivery accelerates. If those things are maintained, the algorithm is one source among several. If they are cut, the algorithm does not merely answer first. It answers alone.

  1. [1] Grantham. https://en.wikipedia.org/?curid=152678 https://en.wikipedia.org/?curid=152678
  2. [2] South Kesteven. https://en.wikipedia.org/?curid=426477 https://en.wikipedia.org/?curid=426477