Technology 02 · BCI
AI draft
Nobody on the team has reviewed this page yet. An AI model wrote it as an outline for the team to react to, so treat every line and every rating as unchecked.
Could brain computer interfaces help people keep up with AI?
Brain computer interfaces connect the nervous system to a computer. Implanted devices already let a small number of people with paralysis move a cursor or produce text. The bigger claim is that much faster interfaces could keep people in charge of increasingly capable AI and keep their work worth paying for.
Where we land
Full scorecardAll six ratings are Unclear for now. In each case the reason is that we haven't finished looking.
- Alignment case
- Intelligence CurseThe risk that increasingly capable AI reduces the economic and political value of human work and participation, and so weakens human agency. case
- Human welfare risk
- Artificial-mind welfare and rights risk
- Governance risk
- Safeguard adequacy
No milestones mapped yet
How to read the marks
- From a sourceQuoted word for word from a cited source.
- Our readThe team's own interpretation.
- AI-suggestedSuggested by an AI model, set in a dashed outline.
- UnclearWe don't know yet, and the tag gives the reason.
At a glance
AI-suggested and not yet reviewed, unless marked
- What it claims to solve
Alignment. One argument is that if people are tightly linked to AI systems, the systems will act as extensions of human intent and won't become separate agents with goals of their own.
- How it would work
Implanted or wearable devices record brain activity and decode it into commands, text or speech.
- Strongest case
Of the three technologies on this site, BCIs are the most concrete.
- Strongest objection
Bandwidth may not be the bottleneck. The hard part of overseeing AI is understanding what it's doing, and a faster channel into a human brain doesn't obviously make that easier.
- Artificial minds
If a device writes to the brain, where does the person end and the system begin?
- Main welfare risks
Brain data can reveal things people never chose to share, and a device that writes to the brain could be used to nudge mood or decisions.
How it would work
AI-suggested and not yet reviewed, unless marked
What it claims to solve
Alignment. One argument is that if people are tightly linked to AI systems, the systems will act as extensions of human intent and won't become separate agents with goals of their own.
The Intelligence Curse. A person working through a fast interface might do more than either a person or an AI alone, so human work would still be worth paying for as AI improves.
The mechanism
Implanted or wearable devices record brain activity and decode it into commands, text or speech. More advanced devices also write information back by stimulating neurons.
The argument goes that with enough bandwidth, people could follow and steer an AI's reasoning as it happens and have a say in each important decision.
Strongest case and objections
AI-suggested and not yet reviewed, unless marked
For
The strongest case
- 01
Of the three technologies on this site, BCIs are the most concrete. Implants already restore some movement and communication in clinical trials, so the basic technology exists and is getting better.
- 02
A person stays in the loop by design, because the system acts on someone's intentions.
- 03
Medical demand pays for progress, since restoring movement and speech is worth doing whether or not the alignment argument holds.
Against
The strongest objections
- 01
Bandwidth may not be the bottleneck. The hard part of overseeing AI is understanding what it's doing, and a faster channel into a human brain doesn't obviously make that easier.
- 02
A company, a government or the AI itself could use a device that writes to the brain to monitor the person wearing it, or to manipulate or pressure them.
- 03
Access is likely to be unequal. If enhancement is expensive or risky, it could widen the gap between people who have it and people who don't, which would make the Intelligence Curse worse.
Artificial minds
AI-suggested and not yet reviewed, unless marked
Open questions
If a device writes to the brain, where does the person end and the system begin? A change in mood or a decision might be hard to attribute to either one.
Should people be able to remove an interface without losing abilities, or a sense of self, that they've come to rely on?
Who owns the data a brain produces, and the device itself, if the company that made it fails?
Welfare and governance risks
The team hasn't assessed welfare and governance risks in detail yet. The current risk ratings are in the full scorecard.
Milestones
The team hasn't mapped any milestones for this technology yet.
Full assessment
The full scorecard with the basis for each rating.
Show the full assessmentHide the full assessment
AI-suggested and not yet reviewed, unless marked
Full scorecard
The ratings use the scales in the team’s draft scorecard. “Not claimed” means the proposal doesn’t claim that outcome, so there is no case to grade. We never rate a risk Low just because nobody has studied it, and the cutoffs for the risk ratings aren’t set yet. How we rate
| Dimension | Rating | Confidence | Basis |
|---|---|---|---|
| Alignment caseCase · Alignment | UnclearSearch incomplete | Low | Most versions of this argument don't explain how a faster link would make an AI system safer, and the search for a proposal that does isn't finished. |
| Intelligence Curse caseCase · Intelligence Curse | UnclearSearch incomplete | Low | It's plausible that augmented people would stay economically relevant, but that depends on cost, safety and who gets access. |
| Human welfare riskRisk | UnclearSearch incomplete | Low | Brain data can reveal things people never chose to share, and a device that writes to the brain could be used to nudge mood or decisions. Employers could use headsets to monitor workers, and users may come to depend on a device its maker can stop supporting. How likely or severe these harms are hasn't been weighed. |
| Artificial-mind welfare and rights riskRisk | UnclearSearch incomplete | Low | The risk to artificial minds hasn't been assessed. The open questions we've found for BCIs are about the person using the device, such as where the person ends and the system begins. |
| Governance riskRisk | UnclearSearch incomplete | Low | Only a few places have rules on who may collect, own and use brain data. |
| Safeguard adequacyCase | UnclearSearch incomplete | Low | Medical device rules cover implants used in clinics, but consumer and workplace headsets may fall outside them. We haven't checked whether existing privacy and device rules are enough. |
Grading key