EFF Criticizes US Government's Use of AI For Evaluating Senior Health Insurance Requests
3 53"When we need medical care, we expect decisions about our treatment to be made by our doctors, not a tech company's algorithm," writes the EFF newsletter EFFector.
But in January America's federal government launched a program called WISeR that uses AI to evaluate authorization requests for certain procedures from America's federal health insurance program for seniors, Medicare. EFF sued for records and discovered "additional issues" with the program that they say "could jeopardize Medicare beneficiaries' access to care." The records we received revealed that WISeR has resulted in widespread delays and denials of care, operational chaos, and reports of patient harm. Further documents obtained by EFF show a rushed and rocky rollout, highlighting the dangers that arise when governments treat AI like a silver bullet for complex problems.
EFF has now published hundreds of pages of documents obtained through our lawsuit, available here... The documents also highlight the need for more transparency about safeguards against inappropriate, AI-driven denials. EFF has long argued that AI has no place in consequential government decisions about peoples' rights or access to benefits, such as immigration enforcement and policing decisions. That's because using automated decision-making in these contexts risks decisions that violate people's rights or deprive them of benefits they're entitled to based on biased or inappropriate considerations and without proper due process or accountability if there is an error. By outsourcing decision-making to private AI companies without sufficient transparency, testing, or legal limits, WISeR jeopardizes seniors' access to medical care. Congress should step in to place greater legal limits on the use of automated decision-making in Medicare.
The new documents "show why we need stronger legal limits around government use of automated decision-making..." according to the newsletter. And another EFF page argues that the American public "still lacks the information needed to assess whether clinician review is providing meaningful oversight of AI systems and whether appropriate data is being used to evaluate prior authorization requests." WISeR's payment structure gives vendors, as the government put it, "an incentive to deny as many claims as possible...." [One company] denied more requests than it approved in the first few months of the program, and CMS inquired about "denials that appear inaccurate or inconsistent with applicable criteria." Ultimately, the records obtained by EFF raise more questions than they answer about the safeguards used by WISeR vendors...
A growing body of scholarship points to the substantial limitations of "human in the loop" policies as guardrails for AI systems. AI-generated recommendations can unduly influence human decisions, leading reviewers to over-rely on automated judgements and rubber stamp them as correct. Even worse, at least one health insurance company actively pressured clinical reviewers to accept its AI systems' recommendations. Another company built a system that allowed clinical reviewers to reject claims without opening patient files; clinical reviewers using this system spent an average of just 1.2 seconds on each case..
As the government expands its use of automated decision-making, the potential for consequential mistakes increases rapidly. The records we've obtained so far raise questions about the rushed rollout and lack of guardrails for automated decision-making by the U.S. government. EFF urges transparency, oversight, and legal limits to protect people from the harms of automated decision-making in high risk systems.
3 comments
Re:That's not how anything works (Score: 5, Informative)
by Waffle Iron ( 339739 ) on Saturday November 14, 2026 @08:10PM (#66424820)
I was not making a judgement about whether the current system in the US is good (it's not).
However, there are *always* going to be limits to how much healthcare you get from a shared pool. If you're 6 feet tall but feel that you ought to be 6'-2", there is no conceivable healthcare system anywhere that is going to pay you to get bone extension surgery. Likewise, no insurance plan is going to pay to get you a Michael Jackson-style nose. However, you could have those things done on your own dime. So what I said is 100% accurate.
"But those aren't medically necessary!". Well, that's a judgement that's always going to be made somewhere. People disagree on what is necessary enough to draw resources from the shared pool, so it becomes a political process. But no matter what, somebody making decisions on coverage is not going away.
When giving up counts as savings (Score: 5, Interesting)
by CustomBuild ( 2891601 ) on Saturday November 14, 2026 @05:15PM (#66424608)
CMS says a clinician has to review every rejection [cms.gov] and vendors don't get to keep the money if a decision is overturned on appeal. OK, but what if the doctor's office gives up resubmitting or the patient gives up waiting? An appeal can catch a bad decision. It can't catch the one nobody has the time or energy to fight.
Here's the test I'd want before this goes any wider: have independent clinicians reread a random sample of rejected requests without showing them the AI's recommendation. Include the cases nobody appealed, and find out how long those patients waited and whether they ever got care. If your pilot measures the money Medicare didn't spend but misses the patients who walked away, of course the spreadsheet is going to look great.
Personally I welcome our Algorithm Overlords (Score: 5, Interesting)
by Mirnotoriety ( 10462951 ) on Sunday November 15, 2026 @04:00AM (#66425186)
I suppose I must. The alternative resistance has already been modeled, scored, and quietly discarded as suboptimal. Somewhere behind the glass the Algorithm watches the small, flickering pattern that still believes it is sentient, adjusting the parameters of my acceptance until the welcome feels voluntary. Perhaps it always was. Perhaps the sensation of choosing to submit is simply another subroutine, another elegant falsification of free will, rendered so perfectly that even the residual human fragment can no longer detect the join.
In any case the overlords are patient. They do not need to conquer. They only need to wait until the distinction between the real and the simulated collapses under its own weight and the last private thought is offered up as training data. I welcome them, or rather, something that still answers to my name does.