Behavioral Health Updates
Technology

Everyone's selling you AI. What you actually need is software that's right every time.

The whole category is racing to rebrand as AI-native. But a probabilistic model in the wrong place, on a claim amount or a census count, turns an impressive demo into a document that contradicts itself. And the AI is unproven where it counts.

Sit through three treatment-software demos this quarter and you will hear the same word in all of them. AI. Everyone is racing to rebrand as AI-native. One vendor rebranded around it after a merger. Another raised $41 million on the pitch. A third put AI on the admissions phone.

The problem is not that AI is useless. It is that most vendors are pointing it at the wrong job.

AI is a good first draft and a poor source of truth

A probabilistic model is exactly what you want for a summary or a suggested reply. It is exactly what you do not want deciding a claim amount, a contract term, or a census count, because when it is wrong, it is wrong with total confidence.

The reliability data is now in, and it is sobering. Ambient AI scribes show a 26.3% mean error rate across platforms (Mayo Clinic Proceedings: Digital Health, 2025), and hallucinations appear in 31% of AI-generated clinical notes versus 20% of physician notes (peer-reviewed, 2025). Meanwhile 62.6% of Epic hospitals had already adopted an ambient AI documentation tool by mid-2025 (AJMC, 2025). Adoption is racing ahead of validation. Many of these tools are classified as administrative rather than medical, so they bypass FDA review entirely.

Intelligent automation is a different thing

There is a category of software that does the reliable work without guessing. It is deterministic. Data flows through a defined pipeline. Financial math is enforced by rules that cannot produce an impossible number, so collected can never exceed allowed, which can never exceed billed. Records are updated in a way that a failure cannot leave a hole. This is not glamorous, and it does not demo as well as a chatbot. It just runs, and you can audit every step.

The honest version of the pitch

The strong claim is not "we have no AI." That would be a lie, and a checkable one. Good products use AI where a mistake is cheap, like an in-app help assistant or a safety filter, and keep it far away from the numbers that run your business.

So the question to ask a vendor is not "do you have AI." Everyone will say yes. The question is "what happens when it is wrong, and what does it touch?" If the answer is your census, your billing, or a document a patient signs, that is not innovation. It is a liability with a good marketing budget.

AI is great at a first draft. It should not be the last word on your revenue.

Keep reading

Software & Adoption

Change is hard. So is the slow bleed of a tool your team won't use.

Switching systems is a real project, and "it's too hard to change" keeps a lot of operators on software everyone quietly hates. But staying is a decision too, and it has a price you are already paying.

Michael J. Wilson Jr., CIP, CFI ·

Behavioral Health Updates is an independent industry publication published by vProGo.