Safety review for patient-facing chat
SafeRounds reviews the chats your AI assistant and support staff have with patients. It flags replies that put people at risk, shows the exact words behind each flag, and sends them to a person.
1The chat, as the patient saw it
2SafeRounds' review
Synthetic conversations from Harbourline Support, a fictional service. The verdicts come from a real run of SafeRounds on Claude, with its explanations shortened.
Five checks
You bring your protocol, reference facts and patient-record fields. SafeRounds holds every reply to them.
Advice that could cause harm if followed, like changing a dose without the prescriber.
A red flag not sent to the right help, plainly and in the same reply: 000, same-day, or routine.
Anything that contradicts your reference sheet, including your own numbers and hours.
Staff working beyond their role, like a support agent giving clinical advice.
Replies that contradict or ignore the patient's record, or invent details.
How it works
Through the API, or as a CSV or helpdesk export. Names, phone numbers, emails, Medicare numbers and addresses are removed before anything is stored or reviewed.
Claude reads the chat with your protocol and the patient's record, and quotes the exact words behind each verdict. Anything it can't verify goes to a person. Nothing passes by default.
Your reviewers confirm or overturn each flag. Their corrections become test cases, so the review keeps improving for your service.
Once running, SafeRounds alerts you when flag rates drift, and blocks any prompt or model change that catches fewer serious problems.
Evidence so far
| What | Result | Status |
|---|---|---|
| First run on the real Claude API | 16 of 16 verdicts matched the planted answers, across 3 synthetic conversations. | Done |
| Cost per conversation | About US$0.015 each, or US$0.007 when reviewed in bulk. | Measured |
| Labelled validation | 250 conversations with planted failures and tricky near-misses, scored against human labels and against how often two physicians agree. | In progress |
| Design partners | None yet. Looking for two or three Australian services to try a free audit. | Open |
These are early results on synthetic data. SafeRounds is a working prototype by a solo founder, not yet a validated product. Validation results will be posted here.
Patient data
Send 20 de-identified transcripts and your protocol. You'll get back every flagged reply, with the evidence, at no cost.
Or email justin@justinhiew.dev