The Ethics of AI in Medical Diagnosis and Treatment

Using AI in medical diagnosis and treatment is ethical when it demonstrably improves care, is tested for bias across patient groups, keeps clinicians accountable for decisions, protects patient data, and is honest with patients about its role. The hard questions are less about whether to use AI and more about how it is validated, governed and monitored.

Key takeaways

  • Clinical AI should support clinical judgment, with a named human accountable for each decision.
  • Bias testing across age, sex, race and care setting belongs before and after deployment.
  • Patients deserve to know when AI meaningfully shapes their diagnosis or treatment.
  • Regulatory clearance is a starting point, not proof that a tool works in your population.
  • Governance needs owners, monitoring and a way to switch a tool off.

What ethical principles apply to AI in healthcare?

The World Health Organization's 2021 report on the ethics and governance of AI for health sets out consensus principles that most health systems now use as a reference point: protecting human autonomy, promoting well-being and safety, ensuring transparency and explainability, fostering responsibility and accountability, ensuring inclusiveness and equity, and promoting AI that is responsive and sustainable. In plain terms, AI should help patients and clinicians, not replace their judgment, and it should work fairly for everyone it touches.

These principles sound abstract until they meet a real use case. A model that flags possible lung nodules, such as the tools discussed in our piece on how AI is helping predict lung cancer, raises different questions from a chatbot that suggests medication changes. The level of oversight should rise with the potential for harm.

The five ethical risks leaders should plan for

1. Safety and validation

A model trained in one hospital may perform worse in another because patients, equipment and workflows differ. Ask for evidence from settings similar to yours and run a local validation before clinical use. The FDA maintains a public list of AI-enabled medical devices authorized for marketing in the US, which helps confirm regulatory status, but the agency notes that the list is not comprehensive and its summaries are not exhaustive.

2. Bias and equity

If training data underrepresents certain groups, the tool may miss disease or over-flag it for those patients. Require performance results broken down by demographic group and care setting, and repeat the analysis after go-live.

3. Consent and transparency

Patients should not discover after the fact that software influenced their care. Decide when disclosure is required, how clinicians explain AI input in plain language, and how patients can ask questions or decline where that is feasible.

4. Privacy and data use

Training and running models often involves large volumes of protected health information. Confirm what data the vendor receives, whether it is used to train other customers' models, and how it is secured. Our overview of EHRs, patient privacy and HIPAA covers the baseline safeguards.

5. Accountability

When an AI suggestion contributes to harm, someone must be able to explain what happened. Keep records of model versions, inputs and outputs, and make clear in policy that the treating clinician owns the decision.

How should a health system govern clinical AI?

Treat each clinical AI tool like a new clinical service. The NIST AI Risk Management Framework, released in January 2023, offers a general structure (govern, map, measure, manage) that health systems can adapt alongside medical device rules and internal clinical governance.

StageEthical questionPractical control
SelectionDoes it solve a real clinical problem?Clinical sponsor, defined use case, regulatory status check
ValidationDoes it work for our patients?Local test set, subgroup performance review
DeploymentDo clinicians understand its limits?Training, clear labeling of AI output in the workflow
MonitoringIs performance drifting?Scheduled audits, incident reporting, version tracking
RetirementCan we stop safely?Documented off-switch and fallback process

Where AI ethics meets everyday operations

Many ethical failures are operational. Alert fatigue leads clinicians to ignore warnings. Poorly placed AI output gets copied into notes without review. Prediction tools trigger interventions that staff cannot actually deliver. For example, a readmission risk score only helps if follow-up capacity exists, a point we explore in whether AI can help predict and prevent readmissions. Before launch, walk through the workflow with frontline staff and ask what they will do differently when the model fires.

Questions to ask any clinical AI vendor

  • What is the intended use, and what uses are out of scope?
  • What populations and sites were used for training and testing?
  • How does performance differ by demographic group?
  • How are model updates validated and communicated?
  • Is our data used to train models for other customers?

Frequently Asked Questions

Can AI make a diagnosis without a doctor?

Some authorized tools perform narrow detection tasks automatically, but in most care settings a licensed clinician remains responsible for the diagnosis and treatment plan. Ethically, the safest model is AI as a second reader or decision aid, with clear rules on when its output must be reviewed and who signs off on the final decision.

Should patients be told when AI is used in their care?

Yes, when AI meaningfully influences a diagnosis or treatment choice, patients should be able to learn that and ask about it. The WHO principles stress autonomy and transparency. Health systems should set a policy that defines which uses require disclosure and give clinicians simple language for explaining the tool's role and limits.

Does FDA authorization mean an AI tool is safe to use?

Authorization means the device passed FDA premarket review for its intended use, which is important. It does not guarantee the tool performs equally well in your patient population or workflow. Local validation, subgroup analysis and ongoing monitoring are still needed, along with clinician training on what the tool can and cannot do.

Next steps

  1. Inventory every AI tool touching clinical decisions, including features inside existing systems.
  2. Assign a clinical owner and risk level to each one.
  3. Require subgroup performance data for high-risk tools.
  4. Set a patient disclosure policy and a monitoring schedule.

Last reviewed: October 2026.

Sources

Comments

Post a Comment

Popular Posts

Why Workday Onboarding Breaks Down for Frontline Employees

Image
The Onboarding Gap Nobody Talks About Workday's onboarding module is well-designed for its intended audience: office-based, desk workers with reliable computer access, personal email addresses, and the digital literacy to navigate a web-based portal. For this population, Workday onboarding works well, it automates tasks, routes approvals, collects documents, and creates a reasonably smooth first-week experience. But most organizations using Workday have a substantial population of frontline workers: warehouse employees, retail staff, manufacturing workers, healthcare aides, food service workers, drivers. For this population, the standard Workday onboarding experience frequently fails in ways that are predictable, documented, and, crucially, fixable. Understanding why it breaks down and what actually works is increasingly urgent as labor market competition for frontline talent intensifies. How Standard Workday Onboarding Is Designed Workday's new hire onboarding (delivered throu...
Read more

How to Improve the Customer Experience (CX)

Customer experience is the sum of every interaction a customer has with your company, from the first ad they see to the way a return gets handled years after the purchase. Companies that take this seriously outperform those that treat CX as a support function. The ones that struggle tend to confuse customer satisfaction scores with actual improvements, or fix the wrong things. Here's a practical look at what actually moves CX forward. Start with where customers actually struggle Most CX improvement programs begin with surveys. Surveys are useful but limited, they capture what customers are willing to articulate after the fact, which tends to under-report friction in the middle of an experience and over-index on the most recent interaction. The richer data comes from observing behavior directly: where do customers drop off in a purchase flow? Where do support tickets spike? What search queries are people entering on your site that suggest they can't find what they're loo...
Read more

How Do I Log In and Sign In to Workday HCM

Workday HCM is the system your organization uses to manage everything from your pay stubs and benefits to time off requests and performance reviews. Getting in is usually simple once you know where to go, but first-time login, password resets, and single sign-on setups can trip people up if no one has walked them through it. Here's what you need to know. How to find your Workday login URL Workday doesn't have one universal login page. Each organization has its own tenant, a dedicated instance with a unique URL. Your company's HR department or IT team should have provided the URL when you were onboarded. It usually looks something like your-company.workday.com or wd3.myworkday.com/yourcompany . If you weren't given the URL, check your onboarding email, your company's intranet, or ask HR directly. Some organizations also link to Workday from their internal HR portal. Don't try to guess the URL, there's no central directory, and guessing wrong just takes...
Read more

UKG Union Contract and Overtime Rules for Multi-Site Food Plants

Multi-site food manufacturers running UKG often struggle with one thing: each plant has its own union contract, shift pattern and overtime rules, while the timekeeping system is configured centrally. The fix: document every contract rule precisely, map it to UKG pay rules and work rules, test against real timecards, and handle true exceptions with add-ons rather than core customization. Disclosure: The author works at CloudApper, which makes the UKG add-ons discussed in this article. Why are union contracts so hard to configure in UKG? Federal law sets a floor. Under the Fair Labor Standards Act, non-exempt employees must receive at least one and a half times their regular rate for hours worked over 40 in a workweek. Collective bargaining agreements frequently go further, and food plants often have several agreements across locations. Common contract provisions include: Daily overtime after 8 hours, or after 10 on a four-day schedule. Double time on the seventh consecutive day o...
Read more

Infor HCM Software Engineer Jobs: Salary Factors and Skills

An Infor HCM software engineer's salary depends mostly on the type of employer, the depth of Infor platform knowledge, and location. Engineers who combine general software skills with hands-on experience in Infor CloudSuite HCM, Lawson, Infor ION integrations and payroll logic tend to command more than generalist developers, because that combination is scarce in the job market. What does an Infor HCM software engineer actually do? The title covers several different jobs, and pay follows the job more than the title. Broadly, these engineers build, configure, integrate and support the Infor human capital management stack, which includes core HR, payroll, benefits, talent management and workforce management. Many organizations still run the older on-premises Infor Lawson system alongside or instead of the cloud suite, so experience with both is common. Typical responsibilities include: Building and maintaining integrations between Infor HCM and payroll providers, benefits carrie...
Read more

The End of Remote Work: Why Companies Want You Back

Return to Office: The Trend Reshaping the Modern Workplace After years of celebrating the remote work revolution, a powerful counter-movement has taken hold. Amazon, JPMorgan Chase, Goldman Sachs, Disney, and hundreds of other organizations have issued return-to-office (RTO) mandates, some requiring full five-day-a-week presence. The era of near-universal remote work flexibility appears to be giving way to something more complicated, and HR leaders are at the center of navigating it. Why Companies Are Calling Employees Back Collaboration and Innovation: Many executives argue that the serendipitous interactions, the hallway conversation, the spontaneous whiteboard session, that drive breakthrough ideas simply cannot be replicated on Zoom. Studies from Stanford and MIT suggest that in-person collaboration produces measurably higher rates of novel idea generation. Culture and Cohesion: Building and sustaining organizational culture at a distance has proven harder than anticipated. N...
Read more

ERP Solution Guide: How to Choose the Best ERP for You

What Is an ERP System and Why Does It Matter? An enterprise resource planning (ERP) system is software that integrates the core functions of a business — finance, inventory, procurement, human resources, manufacturing, and customer management — into a single, connected platform. Instead of data living in separate spreadsheets or standalone applications that don't talk to each other, an ERP creates one source of truth for the entire organization. For growing companies, the question is usually not whether they need an ERP but when and which one. Getting this decision right has long-term consequences. A poorly chosen ERP creates more problems than it solves — forcing teams to work around the system, creating data integrity issues, and consuming IT resources in an endless cycle of customization and maintenance. A well-chosen ERP, on the other hand, becomes the operational backbone that lets a company scale without proportionally growing its administrative overhead. Understandin...
Read more

How to Search in Workday: Find Reqs, Reports, People and Tasks

To search in Workday, type into the global search bar at the top of any page, press Enter, then use the category filters on the left of the results to narrow to people, organizations, tasks and reports or other object types. Workday only returns items your security roles allow you to see, so missing results often mean an access issue rather than a typo. How does Workday search work? Workday uses a single global search box rather than separate menus for each module. Everything in the tenant, from a worker's profile to a job requisition to a custom report, is an object that search can find if you have permission to view it. Three points explain most search behavior: Security trimming. Results are filtered by your security groups. A recruiter and a payroll partner typing the same term will see different results. Categories. After you press Enter, results are grouped into categories that appear as filters. Clicking one hides everything else. Related actions. Once you open an...
Read more

New Apple Watch Health Features Will Be Available This Year, but Blood Pressure and Blood Sugar Sensors Will Not Be Available Until Next Year

Image
What Apple confirmed for its upcoming watch lineup Apple's annual health feature announcements for its Watch lineup continue to generate significant attention, both from health enthusiasts who track every new sensor addition and from the clinical research community that increasingly uses consumer wearables in studies. The pattern that has emerged over the past several product cycles is consistent: Apple confirms a set of features that will ship with the current year's model and acknowledges separately that other, more complex sensors are still in development and will not arrive on schedule. This year's announcement followed that pattern closely. Several new health monitoring capabilities are confirmed for the current Apple Watch generation, representing meaningful additions to what the device can track passively. At the same time, the two most anticipated sensor additions, continuous blood pressure monitoring and non-invasive blood glucose measurement, will not be availa...
Read more

Dollar General Store Walkout: Lessons for Retail HR

In March 2024, every employee at a Dollar General store in Mineral Point, Wisconsin, quit at once and posted "We quit" signs on the doors. They cited a lack of appreciation, being overworked and underpaid, and a dispute over a corporate rule limiting which unsold items could be donated. The store reopened about three hours later. Key takeaways The walkout was triggered by a policy change, but the notes employees left pointed to long-running frustration with workload, pay and recognition. Policies that clash with frontline values (such as throwing away usable goods) can become flashpoints when trust is already low. Explaining the reason behind a rule, and giving local teams a channel to push back, costs little compared with a full-store walkout. Retail and hourly employers should treat a mass resignation as a lagging indicator and track earlier warning signs. What happened at the Mineral Point store? According to reporting syndicated by Sinclair stations, customers ...
Read more