NYC Local Law 144 Bias Audit: How to Run One for AI Hiring Tools

A woman's hands working on a laptop beside a notebook

Photo: Pixel.la Free Stock Photos, CC0 (public domain), via Wikimedia Commons.

A recruiter in Brooklyn switches on an AI resume ranker on Monday. By Friday it has scored 400 applicants. Nobody has published an audit, sent a notice, or checked whether the tool even counts under the law. New York City's Local Law 144 treats each day of use as a separate violation, which is how a quiet tool rollout turns into a compliance bill.

NYC Local Law 144 bars employers and employment agencies from using an automated employment decision tool (AEDT) to screen candidates or employees for promotion in the city unless the tool has had a bias audit within the past year, a summary of the results is public, and candidates got notice at least 10 business days before use. An independent auditor calculates selection or scoring rates and impact ratios by sex, race and ethnicity, and intersectional categories.

By the Decision Makers Hub editorial team. Last updated November 2026. This article is general information, not legal advice. Have employment counsel review how the law applies to your tools, jobs and candidates.

Key takeaways

  • The audit must be done within one year before you use the tool, so it is an annual task, not a one-time project.
  • Notice goes to NYC resident candidates and employees at least 10 business days before the tool is used.
  • The auditor must be independent: not employed by you or the vendor, not involved in building or using the tool, and without a financial interest in either.
  • Penalties start at up to $500 for a first violation and run $500 to $1,500 for each later one, and each day of use counts separately.
  • The law requires calculating and publishing impact ratios. The City sources reviewed here do not set a pass or fail cutoff.

What we keep hearing. A vendor says its tool is "LL144 compliant," and the HR team leaves it there. "Compliant" is a claim, not evidence.

Our take. Ask to see the audit: who did it, when, and where the summary is published. If the vendor cannot show it, assume you do not have it.

Does Local Law 144 cover your tool?

The law applies to tools that "substantially assist or replace discretionary decision-making," according to the City's Department of Consumer and Worker Protection (DCWP). An "employment decision" means to screen candidates for employment or employees for promotion within the city, and DCWP says using a tool to help substantially assess or screen candidates at any point in hiring or promotion counts. Enforcement began on July 5, 2023.

Location matters. Under the DCWP FAQ, a job is "in the city" if it is at an NYC office at least part time, or fully remote but tied to an NYC office; an employment agency counts if it is located in NYC. A tool used only for candidates outside the city can still be covered if the job itself is in the city. Notice, though, is required only for candidates and employees who are NYC residents.

If you do not have a clean list of which HR systems rank, score or filter people, start with an inventory. Our guides to auditing your HR tech stack and what an applicant tracking system actually does will help you find the features that count as automated screening.

What does the law require, requirement by requirement?

RequirementWhat the City saysEvidence to keep
Bias auditDone within one year of using the tool, every year, by an independent auditorAudit report and date
Public summaryPost the audit date, data source, number of individuals in an unknown category, applicant counts, selection or scoring rates, impact ratios, and the tool's distribution dateURL of the summary page
Candidate noticeAt least 10 business days before use; says an AEDT is used and what qualifications or characteristics it assesses; includes instructions to request a reasonable accommodation under other lawsPosting, email or policy text with dates
Audit dataHistorical data from your own use of the tool; test data only if there is not enough historical data; no imputed or inferred demographicsData source notes
CategoriesSex, race and ethnicity, and intersectional categories; a category under 2% of the data may be excluded from impact ratio calculationsCategory table

Notice can be given in a job posting, by mail or by email. Applicants can instead be notified on the employment section of a website, which need not be specific to a position, and promotion candidates can be notified through a written policy or procedure.

How does an impact ratio work?

An impact ratio compares how often a category of people is selected (or scores above a threshold) against the most-selected category. The EEOC's Uniform Guidelines Q&A gives a clear arithmetic example: if 48 of 80 White applicants are hired (60%) and 12 of 40 Black applicants are hired (30%), the ratio is 30 divided by 60, or one half. The EEOC treats ratios below four-fifths as an initial signal of adverse impact, and we explain that rule of thumb in detail in our guide to AI resume screening and the four-fifths rule.

LL144 is different in one respect that surprises people: it requires you to calculate and publish the figures. The DCWP pages reviewed for this article do not set a pass or fail cutoff. That does not make a low ratio harmless, because other federal, state and local anti-discrimination laws still apply to the employment decision itself.

How do you run the audit in practice?

  1. Inventory every tool. List each system that ranks, scores, classifies or filters candidates or employees, and mark which ones touch NYC jobs or NYC residents.
  2. Confirm what counts as a "substantial" role. Ask counsel whether a human reviewer really overrides the tool or mostly follows it. Our piece on human in the loop AI explains why a rubber-stamp review is a weak defense.
  3. Pull historical data. Use your own data from using the tool. If you do not have enough, DCWP allows test data, and the published summary must then explain why historical data was not used and how the test data was generated.
  4. Collect demographic data lawfully. DCWP says imputed or inferred demographic data cannot be used. Plan for self-identified data and an "unknown" category.
  5. Hire an independent auditor. DCWP says an auditor is not independent if they work for the employer or the AEDT vendor, helped use, develop or distribute the AEDT, or have a direct or material indirect financial interest in either. DCWP does not approve auditors.
  6. Review the numbers and decide. Even without a cutoff in the law, investigate large gaps with your vendor, and document what you changed. Similar thinking applies to the pay audits we describe in how to run a pay equity audit.
  7. Publish and notify. Post the summary on the employment section of your website (or link to it) and send notice at least 10 business days before use.
  8. Put the next audit on the calendar. You can rely on an audit for only one year from the date it was conducted.

What does non-compliance cost?

The legislation text lists a civil penalty of not more than $500 for a first violation, with each additional violation on the same day also covered, and not less than $500 nor more than $1,500 for each subsequent violation. Each day an AEDT is used in violation counts as a separate violation, and failing to give any required notice to a candidate or employee is a separate violation too. For a tool used on hundreds of applicants a day, the exposure adds up quickly, before counting any discrimination claim.

Treat the audit as one part of a larger program. Our AI governance framework guide and company-wide AI policy template show where bias audits, notices and approvals fit.

Frequently asked questions

Does Local Law 144 apply to fully remote jobs?

It can. Under the DCWP FAQ, a fully remote job is "in the city" if it is tied to an NYC office, and notice is required for candidates who are NYC residents.

How often is a bias audit required?

Every year. DCWP says an employer can rely on a bias audit for one year from the date it was conducted.

Who can be the independent auditor?

Someone who exercises objective and impartial judgment. DCWP says an auditor is not independent if they work for the employer or vendor, helped use, develop or distribute the tool, or have a financial interest in either. DCWP does not approve auditors.

Is there a pass or fail impact ratio under the law?

The DCWP pages reviewed for this article require calculation and publication of impact ratios but do not state a pass or fail cutoff. Ask counsel how other anti-discrimination laws apply.

How much are the penalties?

Up to $500 for a first violation and $500 to $1,500 for each subsequent violation, with each day of use and each failure to give notice counted separately, according to the City Council legislation text.

Sources

Comments

Popular Posts

Why Workday Onboarding Breaks Down for Frontline Employees

Interview Tips for Beginners: A Step-by-Step Prep Plan

Are Biometrics Better Than Passwords? What NIST Says

How to Improve the Customer Experience (CX)

How to Market Your Handyman Services to Small Business Owners

Are Mobile Apps Tracking Your Every Move? How to Check

Predictive Scheduling Laws: Where They Apply and How to Comply

End-of-Day Routines That Boost Productivity at Work

Can I Learn Epic EHR Online? Training Paths Explained

How AI Assistants Enhance Decision-Making in HCM Integration