Sarthi
Case study · AI Blueprint Sprint · HR and payroll

Should an IT services firm build or buy an AI assistant for pay and HR questions?

Build it in-house, in three gated releases. Payback in about 19 months from kickoff, 22 including the Sprint fee. Target: 6 in 10 HR questions answered without HR. No employee pay data reaches a model provider.

ClientUS IT services firm, about 1,200 employees
Decision ownerCFO, with the CHRO and CIO
Engagement10-day Blueprint Sprint, February 2026
Lead advisorShekhar Nirkhe, Sarthi

I ran this Sprint in February 2026. The client isn't named here, so I have changed the numbers and some details to keep it that way. The findings and the decisions are as they were. It follows the same layout as the report the steering committee received. Amounts are in US dollars.

Contents

  1. Executive summary
  2. The question and how we answered it
  3. Where HR's time goes
  4. Which questions to automate first
  5. Build, buy or fix the process
  6. Business case and sensitivity
  7. Architecture, controls and data protection
  8. Risks and how they are handled
  9. Roadmap, governance and KPIs
  10. What we recommend against
  11. Decisions and next 30 days
  12. Appendix: method and assumptions
1 · Executive summary

Build one in-house assistant for pay, policy, leave and salary advances. It pays back about 19 months from kickoff and keeps payroll data inside the firm.

Situation
950 of 1,200 employees are consultants at client sites in 14 states. Every pay, leave and policy question goes to HR by email.
Complication
HR spends about 500 hours a month on 2,400 questions, answers take 1.5 days, and headcount grows 15% a year. Two vendors were pitching packaged assistants.
Resolution
Build one assistant on the firm's cloud, connected to Workday, ADP and one clean policy library. Release it in three phases, each gated on measured results.

The answer. Build, do not buy. $107,000 one-time, about $5,200 a month to run, first users in week 10, full rollout in 24 weeks. Payback about 19 months from kickoff, 22 months including the $25,000 Sprint fee, 13 months at full run rate.

Why

Most of what HR answers is already written down somewhere. Payslips, leave, policy and salary advances make up 8 in 10 questions, and each answer sits in Workday, ADP or a policy file. The plan targets 75% of those answered without HR, about 6 in 10 of all questions. The day 6 prototype got 92% of its answers right.

The biggest category is also the one nobody could sell us. A consultant's payslip question depends on their client, their rate, their timesheet and the state they worked in that week, and neither vendor could see that. Over three years from kickoff, building nets about $148,000. The service platform would have lost about $54,000.

The numbers hold when pushed: run-rate payback stays under 18 months whichever single assumption we stress. What worried us more was legal exposure on salary advances, and whether consultants would use the thing at all. Both now have an owner and a gate (Sections 7 and 8).

Decisions requested from the steering committee

  1. Approve phase 1 (pay and policy, through the week 14 decision): $74,000 of the $107,000.
  2. Approve the stop rule: continue only if run-rate payback, projected from 4 weeks of pilot use, is 18 months or less.
  3. Name an HR product owner (1 day a week) and commission a 14-state counsel review of advance rules.
  4. Decline both vendor proposals as they stand.

The payroll question that shaped the pilot

A representative case from the day 6 test set; wording and figures changed.

Employee askedPrototype answeredPayroll's approved answer
"My take-home dropped $166 this pay. I moved from the Dallas client to the Chicago one on the 14th. Why?" "Changes in take-home pay are usually caused by changes to your federal withholding (W-4) or benefit deductions. Please check your W-4 elections." "Your work state changed from Texas to Illinois on the 14th. Texas has no state income tax; Illinois withholds 4.95%. 8 of the 11 working days this period were in Illinois, so $166 of Illinois tax was withheld."
What brokeThe prototype could not see ADP's work-location history or per-state tax lines, so the model filled the gap with a generic answer. No figure was wrong; the explanation was.
What engineering builds firstTicket HR-PAY-01: map those ADP fields, compute the change in code, and send anything not fully explained to payroll. Owner: the firm's backend lead. Six acceptance tests.
What unlocks the next $33,000The week 14 scorecard. Targets: 95% correct (prototype observed 92%), zero wrong pay figures (prototype observed 0 of 300), 70% answered without HR, 60% pilot usage.

See the engineering handoff: the ticket, its tests and the scorecard, as the firm's team received them.

What changed our plan. Going in, I assumed the model would be the weak point. It wasn't. Of the 24 answers the prototype got wrong, 19 came down to data or policy: an old policy version, an ADP field we hadn't mapped, a rule HR had never written down. So we changed the order of work. Field mapping became a condition for launch, the policy clean-up moved in front of the build, and anything the data can't fully explain now goes to payroll rather than getting a best guess.

Why prototype answers failed (24 of 300)ShareFix before launchOwner
Old policy version retrieved3%One source per policy, with effective datesHR product owner
ADP field not yet mapped (state tax codes, retro pay)2%Complete the mapping; add cases to the test setTech lead, payroll lead
Question too vague to answer1.7%Assistant asks one clarifying questionTech lead
Policy silent or contradictory1.3%HR decides the rule; it goes on the rules screenCHRO
Total8%Release bar: 95% correct

What the client gets on day 10

DeliverableWhat it settles
Decision memoBuild or buy, the options scored, and the four decisions above
Business case modelMonth-by-month cost and benefit from kickoff, editable by finance, with the stop rule built in (Exhibit 7)
Target architecture and data rulesWhat stays inside the network, masking, approved calculations, audit trail (Section 7)
Release bar and test-set design300 questions, 95% correct, zero wrong pay figures; why the prototype missed and who closes each gap (Section 1)
Policy rules and escalationsWhich requests a person must decide (Exhibit 11)
Risks, gates and stop ruleOwners and pass conditions for each release (Sections 8 and 9)

The firm's own team plans and builds from these. Sarthi reviews progress against the bar at each gate.

2 · The question and how we answered it

We agreed the decision criteria with the CFO on day 1, before looking at any technology.

CriterionThresholdSet by
Payback18 months or less after full rolloutCFO
Employee dataNo identifier or pay figure leaves the firm's cloud unmaskedCIO and IT security
Answer qualityZero wrong pay figures; 95% correct on an HR-approved test setCHRO
SpeedEmployees using something within one quarterCHRO

Exhibit 1Five questions, each answered by a specific analysis

Should the firm use AI for HR and pay questions, and if so, build or buy? Key question 1. Is the problem big enough?Hours, volume, wait times, growth 2. Can it be answered safely?Data access, quality, legal limits 3. Which questions first?Value against feasibility and risk 4. Build, buy or fix the process?Coverage, data control, 3-year cost 5. Does it pay back, and how earlydo we know? Payback, stress test, stop rule Time study, 7,100-message inboxanalysis, 8 consultant calls Data audit of 6 sources, privacyand employment law review Scoring of 6 use cases on value,data readiness, risk and effort Weighted option scoring and3-year net value of 4 options Cost build-up, sensitivity on 4drivers, pilot gates ANALYSIS USED SUB-QUESTION

Source: Sprint workplan, agreed with the steering committee on day 1.

Ten days, one output per day

DayWorkOutput
1Interviews with CHRO, payroll lead, 3 HR generalists, IT director; half a day shadowing HR (41 requests in 4 hours)14 candidate problems
23 months of HR inbox (7,100 messages), masked in the firm's cloud and classified; 8 consultant callsVolume and time by question type
3Where each answer lives, API access, data quality, ownerData readiness map
4Wage statement, deduction and advance rules in 14 states, with employment counselLegal limits per use case
5Scored 6 use cases with the CHRO and payroll leadShortlist of 4
6Prototype on 300 masked real questions; 50 cross-access attemptsAccuracy and access results
7Two vendor demos and proposals; four options scoredBuild-or-buy call
8Cost build-up with IT, benefits with finance, stress testsBusiness case, stop rule
9Architecture and security review; release plan with HRArchitecture, risks, roadmap
10Read-out to the steering committeeThis report, four decisions
3 · Where HR's time goes

HR spends about 500 hours a month on questions whose answers already sit in Workday, ADP or a policy file.

Exhibit 2Six question types make up all 2,400 monthly questions

Question typePer monthMinutes eachHR hoursAnswer already in a system?
Payslips and deductions82010137Yes, ADP
Salary advances2202592Yes, written rules applied by hand
HR policy (travel, benefits, overtime)4101282Yes, policy documents
Timesheets and client billing2901573Partly, nightly export
Leave balance and requests500867Yes, Workday
Visa and employment letters1602053Partly, needs legal sign-off
Total2,400503

Source: HR inbox, 3 months, 7,100 messages; time study of 41 requests. Note: minutes are median handling times.

What drives the volume

Two things surprised us. The load isn't spread evenly: most payslip questions land in the three days after a pay run, exactly when the same two payroll people are approving advances. And many "payslip" questions are really tax questions. Consultants move between client sites, sometimes across a state line, and "why did my take-home change?" can only be answered from that person's own pay history.

The rest is housekeeping. Some policies exist in three versions (intranet, shared drive, old emails), so answers drift. Slow replies make more work too: one consultant in five asks the same question twice.

4 · Which questions to automate first

Four question types clear the bar. Timesheets wait for better data; visa letters stay with counsel.

Exhibit 3Payslips, advances, policy and leave combine high value with ready data

$60K$40K$20K$0 HR time freed per year LowHighFeasibility: data readiness, legal risk, effort BUILDFIX DATA FIRSTDO NOT AUTOMATEQUICK FIXES Payslips $59K Salary advances $40K Policy $35K Leave $29K Timesheets $31K Visa letters $23K

Note: value is HR time at $48 an hour, with 75% of questions answered without HR. Build threshold: $25K a year.

Use caseValue / yearData readinessRiskCall
Payslips and deductions~$59KHigh: ADP APIFigures must be exactPhase 1
HR policy~$35KMedium: clean up firstLowPhase 1
Leave~$29KHigh: Workday APILowPhase 2
Salary advances~$40KHigh: written rulesHigh: state wage lawPhase 3
Timesheets~$31KLow: nightly exportLowNot yet
Visa letters~$23KPartialHigh: counsel sign-offNever

Advances are worth more than policy or leave but go last: they move money, so the assistant earns trust on read-only questions first.

5 · Build, buy or fix the process

Building returns the most over three years, because only a build can read each consultant's own pay data.

We looked at four ways forward, including not using AI at all.

Microsoft's Employee Self-Service agent was on the market, but it needs Microsoft 365 Copilot licences the firm didn't have, so we didn't score it.

Exhibit 4The build scores highest on the criteria weighted most

CriterionWeightA. ProcessB. WorkdayC. PlatformD. Build
Question volume covered30%1235
Employee data control25%5425
3-year cost20%5433
Time to first value15%5433
No lock-in10%4225
Weighted score (of 5)3.73.22.74.3

Note: scores 1 to 5, weights set on day 1, before any vendor demo.

Exhibit 5Over three years, only the build clearly earns back more than it costs

OptionCovers3-year costHR hours freed / month3-year net value
A. Fix process onlyPolicy FAQ$5,000~20+$29,000
B. Workday's assistantLeave, policy; no ADP pay data$144,600~110+$34,000
C. Service platformPolicy, leave, advances; payslips at handbook level$334,200~180-$54,000
D. Build in-houseAll four, from each employee's own data$281,200~280+$148,000

Source: the two vendor proposals received in February 2026 (B: $15,000 setup, $3 per employee per month; C: $75,000 implementation and custom work, $6 per employee per month). Prices are rounded and changed like every figure here; they are not Workday or ADP list prices. Note: net value is HR time at $48 an hour minus all costs over 36 months from kickoff, using the same monthly model and rollout ramp as Exhibit 7. At 15% headcount growth, C's licences rise to about $375,000.

From practice I now give every vendor 20 of the client's own questions, masked, before the demo starts. The handbook demo always looks good. Here both vendors were strong on policy and weak on payslips, which settled the coverage argument in an afternoon.
6 · Business case and sensitivity

$107,000 one-time pays back about 19 months from kickoff, 13 months at full run rate. The share of questions answered without HR is the number to watch.

Exhibit 6Cost to build and run

One-timeAmount
Engineering: 20 to 22 developer-weeks over 24 weeks, costed at 22$79,000
Security review and penetration test$15,000
ADP API access and setup$8,000
Policy clean-up$5,000
Total$107,000
Per monthAmount
Upkeep: one developer, about 20% of their time$3,100
Hosting and vector database$1,200
Model usage, about 15 cents a conversation$400
Vault and key management$300
Monitoring and logs$200
Total$5,200

Note: developer-weeks at $3,600 (about $185,000 a year, loaded). A small model routes each question; a larger one drafts the answer.

ReturnAssumptionAmount
HR time freed75% of covered questions answered without HR280 hours / month
HR capacity recovered$48 per loaded HR hour, set by finance$13,440 / month
Running costExhibit 6$5,200 / month
Net benefit$8,240 / month
Payback at full run rate$107,000 ÷ $8,24013 months
Payback from kickoffWith the rollout ramp (Exhibit 7)19 months
All-in, with the Sprint feeAdds $25,000 spent before the decision22 months

Exhibit 7Modeled net value from kickoff turns positive in month 19, or month 22 counting the Sprint fee

BUILD AND ROLLOUT +$150K+$100K+$50K$0-$50K-$100K 061218243036Months from kickoff Month 19 Month 22 with Sprint fee Lowest: -$101Kin month 6 +$148K Build only Including $25K Sprint fee
Month3612182436
Modeled net value-$69K-$101K-$53K-$3K+$47K+$148K
Cash view: two hires avoided-$70K-$125K-$93K-$39K+$15K+$123K

Note: build costs from Exhibit 6, spread over weeks 1 to 24; running cost from week 10. Benefits ramp with the releases: pay and policy from the week 10 pilot, leave from month 5, advances from month 7; full run rate from month 9. Modeled value counts recovered HR hours at $48. The cash view counts only the two HR hires, assumed for months 7 and 10 (about $170,000 a year): cash payback in month 23, or 26 with the Sprint fee.

Exhibit 8Run-rate payback stays under 18 months across realistic ranges of all four drivers

OVER 18 Base case 13 months Loaded HR cost per hour$56 / $40 (base $48) Share answered without HR85% / 65% (base 75%) Running cost per month$4,000 / $7,000 (base $5,200) One-time build cost10% under / 30% over 10.217.8 10.516.3 11.316.6 11.716.9 8101214161820Payback after full rollout, months

Note: each bar moves one driver and holds the others at base case.

HR's hourly cost moves payback the most, but it isn't really in doubt: finance gave us that number on day 1. What nobody can know yet is how many questions the assistant will close on its own. That is what the pilot is for, before the rest of the budget is spent.

Exhibit 9The stop rule turns the pilot result into a decision

ScenarioAnswered without HRHours freedNet / monthRun-rate paybackDecision
Expected75%280$8,24013 monthsGo
Pilot gate70%265$7,52014 monthsGo
Weak60%226$5,64819 monthsRelease leave; defer advances
Stop50%189$3,87228 monthsStop

Note: run-rate payback, projected from 4 weeks of pilot use. Up to 18 months, go; 18 to 24, release leave but defer advances; over 24, stop. Agreed with the CFO.

For the CFO: the model values recovered HR capacity (280 hours a month, about 1.75 people). Cash shows up only in the hiring budget: the two HR generalists planned for next year's growth, about $170,000 a year, are not hired. That budget is larger than the capacity value, so the model is conservative. Faster answers and fewer pay errors are not counted.

From practice A closed chat isn't an answered question. We only count it if the employee doesn't email HR or ask again within 72 hours, and that number usually sits well below what a vendor dashboard shows. Agree the definition before the pilot, or you'll be arguing about it afterwards.
7 · Architecture, controls and data protection

No real employee identifier or pay figure ever reaches the model provider, and every action can be explained a year later.

Exhibit 10Real employee data stays inside the firm's network; the model sees only masked values

INSIDE THE FIRM'S NETWORK INTERNET EmployeeCompany SSO, in Teamsor the web Assistant serviceMasks real values going out,restores them coming back; runspay maths and policy rules Vault and audit logNames, SSNs, pay; everyaction; firm-held keys Vector databasePolicy text with effectivedates; masked records Workday and ADPLeave, pay, timesheets;read-only APIs Hosted modelEnterprise terms, notraining, zero retention Question, policy text, masks Draft answer with masks

How one question is answered

  1. The employee signs in with SSO; the assistant can read only that person's records.
  2. Names, IDs and amounts are swapped for masks ("EMP-4821", "AMT-07") before anything leaves the network.
  3. The model drafts the answer from the question, the policy passage and the masks.
  4. Inside the network, real figures are put back from ADP. Every pay figure comes from ADP's payroll APIs or from deterministic, tested code; the model only explains the result.
  5. If no approved calculation covers the question, the assistant does not improvise: it routes the question to payroll with the records attached.

Policy rules HR can change, and when a person decides

Policies lived in documents and in HR's heads. The build turns the deciding rules into settings HR edits on a rules screen, with every change logged: who, when, old and new value, effective date. Each decision records the rule version it used. Anything outside the rules goes to a person; the assistant never approves an exception.

Exhibit 11Requests that break a rule go to a person, with the reason attached

TriggerGoes to
Advance above the limit (half of net monthly pay)Payroll lead
Second advance while one is being repaidPayroll lead
Employee in first 90 days or serving noticePayroll lead
Leave beyond balance or in a client blackout periodManager, then HR
Pay dispute, termination, harassment or visa statusHR the same day; the assistant does not answer
No approved policy source, or low confidenceHR ticket

An audit trail for every action

Every action is logged with the request, records read, rule and policy versions, model and prompt version, decision and approver. HR and counsel can replay any decision from the last 12 months; older records follow the firm's retention policy.

What IT security asked

QuestionAnswer
Does the provider train on or keep our data?No: enterprise terms, zero retention, through the firm's cloud account.
Can someone see another person's pay?No: lookups are tied to the signed-in employee; 50 attempts failed in testing.
Can a crafted message trick it?It can only read the user's own records and file a request. It cannot change pay or approve.
Can the model run code?Only for HR and payroll staff doing ad-hoc analysis, such as testing a policy change: an isolated sandbox, no network, read-only masked data, a time limit, every script logged. Employees never see a figure from model-written code.
Are we locked into one model?No: one internal interface; switching is a config change and a test rerun.
How do we know answers are right?300 HR-approved questions before every release. Bar: 95% correct, zero wrong pay figures.
From practice Language models are poor at arithmetic, and a salary leaves no room for "usually right". Every pay figure an employee sees comes from the payroll APIs or from deterministic, tested code; the model writes the words around it. A sandbox limits what model-written code can touch, not whether its answer is right, so that code serves staff analysis and never an employee's answer.
8 · Risks and how they are handled

The biggest risks are legal and adoption, not the model. Each has an owner.

Exhibit 12Risk register

RiskLikelihoodImpactMitigationOwner
Advance rules breach a state's wage lawMediumHighCounsel signs off all 14 states before phase 3; written consent; no feesCHRO
Consultants don't use itMediumHighLive in Teams; HR answers covered questions with a link to it; weekly usage reviewHR product owner
Wrong pay figure shownLowHighFigures only from ADP APIs or tested code; unsupported questions go to payroll; zero-tolerance release barTech lead
A past decision is challengedMediumHighFull audit trail, replayable for 12 monthsCHRO
Outdated policy answerMediumMediumOne source per policy; answers cite document and dateHR product owner
HR sees it as a threatMediumMediumHR owns the approved answers; hiring avoided, no role cutsCHRO
Data leak through crafted messagesLowHighPer-user scoping, masking, red-team tests each releaseIT security
Model price or quality changesMediumLowSwappable model behind one interfaceTech lead
From practice Salary advances looked like the easy win, because the rules fit in one spreadsheet. They turned out to be the riskiest item on the list. Paying an advance back through payroll is a wage deduction, and each of the 14 states has its own rules on consent and limits. So they go last, after counsel has signed off state by state.
9 · Roadmap, governance and KPIs

Three releases over 24 weeks, each opened only when the previous gate is met.

Exhibit 13First users in week 10; advances only after counsel sign-off

Wk 15913172125 Policy clean-up Build pay and policy Security review, pen test Pilot, 150 consultants Leave: build, then release Counsel review, 14 states Salary advances Gate 1, wk 14Gate 2, wk 16Gate 3, wk 24All consultants from wk 15 Build and releaseLegal and advancesGo or stop decision
GateWhenPass conditionDecided by
1. Pay and policyWeek 1470% answered without HR; zero wrong pay figures in 300 answers; run-rate payback 18 months or lessSteering committee
2. LeaveWeek 16Leave emails halved among pilot usersCHRO
3. AdvancesWeek 24Counsel sign-off in 14 states; 4 pay runs with no manual reworkCFO and CHRO

What the week 14 decision rests on. The pilot measures pay and policy directly. Leave is estimated from the prototype and advances from the written rules, so the committee releases the remaining $33,000 only if the measured results hit every target and projected run-rate payback is 18 months or less. Full scorecard in the engineering handoff.

Decision rights

ActivitySteering committeeHR product ownerTech lead and 2 developersIT securityPayroll lead
Scope and gatesARCCC
Approved answers, policy rulesIA, RCC
Build and test setICA, RCC
Security reviewIRA
Advance rules in codeICRA

Note: R responsible, A accountable, C consulted, I informed. Steering committee meets every two weeks.

KPIs

KPIBaselineWeek 24 targetMeasured by
Covered questions answered without HR0%75%No HR email or repeat within 72 hours
HR hours on covered questions377 / monthunder 100Tickets × handling time
Time to answer1.5 daysunder 5 minutesConversation logs
Repeat questions1 in 51 in 20Same person, same topic, 7 days
Wrong pay figuresn/a0Weekly sample of 50 answers
Consultants using it monthly060%SSO sign-ins
10 · What we recommend against

Three things the firm was considering should not be done now.

Timesheet questions can wait. Client approvals arrive late and only in a nightly export, so any answer would be stale. Fix the feed first, then look again; it's worth about $31,000 a year once the data is current.

Visa letters should never be automated. Each one has to match what was filed with immigration and needs counsel to sign it. A library of pre-filled templates saves more time, with almost none of the risk.

And we advised declining both vendor proposals as they stood. The platform costs more over three years and can't see consultant pay. Workday's assistant deserves another look in a year, sooner if it learns to read ADP.

11 · Decisions and next 30 days

Approve phase 1 this month and consultants use the assistant before quarter end.

ActionOwnerBy
Approve phase 1 ($74,000) and the stop ruleCFOWeek 0
Name the HR product ownerCHROWeek 0
Commission the 14-state counsel reviewCHROWeek 1
Request ADP and Workday API accessIT directorWeek 1
Book security review for weeks 8 and 9IT securityWeek 2
One source for the 12 most-asked policiesHR product ownerWeek 4
300-question test set with approved answersHR product owner, tech leadWeek 4
Pick 150 pilot consultants across 5+ statesCHROWeek 6

Note: phase 1 covers engineering and pilot support to the week 14 decision, the security review, ADP API setup and policy clean-up.

Appendix

Method, assumptions and lessons

A. Method

B. Assumptions

AssumptionValueSource
Loaded HR cost$48 / hourFinance
Answered without HR75%Feasibility test, adjusted for adoption
Questions2,400 / monthInbox, held flat
Engineering effort20 to 22 developer-weeksIT estimate; 22 used
Developer cost$3,600 / weekFinance
Hiring budget avoidedabout $170,000 / year2 HR generalists; timing assumed (months 7 and 10)
Sprint fee$25,000All-in payback view only
Headcount growth15% / yearFirm's plan

C. From the lead advisor

On a comparable system I led, the hardest question was not which model to use but when a person must decide. HR policies lived in documents and in the HR head's memory, so we turned the deciding rules into settings HR could change themselves, with every change logged. Anything unusual went to a person: a medical expense claim over €2,000, for example, needed further proof, so it went to HR instead of being paid. We also kept a full record of every action, so a year later we could see what the system did and why. With pay and HR, any mistake can become a legal question, and that record is how you answer it.