How to create an ATS interview feedback process that improves hiring quality

A good ATS interview feedback process turns interviews into decision data. It gives each interviewer a clear brief, captures evidence in a structured form, and makes candidates comparable before the hiring team starts debating opinions.

The aim is not to make hiring mechanical. The aim is to stop vague notes, delayed feedback and senior-person bias from deciding who moves forward.

This guide is for founders, HR leads, recruiters and talent teams who already use, or are choosing, an applicant tracking system. It uses Greenhouse, Lever and Ashby as implementation examples because their public documentation gives useful detail on scorecards, feedback forms, AI notes and reporting. That does not make them the top three ATS tools overall on ATSLab. Breezy HR remains our Editor’s Choice overall, while Ashby is our highest-ranked scaling-team tool.

What is an ATS interview feedback process?

An ATS interview feedback process is the repeatable workflow for collecting, structuring, reviewing and analysing interviewer feedback inside your applicant tracking system. It starts before the first interview, because the scorecard is only as good as the criteria behind it.

The basic workflow is simple: define role success criteria, turn those criteria into scorecards or feedback forms, assign interviewer focus areas, require feedback before the debrief, review submitted evidence, then use reporting to improve the next hiring loop.

That last step matters. If the process stops at completed forms, you have tidier notes but little learning. If the ATS can show completion speed, pass-through rates and interviewer variance, the feedback process starts improving hiring quality over time.

A small team can run this with a light scorecard and one debrief meeting. A larger team needs stricter controls, because more interviewers mean more chances for repeated questions, patchy notes and late feedback.

Why unstructured interview feedback hurts hiring quality

Unstructured feedback fails because it gives hiring teams fragments instead of comparable evidence. One interviewer writes three paragraphs about communication style, another gives a thumbs-up with no context, and a third waits two days until the debrief has already shaped their view.

That creates predictable problems. Candidates are judged on different criteria, weak signals get treated as facts, and strong interviewers can dominate a meeting before quieter interviewers submit their evidence.

Structured scorecards and feedback forms fix part of this. They give every interviewer the same framework, so the team can compare candidates across stages, roles and interviewers.

They do not remove bias on their own. A scorecard is a process control, not a guarantee of fairness. The value comes from pairing ratings with written evidence, independent submission and disciplined debriefs.

The timing is as important as the form. If interviewers read each other’s feedback too early, anchoring creeps in. If recruiters allow debriefs before forms are complete, the loudest opinion often becomes the starting point.

The 7-step ATS interview feedback process

Start with role success criteria before interviews begin. Define what a strong hire must be able to do in the first 6 to 12 months, then separate must-have criteria from trainable preferences.

Next, convert those criteria into ATS scorecards or feedback forms. Each form should map to the interview stage, rather than asking every interviewer to judge everything. A technical screen, hiring-manager interview and values interview should not all ask the same questions.

Assign each interviewer a focus area. One person might cover role-specific skills, another collaboration, another leadership judgement. This reduces duplication, but the limitation is that each interviewer must understand their brief before the interview starts.

Require feedback before the debrief. This is one of the simplest quality controls in the whole process. The downside is operational: recruiters need the authority to postpone a debrief, or at least mark missing feedback as a process failure.

Use calibrated rating scales and require evidence. A 1 to 5 scale is weak if nobody defines what a 3 means. A useful scorecard gives rating anchors and asks for observed evidence, risks, concerns and a clear recommendation.

Review scorecards in a debrief or candidate roundup. The recruiter should start with the role criteria, then compare evidence across interviewers. The meeting should resolve differences, not repeat every interview note aloud.

Finally, track the process itself. Look at completion rate, time to feedback, pass-through by stage, interviewer variance and post-hire signals where your HRIS or analytics process can support it. The catch is that messy forms create messy reports, so reuse templates where reporting matters.

How do you build scorecards that produce usable decision data?

A useful scorecard is short enough that interviewers complete it, but structured enough that the hiring team can compare candidates. The sweet spot is usually 4 to 7 criteria per interview, each with a rating, evidence field and recommendation.

Each criterion should connect to the job. “Strong communicator” is too vague unless the role needs customer negotiation, cross-functional alignment or technical writing. Tie the criterion to the work, then ask for evidence from the interview.

Ratings need anchors. For example, a low rating might mean the candidate could not describe a relevant example, while a high rating might mean they gave a specific example with clear trade-offs and measurable results.

Written evidence is the safeguard. A score without evidence is just a tidier gut feel. Ask interviewers to write what the candidate said or did, then separate that from their interpretation.

Keep templates reusable where possible. Ashby specifically recommends shared application forms, feedback forms and interviews when teams want reporting across jobs, because custom versions are harder to report on unless connected to a custom field. Reuse helps analytics, but it can feel restrictive if every role has unusual requirements.

How to set it up in Greenhouse

Greenhouse is the mature structured-hiring example if your organisation needs formal scorecards, interview kits and debrief controls. It is best suited to enterprise teams that can fund and maintain a structured implementation, not small teams that mainly need a quick hiring pipeline.

Greenhouse uses custom pricing, with plan names Core, Plus and Pro. Its Core plan includes structured interview kits and scorecards, scheduling, reporting and analytics, SSO, sourcing and CRM, and Real Talent Talent Matching.

Greenhouse scorecards can include skills, traits, qualifications, focus attributes, key takeaways, attribute ratings and overall recommendation options such as Definitely Not, No, Yes, Strong Yes and No decision. That gives hiring teams a detailed framework, but the setup work is heavier than a simple small-business ATS.

The useful control is scorecard visibility. Greenhouse can be configured so interviewers see past scorecards never, always, or only after all other interviewers submit. Hiding prior feedback until submission supports independent judgement, though recruiters need to explain the rule so interviewers do not see it as needless friction.

Greenhouse also supports AI scorecard summaries, interview question suggestions, scorecard attribute suggestions and scorecard text refinement across all tiers. These can speed up review, but they should stay human-reviewed aids rather than decision makers.

Greenhouse announced Greenhouse Notetaker on 10 June 2026, describing it as recording and transcribing interviews, then mapping AI-generated notes to scorecard questions. If you plan to use it, ask your vendor contact about release status, consent handling and retention settings before building policy around it.

How to set it up in Lever

Lever is the relevant example if your interview feedback process sits inside a wider ATS and CRM motion. It suits enterprise teams that hire proactively and nurture passive candidates over time, but its custom pricing and implementation model are overkill for many small teams.

Lever’s pricing page says every plan includes core ATS, CRM, advanced reporting and analytics, plus key integrations. Its help centre has a Feedback & Forms section covering interview feedback forms, interview criteria and form templates.

For the interview workflow, build feedback forms around role criteria, then connect them to the right stages and interviewers. LeverTRM’s product page lists structured scorecards for consistent evaluation, AI-ranked candidate shortlists, pipeline analytics and talent rediscovery. Those features help teams connect interview signals with pipeline work, but they need clean data to be useful.

Lever AI Interview Transcripts and Summaries Lite captures video interview conversations and generates summaries. It supports Zoom, Microsoft Teams and Google Meet, but not phone calls.

There are governance details buyers should not skip. Lever candidate emails include non-editable AI recording disclaimer language and an opt-out link, and consent status appears on the candidate profile.

There are also usage and cost questions. Lever’s Lite limit is 50% of average completed video conference interviews per month, and panel interviews count each interview event separately. Unlimited transcripts and summaries are documented as an additional-cost upgrade, and standalone AI Interview Companion is also an add-on with pricing through an account manager or customer success manager.

How to set it up in Ashby

Ashby is the cleanest example if a scaling team wants structured feedback, reportability and modern AI note workflows in one platform. On ATSLab, Ashby ranks second overall and is our Best for Scaling pick, but it still costs more than many small-business tools.

Ashby’s official plan names are Foundations, Plus and Enterprise, with separate Ashby Analytics for existing ATS users. Foundations is priced at $400 per month for companies up to 100 employees, and Ashby offers a 10% discount for annual commitments.

For feedback design, Ashby’s key advice is to use shared forms where reporting matters. Shared feedback forms can be used across as many jobs as needed, which makes it easier to compare interview data across roles. The trade-off is that teams must resist creating one-off forms for every hiring manager request.

Ashby AI Notetaker is listed as an add-on. It includes recording and transcription, AI summaries, AI assistance for drafting feedback, interview-specific AI chat, consent, opt-out, data retention controls and connected meeting data.

Ashby released AI Notetaker to public beta on 25 September 2025. Recordings and transcripts appear next to feedback submissions, and Auto-fill with AI can draft feedback directly inside the feedback form.

Ashby says each plan includes 500 interviews to try AI Notetaker at no cost. That is useful for testing adoption, but teams should still confirm what happens after the allowance and how long recordings or transcripts are retained.

Ashby’s product-specific terms also set the right boundary: AI Interviewer is designed to assist, not replace, human decision-making, and a qualified human reviewer must make hiring decisions. That is the correct policy stance for any ATS interview feedback process using AI.

What should your interview scorecard template include?

A strong scorecard template should capture the decision evidence in a consistent format. Include the competency or success criterion, the interviewer’s focus area, the question or prompt, observed evidence, rating, recommendation, confidence level and follow-up concerns.

Add rating anchors next to each scale. A numeric scale without anchors produces false precision, because one interviewer’s 4 may be another interviewer’s 3.

Use an overall recommendation, but do not let it replace the evidence fields. Greenhouse, for example, supports recommendation options from Definitely Not through Strong Yes, plus No decision. That is useful for debrief sorting, but the team still needs the reasoning behind the vote.

Add a confidence field. A low-confidence Yes is different from a high-confidence Yes, especially if the interviewer ran out of time or did not cover the planned focus area.

Include hiring-bar notes or calibration comments. These help the team record why a candidate met, missed or exceeded the bar, and they become useful training material for future interviewers.

Keep the template as reusable as the role allows. Breezy HR, for example, supports candidate scorecards tied to positions or pipeline stages, with thumbs-up/down ratings, comments, average ratings and side-by-side comparisons. Its custom scorecards have a 200 limit and are available on Growth, Business and Pro plans, so teams still need to manage template sprawl.

Which metrics show whether feedback is improving hiring quality?

The first metric is scorecard completion rate. If only 70% of interviewers complete feedback, the process is not reliable enough for serious debriefs. Aim for near-complete submission before every hiring meeting.

Track time to feedback after interview. Same-day feedback is usually cleaner than feedback written after a candidate stack has blurred together. The limitation is that speed should not mean thin notes, so pair timing with evidence quality checks.

Measure the percentage of feedback submitted before debrief. This is a direct check on groupthink risk. If forms arrive after the meeting, the process is documenting the decision rather than informing it.

Look at stage pass-through rate by interviewer, role and department. If one interviewer rejects nearly everyone, or another passes nearly everyone, you may have a calibration problem. The data will not tell you who is right by itself, but it shows where to inspect.

Track interview-to-offer conversion. A low conversion rate after late-stage interviews may mean weak screening, unclear criteria or interviewers testing for different things.

For more mature teams, review inter-rater variance across competencies. If interviewers disagree sharply on the same criterion, the scorecard may be vague or the interview training may be weak.

Candidate experience is also part of hiring quality. Use survey score or candidate NPS if your ATS or HR stack tracks it, but treat it as one signal. A pleasant process can still make poor hiring decisions if the scorecards are loose.

Post-hire proxy metrics are the hardest but most valuable. Retention, ramp performance and hiring-manager satisfaction can show whether interview signals predicted real work, if your HRIS or analytics process connects those data points.

What should you ask ATS vendors before buying?

Ask whether structured scorecards or feedback forms are included in the base plan. Some tools include them early, while others reserve advanced controls, analytics or AI support for higher tiers or add-ons.

Ask whether scorecards can be reused across jobs, stages and departments. Reuse matters for reporting, but you still need enough flexibility to reflect different roles.

Ask whether feedback can be hidden until all interviewers submit. Greenhouse supports configurable visibility, which is useful for independent feedback. If another vendor cannot do this, you may need recruiter discipline rather than software controls.

Ask whether interviewers can be assigned specific focus areas. Without that, teams often repeat the same questions and miss important criteria.

Ask whether recruiters can enforce feedback completion before debrief. A reminder is helpful, but a workflow control is stronger if your hiring managers tend to move fast without written evidence.

Ask how AI summaries, transcripts and notetakers are priced. Check whether they are included, limited, metered or add-on. Lever’s documented Lite limit and Ashby’s AI Notetaker add-on show why this question matters.

Ask about candidate consent, opt-out, recording storage and retention. AI interview notes are convenient, but recording a candidate interview creates policy and trust obligations.

Finally, ask about reporting limits and hidden fees. Confirm whether feedback data can be reported by job, stage, interviewer and department, and ask about implementation, migration, integrations, SMS, e-signature, scheduling and other usage fees.

Which ATS should you shortlist for this workflow?

Shortlist Greenhouse if you are an enterprise team that wants formal structured hiring, scorecard controls and deep hiring process discipline. The limitation is cost and complexity: ATSLab records Greenhouse from about $6k, and its official pricing is custom.

Shortlist Lever if your feedback process needs to connect with proactive sourcing, CRM workflows and passive-candidate nurture. The limitation is that pricing is custom, ATSLab records Lever from about $4k, and AI transcript limits or add-ons need contract confirmation.

Shortlist Ashby if you are a scaling team that wants ATS, CRM and analytics in one platform, with shared forms and AI-assisted feedback workflows. The limitation is that Foundations starts at $400 per month for companies up to 100 employees, so it is not the cheapest way to collect interview notes.

If you are a smaller business, do not assume these enterprise-leaning examples are the right buy. Breezy HR remains ATSLab’s number one ranked ATS overall at $157, and it suits startups and small businesses that want a capable ATS without per-seat fees. The trade-off is that larger teams may outgrow lighter workflow controls and reporting depth.

The right choice depends on hiring volume, process maturity and reporting needs. Buy the ATS that enforces the behaviour your team will actually follow, not the one with the longest AI feature list.