All posts

Technology · July 23, 2026 · 9 min read

How to Hire a QA Engineer: Test Strategy Over Test Counts

How to hire a QA engineer in 2026: screen for test strategy and automation judgement with work samples, structured interviews, and AI-fluency checks.

By Jakir Patel · Founder, Hanzomon

Share
Technology
On this page

The fastest way to make a bad QA hire is to screen for what is easiest to count: years of Selenium, number of test cases authored, certification acronyms. None of it predicts whether someone can look at a half-built feature, figure out where it will break, and get a team to care before customers do. This guide covers how to hire a QA engineer who can do exactly that. It is written for engineering leaders, hiring managers, and recruiters filling QA and SDET roles — at startups or enterprises, remote or onsite, first QA hire or fiftieth.

Here is what you will get: a role definition that values test strategy over test-case counting, a work sample built around a buggy feature and a spec, an AI-fluency assessment that probes AI-assisted test generation and its failure modes, and a structured interview plan with scorecards you can copy.

Why now? In 2026, candidates can generate a plausible test suite in minutes with an AI assistant, so "wrote 2,000 automated tests" on a resume tells you almost nothing. Meanwhile, AI-generated application code is shipping faster than humans can review it, which makes the judgement of a strong QA engineer more valuable, not less. Your evaluation has to measure that judgement directly — everything else in this guide serves that goal.

What does a great QA engineer actually do?

Strip away the tooling debates and the role reduces to four capabilities. Weak QA processes verify what was built; strong ones interrogate what was intended, what was built, and the gap between the two. Every stage of your hiring process should map back to at least one of these four.

Test strategy beats test-case counting

A test strategy answers a hard question: given finite time, what do we test first, at what level, and what do we consciously leave untested? Great QA engineers reason about risk — new code paths, money-touching flows, integrations owned by other teams — and allocate effort accordingly. Candidates who talk only in case counts or coverage percentages are optimizing a proxy. Ask a candidate to prioritize testing for a release under a hard deadline and listen for explicit trade-offs, not a promise to test everything.

Automation judgement: knowing what not to automate

Automation is a bet: you pay a maintenance cost forever in exchange for cheap repetition. Great QA engineers are selective about that bet. In interviews, probe for things they chose not to automate and why. Reasonable answers include:

  • One-off exploratory sessions where the learning, not the artifact, is the point
  • UI flows still changing weekly, where the suite would rot faster than it pays back
  • Scenarios cheaper and more reliable to cover with a lower-level contract or unit test
  • Checks that need human perception — layout sanity, the tone of an error message, whether something feels broken

Exploratory testing is a skill, not a vibe

Exploratory testing is structured investigation: pick a charter, form hypotheses about where the software is weak, run experiments, and chase surprising results. It is the discipline most exposed by a work sample and most invisible on a resume. Skilled explorers find the bug two menus deep behind an edge case in state handling; unskilled ones re-verify the happy path and call it a session. The tell is what a candidate does after a surprising result: a strong tester treats it as a thread to pull — narrowing the conditions, checking whether it generalises, and asking what else in the system shares that assumption. A weaker one logs the single instance and moves on. That difference in curiosity is the single best predictor of whether someone will find the bug that matters before a customer does, and it is exactly what a timed, observed session makes visible.

Quality advocacy: influence without authority

QA engineers rarely have the authority to block a release; they have evidence and persuasion. A great bug report is an act of advocacy: it reproduces cleanly, quantifies user impact, and makes the fix decision easy. Look for candidates who have changed a team's behavior — earlier testability conversations, better acceptance criteria, fewer regressions reaching production — without ever owning the roadmap.

How to hire a QA engineer: define the role first

Most QA hiring pain is self-inflicted at the job-description stage. "QA Engineer" spans at least four distinct jobs, and interviewing for the wrong one wastes everyone's time. Before you post anything, decide which of these you need — and say so plainly in the listing (our guide on how to write a job description covers the mechanics):

  • Manual-first QA analyst: deep exploratory and domain testing, light scripting
  • Hybrid QA engineer: exploratory skill plus maintainable automation for regression coverage
  • SDET: builds test infrastructure and frameworks; closer to a software engineer than a tester
  • Quality coach: embeds with delivery teams to improve practices rather than executing tests

If this is your first QA hire, bias toward the hybrid profile. A pure SDET will build infrastructure before you know what to test; a pure manual analyst will drown once release cadence rises. You want someone who can do both at 80% and tell you which one matters this quarter.

What should the QA hiring process look like?

A defensible process is short, structured, and weighted toward evidence you can compare across candidates. Five stages are enough: a focused screen on role fit and strategy vocabulary, a sandboxed work sample, a structured technical interview built on the work-sample artifacts, an AI-fluency probe, and a collaboration conversation with the engineers the hire will support. Each stage should have a written rubric before the first candidate enters it — deciding what good looks like after you have met someone you like is how bias creeps in.

01Job description
02Extract skills & seniority
03Compose pillars
04Quality gate
05Live assessment

Every question is generated per job and verified before a candidate ever sees it.

0.54
Validity of work samples for predicting job performance in classic selection research (Schmidt & Hunter)
~30%
Of first-year earnings — the commonly cited U.S. Department of Labor estimate for the cost of a bad hire
Days, not weeks
Time to a confident decision when rubrics and criteria are written before interviews begin

The work sample: one buggy feature, one spec, three bug reports

Nothing predicts QA performance like watching a candidate do QA. Work-sample tests consistently outperform resume review and unstructured interviews across selection research, and for QA the design is unusually natural: give the candidate a deliberately buggy feature, the spec it was supposed to implement, and 90 minutes. Ask for two artifacts — a one-page test plan and their three best bug reports.

The constraint is the point. Three reports, not thirty, forces prioritization: does the candidate surface the data-loss bug and the broken payment edge case, or three cosmetic misalignments? The test plan reveals strategy — what they would test at which level, and what they would consciously defer. The bug reports reveal advocacy: minimal reproduction steps, severity reasoning, and user impact stated in language a product manager acts on.

A sandboxed work sample lets QA candidates explore a real buggy feature, design a test plan, and file bug reports in an identical environment for every candidate — with a full process log for reviewers.
Rubric
Test plan (50 pts)
- Risk-based prioritization with explicit trade-offs ........ 20
- Right level per check (unit / API / UI / exploratory) ..... 15
- Consciously deferred areas, with reasoning ................ 15

Bug reports (50 pts)
- Reproducibility: minimal, deterministic steps ............. 20
- Severity judgement: worst bugs found and ranked first ..... 20
- Communication: impact framed for a non-QA reader .......... 10

Run it in a sandbox rather than as a take-home. A sandboxed assessment keeps the environment identical for every candidate, removes local-setup friction, and gives you a process log — which bugs they found, in what order, after exploring what — rather than just a polished final artifact. That log is where exploratory skill becomes visible, and it is much harder to outsource than a document.

How do you assess AI fluency in a QA engineer?

QA is one of the roles most reshaped by AI assistance, and one where naive AI use is most dangerous. AI-generated tests fail in characteristic ways, and a candidate's ability to name and counter those failure modes is a stronger fluency signal than any tool checklist — see our broader guide on how to assess AI fluency. Listen for whether candidates can articulate failure modes like:

  • Happy-path bias: generated suites over-sample the obvious flow and under-sample boundaries, concurrency, and failure states
  • Change-detector tests: assertions that lock in current behavior — bugs included — rather than intended behavior from the spec
  • Hallucinated coverage: tests that pass trivially or assert nothing meaningful, inflating coverage numbers while catching nothing
  • Oracle blindness: AI can generate inputs at scale, but it cannot tell you what the correct output should be for your domain

Make it concrete: in the interview, have the candidate use an AI assistant to generate tests against the work-sample spec, then critique the output. Strong candidates treat generation as a draft — they spot the missing negative cases, delete the assertions that codify existing bugs, and add the domain oracle the model could not know. Weak candidates accept the output because it runs green.

A green AI-generated suite is not evidence of quality — it is evidence that the suite passes. Candidates who cannot explain the difference will ship that confusion straight into your codebase.

How to hire a QA engineer with structured interviews

Unstructured interviews reward confidence and similarity; structured interviews reward evidence. Ask every candidate the same questions, in the same order, scored against anchored rubrics written in advance. For QA, anchor the questions to the four capabilities:

  • Strategy: "You have two days to test a release that normally gets two weeks. Walk me through what you cut and why."
  • Automation judgement: "Tell me about a suite you deleted or refused to build. What maintenance cost did you avoid?"
  • Exploratory skill: "Describe the best bug you ever found. How did you get to it?"
  • Advocacy: "Tell me about a time engineering disagreed with your severity call. What happened next?"

Score each answer on a 1-4 scale against written anchors immediately after the interview, before discussing with other panelists. Scorecards do two jobs at once: they make comparisons across candidates legitimate instead of vibes-based, and they create the documentation trail that modern hiring regulation increasingly expects from any employer using structured or automated evaluation. One practical calibration: weight the answers by the seniority you are actually hiring for. A junior QA hire earns the role on curiosity, care, and a coachable approach to strategy; a senior or lead hire has to demonstrate the judgement to set testing strategy for a team, to say no to low-value automation, and to influence engineering practice without owning the roadmap. Anchor the same four questions to different bars at different levels, and write those bars down before the first interview so the panel is measuring the right thing.

Common mistakes when hiring a QA engineer

  • Screening on tool checklists ("must have Playwright") instead of judgement — tools change every few years; strategy transfers
  • Treating QA as a junior-engineer consolation role, which guarantees you attract candidates who see it the same way
  • Reusing a static, shared test that every candidate can find answers to — per-job generation is the practical countermeasure
  • Skipping the work sample because "we can tell from conversation" — decades of selection research say you cannot
  • Hiring an SDET when you needed exploratory depth, or vice versa, because the job description never made a choice

If you use automated tools anywhere in QA hiring, jurisdictional rules may apply: NYC Local Law 144 requires bias audits and candidate notice for automated employment decision tools, and the EU AI Act treats hiring AI as high-risk. This is informational, not legal advice — consult counsel for your specific situation.

Where H-Evaluate fits

H-Evaluate generates a QA-specific assessment from your job description — quality-gated, per-job generation rather than a static shared library — so the buggy-feature exercise a candidate faces maps to the release problems your team actually has and cannot be scraped from a forum. Sandboxed work samples capture the process log, not just the artifact, and the AI-fluency module measures exactly the generate-then-critique loop this guide describes.

The compliance posture is built in rather than bolted on: structured scoring, documented criteria, and a design aligned with NYC Local Law 144 and the EU AI Act. If you are rethinking the whole funnel rather than one role, start with our overview of AI-native hiring.

You can generate a thousand tests in a minute. Knowing which three bugs matter is still a human judgement — hire for that.
qa-engineerhiring-guideswork-samplestest-automationstructured-interviewsai-fluency
J

Written by

Jakir Patel · Founder, Hanzomon

Building H-Evaluate — AI-native, quality-gated hiring assessments. Writes about assessment engineering, hiring integrity and compliance-first AI.

Frequently asked questions

What skills should I look for when hiring a QA engineer?

Prioritize four capabilities: test strategy (risk-based prioritization under time pressure), automation judgement (knowing what not to automate as much as what to automate), exploratory testing skill (structured investigation that surfaces non-obvious bugs), and quality advocacy (bug reports and communication that change team behavior). Tool experience matters less than judgement — frameworks change every few years, but the ability to reason about risk transfers across every stack.

Should a QA engineer know how to code?

It depends on the role variant. An SDET builds test infrastructure and needs genuine software-engineering skills. A hybrid QA engineer needs enough scripting to write and maintain automated regression tests. A manual-first analyst or quality coach can be highly effective with light scripting. The common mistake is defaulting to 'must code' for every QA opening, which filters out excellent exploratory testers your team may actually need more.

How do I test a QA engineer's skills before hiring?

Use a work sample that mirrors the job: give candidates a deliberately buggy feature and its spec, then ask for a one-page test plan and their three best bug reports in about 90 minutes. The three-report limit forces prioritization, the plan reveals strategy, and the reports reveal communication. Run it in a controlled sandbox so every candidate gets the same environment and you can review process, not just output.

How do I evaluate a QA engineer's AI fluency?

Have candidates generate tests with an AI assistant against a spec, then critique the output. Strong candidates identify characteristic failure modes: happy-path bias, change-detector tests that lock in buggy behavior, hallucinated coverage that asserts nothing, and missing domain oracles. They treat generated tests as a draft to edit, not a deliverable. Candidates who accept AI output simply because it runs green are demonstrating the opposite of fluency.

What are red flags when hiring a QA engineer?

Watch for candidates who measure themselves in test-case counts or coverage percentages without risk context, who claim to automate everything, who cannot describe a memorable bug they found through exploration, or who describe adversarial relationships with every engineering team they have worked with. Also treat over-polished take-home artifacts with no visible process cautiously — sandboxed, timed work samples make genuine skill easier to distinguish from AI-assisted polish.

Related posts

See it on your own job description

Join the early-access waitlist and watch H-Evaluate build an assessment for a real role.

See it on your own job description