Data Engineer (AI Platform)
We're hiring a data engineer to own the pipelines behind [product]'s AI features. You'll prepare training and retrieval data, version it so results can be reproduced, build the checks that stop bad records reaching a model or index, and decide with [team] how fresh each dataset needs to be for what it costs.
What you'll do
- •Build and run pipelines that load source data into training sets, fine-tuning sets and retrieval indexes.
- •Make every job safe to rerun, backfill or replay without duplicating or losing records.
- •Write data-quality checks for uniqueness, freshness, nulls and counts, and decide which ones block a load.
- •Version datasets and record lineage so any record can be traced to its source and loading job.
- •Control who can read each dataset and keep personal or restricted fields out unless their use is approved.
- •Track the cost of loads and embedding runs and agree freshness targets with the people who use the data.
What you need
- •You have built and run at least one production data pipeline, including after the source changed underneath it.
- •You write clear, tested SQL and [Python/other] for transforms that run unattended.
- •You can show a data-quality check you wrote and an incident it caught or would have caught.
- •You have handled restricted or personal data and can explain how you limited access to it.
Nice to have
- •Experience loading documents into a search or vector index, including chunking and re-embedding.
- •Experience preparing or versioning training data for a machine learning team.
- •Experience with change-data capture or streaming sources.
- •Familiarity with data-protection requirements that apply to training data, such as deletion requests.
How we use AI tools
- •Using AI tools to draft SQL, transforms or tests is welcome where company policy allows; you'll be expected to read and run what they produce before trusting it.
- •You'll be able to tell when a model-based step, such as AI-assisted deduplication, adds risk a deterministic rule would avoid.
- •Any AI tools you lean on during the work sample are fine — list them in your submission with a line on how you checked their output.
Pay
Salary range: [currency, minimum–maximum], plus [equity/bonus/benefits]. The range reflects [location/working pattern]. We place every offer within it using the same pre-set, job-related, gender-neutral factors — level and the number of pipelines they would own, experience running production pipelines through upstream changes, experience handling restricted or personal data, experience with retrieval indexes or training-data preparation — never previous salary or negotiating style.
