AI engineer loops are new, and still moving
Most loops for people who build LLM apps centre on a RAG or agent design round, a project deep dive and LLM fundamentals, often with a take-home build. Formats changed several times in 2025–2026, so every one here is dated. In live design rounds, the Diagram tab draws the components and data flow as the question is asked.
Seven kinds of round, next to an MLE loop
Loops pick from these. Almost every report behind this page is from 2025–2026 and most describe a single loop, so treat each one as a snapshot.
| Round | What candidates reported | Compared with an MLE loop |
|---|---|---|
| LLM or RAG application design | What candidates reported: Design a RAG or LLM system, then field follow-ups on parsing, retrieval, cost and safety. RAG was the prompt in Capital One’s Senior AI Engineer loop and in a 2026 loop at a product-and-services company. Reddit, 2025 (opens in a new tab); Reddit, 2026 (opens in a new tab) | Compared with an MLE loopRetrieval, RAG, agents and chatbots replace ranking and forecasting models. One candidate called it different from traditional ML system design. Reddit, 2025 (opens in a new tab) |
| Coding | What candidates reported: Often practical: debugging a Flask app plus one LeetCode problem at Capital One, and a spreadsheet-formula and caching problem at OpenAI, per a prep-site report. One 2026 loop had no coding at all. Reddit, 2025 (opens in a new tab); Reddit, 2026 (opens in a new tab); Aced, 2025 (opens in a new tab) | Compared with an MLE loopA 2026 commenter describes it as lighter than hard LeetCode. Big-tech loops can still keep a LeetCode round, as Apple’s GenAI-heavy loop did. Taro, 2025 (opens in a new tab); Reddit, 2026 (opens in a new tab) |
| LLM fundamentals | What candidates reported: Attention step by step, KV caching, tokenisation, decoding, when to fine-tune rather than prompt, and reward methods like DPO and PPO. Capgemini screens paired fundamentals with easy Python, per a prep-site compilation. Reddit, 2025 (opens in a new tab); Taro, 2025 (opens in a new tab); Reddit, 2025 (opens in a new tab); Reddit, 2025 (opens in a new tab); Taro, 2025 (opens in a new tab); EasyLearnSpace, 2025 (opens in a new tab); Reddit, 2025 (opens in a new tab); LeetCode Discuss, 2025 (opens in a new tab) | Compared with an MLE loopCentred on transformers and LLM behaviour rather than classic ML, though Microsoft’s applied scientist loop still asked for a PCA derivation. Reddit, 2025 (opens in a new tab) |
| Evaluation and experiments | What candidates reported: Which metrics to use for an LLM (BLEU, ROUGE, human evaluation, LLM-as-judge), and how to A/B test a change. Reddit, 2025 (opens in a new tab) | Compared with an MLE loopIn one Microsoft Applied Scientist IC2 loop, this was a round of its own, separate from design. Reddit, 2025 (opens in a new tab) |
| Build exercise | What candidates reported: A RAG app, agent or LLM pipeline, built as a take-home or live: a live RAG build at one GenAI company, and a 2-hour build at Sierra. Sierra, 2026 (opens in a new tab); Reddit, 2025 (opens in a new tab); Reddit, 2025 (opens in a new tab); GitHub (Tucows) (opens in a new tab) | Compared with an MLE loopLighter coding is often paired with a small build instead. Reddit, 2026 (opens in a new tab); Reddit, 2026 (opens in a new tab) |
| Project deep dive | What candidates reported: What you personally built and why: every tool and framework choice in a RAG project at Accenture, and nearly every part of the resume at Capital One. Reddit, 2025 (opens in a new tab); GeeksforGeeks, 2025 (opens in a new tab); Aced, 2025 (opens in a new tab) | Compared with an MLE loopThe same kind of round, with the questions on LLM tooling such as CrewAI agents and MCP. GeeksforGeeks, 2025 (opens in a new tab) |
| Customer, client or case round | What candidates reported: A chatbot pros-and-cons case at Capital One, a final client round at Deloitte, a customer round for an OpenAI AI Deployment Engineer (single report), and a “Sales Team Simulation” an OpenAI Applied AI Engineer candidate in Mumbai was told to expect. Reddit, 2025 (opens in a new tab); Taro, 2025 (opens in a new tab); Blind (opens in a new tab); Reddit, 2026 (opens in a new tab) | Compared with an MLE loopShows up in deployment-style, customer-facing AI roles. Prep sites describe a customer role-play in Anthropic’s forward deployed engineer loop, possibly drawing on the same reports. techinterview, 2026 (opens in a new tab); The Forward Deployed, 2026 (opens in a new tab) |
At big tech the overlap is large: Microsoft and Apple GenAI loops still included classic ML, maths and LeetCode. Reddit, 2025 (opens in a new tab); Taro, 2025 (opens in a new tab)
How ML engineer loops runOne RAG prompt, probed stage by stage
Follow-ups candidates reported after a RAG or agent design prompt, placed on the part of the system each one tests.
Parse and chunk
- What if the PDFs contain images or tables, or a chunk cuts across the relevant text? Reddit, 2025 (opens in a new tab)
- Which OCR or vision-language model reads the charts? How do you answer a stock-price question when only a chart has the data? Reddit, 2026 (opens in a new tab)
Retrieve
- Retrieval is inaccurate, or a “completeness” metric lags. What do you change? Reddit, 2025 (opens in a new tab)
- Route e-commerce queries between semantic, keyword and hybrid search. Reddit, 2026 (opens in a new tab)
- The corpus grows from 10 to 100 documents of 100 pages each. Reddit, 2025 (opens in a new tab)
Generate
- How would you combat hallucination? One Amazon candidate answered with a reference dataset, RAG and fine-tuning. Reddit, 2025 (opens in a new tab)
- Design a system that cuts prompt token usage. Reddit, 2025 (opens in a new tab)
Evaluate
- BLEU, ROUGE, human evaluation or LLM-as-judge? How would you A/B test it? Reddit, 2025 (opens in a new tab)
- How do you ensure output quality? Write a similarity-score check for the generator. GeeksforGeeks, 2025 (opens in a new tab)
Run it safely
- Latency, cost, caching, observability, safety and fallbacks, in one 2026 commenter’s list of design themes. Reddit, 2026 (opens in a new tab)
- Mask personal data and keep each customer’s data isolated (single report). Reddit, 2026 (opens in a new tab)
Agents and tools
When the design grows into an agent
- Single agent or multi-agent? Why route between agents? Can CrewAI agents run in parallel? GeeksforGeeks, 2025 (opens in a new tab)
- MCP, asked alongside RAG and A/B testing at Microsoft and next to CrewAI at Accenture. Reddit, 2025 (opens in a new tab); GeeksforGeeks, 2025 (opens in a new tab)
- Improve an existing agentic pipeline. LangGraph state, nodes, edges and routing come up in a secondhand account. Taro, 2025 (opens in a new tab); Reddit, 2026 (opens in a new tab)
Other opening prompts
A memory system for an on-prem small model, a format-agnostic electricity-bill extractor, applying RAG and agentic frameworks to a scenario, and an LLM system design round at IDFC First Bank. Reddit, 2026 (opens in a new tab); Reddit, 2025 (opens in a new tab); Taro, 2025 (opens in a new tab)
With Assisted Voice: The Diagram tab draws the first version of the pipeline as the prompt is asked. For each follow-up, press the answer shortcut for a first-person answer you can put in your own words.
Can you use AI in the interview? Check the date
Companies changed their rules in quick succession through 2025 and 2026. Each entry says who published it: the company, or the press.
- AI allowed or expected
- AI allowed in a pilot
- No AI unless permitted
- Depends on the round
2025
Amazon
2025No AI unless permittedSource: Press reports
Business Insider and GeekWire reported internal guidelines telling candidates not to use GenAI tools during interviews unless explicitly permitted, and that breaking this can lead to disqualification. An Amazon spokesperson said candidates acknowledge they won’t use unauthorised tools. Business Insider, 2025 (opens in a new tab); GeekWire, 2025 (opens in a new tab)
Meta
2025AI allowed in a pilotSource: Meta’s own post, plus press
Meta describes a pilot AI-enabled coding interview in which candidates may use authorised AI tools inside the interview environment. Earlier press reporting described internal plans and mock interviews. Meta on LinkedIn, 2025 (opens in a new tab); CoderPad blog, 2025 (opens in a new tab); WIRED, 2025 (opens in a new tab)
Canva
June 2025AI allowed or expectedSource: Canva’s engineering blog
Expects backend, machine learning and frontend candidates to use AI tools such as Copilot, Cursor and Claude in technical interviews. Canva Engineering, 2025 (opens in a new tab)
Anthropic
July 2025No AI unless permittedSource: Anthropic’s candidate guidance
Live interviews are done without AI assistance, and take-homes without Claude, unless Anthropic says otherwise. It encourages using AI to prepare. Anthropic, 2025 (opens in a new tab)
2026
DoorDash
March 2026AI allowed or expectedSource: DoorDash’s careers blog
A 60-minute AI-assisted working session on your own machine and IDE, screen-shared and narrated, replaces traditional coding rounds. DoorDash Careers, 2026 (opens in a new tab)
Sierra
April 2026AI allowed or expectedSource: Sierra’s blog
The onsite includes a 2-hour build with AI tools of your choice, followed by a review. The phone screen is now system design. Sierra, 2026 (opens in a new tab)
Google
May and October 2026AI allowed in a pilotSource: Press reports
Business Insider reported a pilot “code comprehension” round for junior to mid-level SWE roles on select US teams: read, debug and optimise existing code with Gemini as the approved assistant, assessed partly on AI fluency. In October it reported a broader rollout, still called a pilot. Business Insider, 2026 (opens in a new tab); Business Insider, 2026 (opens in a new tab)
Undated
OpenAI
Live pageDepends on the roundSource: OpenAI’s interview guide
Some formats intentionally allow AI and others assess problem-solving without it, and the preparation materials say which. A prep site tells L4 candidates to assume no AI in live coding unless told otherwise. One commenter describes a US L6 loop where an AI agent was allowed in a one-hour technical interview (single report). OpenAI (opens in a new tab); Hello Interview, 2026 (opens in a new tab); Reddit, 2026 (opens in a new tab)
Google
Candidate guideNo AI unless permittedSource: Google’s virtual-interview guide
Using AI during an interview means disqualification. The 2026 pilot round with Gemini as the approved assistant, reported by the press, is the exception. Google (opens in a new tab)
Meta
Live pageNo AI unless permittedSource: Meta’s hiring FAQ
Outside AI tools aren’t allowed; only the tools inside its interview environment may be used. The FAQ says many Meta interviews now include a built-in AI assistant in CoderPad. Meta Careers (opens in a new tab)
Most of these rules cover engineering interviews in general, not only AI engineer roles. Ask your recruiter what applies to each round before the day.
Where a company’s rules say no AI in a round, as Anthropic’s do for live interviews unless it says otherwise, that includes Assisted Voice. Don’t use it in that round. Anthropic, 2025 (opens in a new tab)
Loops reported, with dates
Every row is dated because these loops change quickly. Most rows are one candidate’s experience or a prep site’s summary.
| Company | Format reported | Source |
|---|---|---|
| OpenAIAll roles, live guide, undated | Skills assessments vary by team: pair coding, take-home projects or technical tests. Finals typically run 4–6 hours with 4–6 people over 1–2 days, virtual by default, with an optional San Francisco onsite. | OpenAI (opens in a new tab) |
| OpenAISWE, Applied AI, senior, 2025 | Per a prep-site report: a recruiter screen, then one system design and one coding screen, then a virtual onsite with two more technical rounds, behavioural, cross-functional behavioural and a project deep dive. | Aced, 2025 (opens in a new tab) |
| AnthropicApplied AI / forward deployed, 2026 | Prep sites only: a Claude and MCP use-case screen, multi-stage refactoring coding, solution design for an often-regulated customer, a values round and a customer-conversation role-play. The sites may draw on the same reports. | techinterview, 2026 (opens in a new tab); FDEInterviews, 2026 (opens in a new tab); The Forward Deployed, 2026 (opens in a new tab) |
| Capital OneSenior AI Engineer, 2025 | A four-round Power Day: coding (debug a Flask app, one LeetCode problem, resume questions), an LLM design needing RAG plus a database design, behavioural, and a case on chatbot pros and cons with code reading. | Reddit, 2025 (opens in a new tab) |
| MicrosoftApplied Scientist IC2, 2025 | System design on cutting prompt token usage; ML and maths (CNNs, a PCA derivation); LLMs and experimentation (RAG, A/B testing, MCP); and LLM evaluation (BLEU, ROUGE, human evals, LLM-as-judge). Microsoft’s Candidate Code of Conduct says candidates should show their own skills in assessments and interviews, without outside assistance unless explicitly permitted. | Reddit, 2025 (opens in a new tab); Microsoft Careers (opens in a new tab) |
| AmazonMLE, GenAI team, 2025 | A one-hour first stage, roughly 60% technical (explain attention step by step, combat hallucination) and 40% Leadership Principles. The candidate describes a loop of five interviews, four on Leadership Principles. Amazon’s remote-interview page says interviews run on Zoom or Amazon Chime; Assisted Voice works on Zoom, not Chime. | Reddit, 2025 (opens in a new tab); Amazon Jobs (opens in a new tab) |
| AccentureLLM Operations Engineer, Pune, December 2025 | Two rounds. The final covered a RAG project, CrewAI agents, MCP, transformers, Python OOP and REST methods. | GeeksforGeeks, 2025 (opens in a new tab) |
| DeloitteGenAI Engineer, Bengaluru, April 2025 | Four elimination rounds: two technical, then a partner, then a client. This candidate cleared the technical rounds and didn’t pass the client round. | Taro, 2025 (opens in a new tab) |
Take-homes, tests and timed builds: not for Assisted Voice
AI engineer loops lean on build exercises more than most. Assisted Voice is for live conversation on Zoom, Google Meet and Microsoft Teams, so it doesn’t help with any of these.
Builds with a stated time
4–6 hours
A take-home AI knowledge assistant: RAG, a REST API and an MCP server.
Tucows, Intermediate AI Engineer, undated GitHub (Tucows) (opens in a new tab)
Up to4 hours
An ML take-home with a written report and a dockerised script.
TXT Arcan, AI Engineer, 2025 GitHub (TXT Arcan), 2025 (opens in a new tab)
About5 hours
A take-home, then a recorded video walkthrough of it.
OpenAI AI Deployment Engineer, one undated Blind report Blind (opens in a new tab)
About6 hours, in a 48-hour window
A take-home, later discussed and extended live with an engineer.
OpenAI SWE L4, 2026, per a prep site Hello Interview, 2026 (opens in a new tab)
2 hours
A build with AI tools of your choice while the interviewer is out of the room, then a review.
Sierra engineering onsite, April 2026 Sierra, 2026 (opens in a new tab)
Also outside a live call
- Online testAnthropic: a CodeSignal assessment for engineering roles, in one 2025 Blind thread where commenters disagree on the pass mark. Blind, 2025 (opens in a new tab)
- Online testZomato MLE campus hiring: ML and Python multiple-choice questions plus an end-to-end RAG build in LangChain (2025). Another GenAI company opened with an async-programming assessment (2025). Reddit, 2025 (opens in a new tab); Taro, 2025 (opens in a new tab)
- Take-homeAn AI engineer RAG take-home followed by a demo of the solution, and a senior multi-modal RAG MVP (both 2025). Reddit, 2025 (opens in a new tab); Reddit, 2025 (opens in a new tab)
- In personAccenture’s final LLM Operations round was at its office on a company laptop, with the panel joining virtually (December 2025). OpenAI offers an optional San Francisco onsite for finals. OpenAI (opens in a new tab); GeeksforGeeks, 2025 (opens in a new tab)
- In personPress reports in 2025 said Google would add at least one in-person round. Axios, 2025 (opens in a new tab)
Where it does help
The live rounds on Zoom, Google Meet and Microsoft Teams, wherever the company allows AI in that round:
- RAG and agent design: the Diagram tab draws the components and data flow as the question is asked.
- Coding shown on screen: capture it, and the Code tab gives an approach and working code.
- Fundamentals, project and behavioural questions: the answer shortcut gives a first-person answer from your resume and files.
LLM fundamentals candidates were asked
- Explain the attention mechanism step by step, without visuals. (Amazon, GenAI team)
- What is a KV cache, and how does it help inference? (Apple)
- What happens to sentiment analysis or NER when a tokenizer splits words into too many tokens? (Zomato)
- How do BERT embeddings differ from Word2Vec? Trainable or sinusoidal positional embeddings? (Zomato)
- When would you use prompt engineering rather than fine-tuning? (Apple screen)
- BERT or GPT? Are LLMs stateful or stateless? (AI engineer loop, 2026)
- Fine-tuning LLMs and VLMs, and reward methods such as DPO and PPO. (Flipkart foundation-model team)
Where candidates slip
- Preparing for the round the recruiter described. One promised “LLM optimisation and hosting” and another promised LeetCode, and both rounds turned out different.
- Assuming a GenAI title means no classic ML or DSA. PCA derivations, CNNs, DSA and t-statistics still came up.
- Starting the design too detailed. One Microsoft candidate’s feedback said to start broader (single report).
- Clearing the technical rounds, then failing the client round, in one Deloitte report.
- Thin deployment experience: a prep-site compilation of Capgemini reports includes a rejection for it.
Usually an LLM or RAG application design round, a project deep dive and LLM fundamentals questions, plus coding that’s often practical or light. Many loops add a take-home or live build, and customer-facing roles may add a client, case or sales-simulation round. These formats are new and still changing, so confirm the loop with your recruiter.
Keep preparing
- Project deep divesDefend every choice in the RAG app you built.
- ML system design roundsThe classic ML design round some AI loops keep.
- n8n and automation interviewsAgent and workflow builds, asked live.
- AI engineer interview questionsLLM, RAG and agent questions with answers.
- AI engineer questionsCommon questions with sample answers.
- NLP engineer questionsCommon questions with sample answers.
Sources
Last reviewed . Candidate reports are paraphrased, and formats vary by team, location and year.
- Interview guideOpenAI (opens in a new tab)
- Guidance on candidates’ AI usageAnthropic, 2025 (opens in a new tab)
- Embracing AI-enabled coding interviews at MetaMeta on LinkedIn, 2025 (opens in a new tab)
- AI in the interview isn’t cheating, it’s the job, according to MetaCoderPad blog, 2025 (opens in a new tab)
- Meta will let job candidates use AI during coding testsWIRED, 2025 (opens in a new tab)
- Yes, you can use AI in our interviews. In fact, we insistCanva Engineering, 2025 (opens in a new tab)
- Why DoorDash is rebuilding its engineering interviews around AIDoorDash Careers, 2026 (opens in a new tab)
- Google plans to let software engineers use AI in job interviewsBusiness Insider, 2026 (opens in a new tab)
- How Google is changing its interview process with AIBusiness Insider, 2026 (opens in a new tab)
- Amazon and candidates’ use of AI in job interviewsBusiness Insider, 2025 (opens in a new tab)
- The debate over restricting AI use during job interviewsGeekWire, 2025 (opens in a new tab)
- The AI-native interviewSierra, 2026 (opens in a new tab)
- Capital One Power Day for a Senior AI Engineer (r/cscareerquestions)Reddit, 2025 (opens in a new tab)
- AI Engineer interview, 2–6 years’ experience, product and services company (r/learnmachinelearning)Reddit, 2026 (opens in a new tab)
- An ML system design interview focused on AI engineering (r/MLQuestions)Reddit, 2025 (opens in a new tab)
- Rejected after the Microsoft Applied Scientist IC2 final loop (r/csMajors)Reddit, 2025 (opens in a new tab)
- ML Engineer, GenAI team, at Amazon (r/datascience)Reddit, 2025 (opens in a new tab)
- Apple Machine Learning Engineer interview, Cupertino, October 2025Taro, 2025 (opens in a new tab)
- ML engineer interview at Apple (r/leetcode)Reddit, 2025 (opens in a new tab)
- A year of ML engineer interviews, compiled by one candidate (r/developersIndia)Reddit, 2025 (opens in a new tab)
- Zomato Machine Learning Engineer interview, India, August 2025Taro, 2025 (opens in a new tab)
- Deloitte Gen AI Engineer interview, Bengaluru, April 2025Taro, 2025 (opens in a new tab)
- Accenture final interview for an experienced LLM Operations EngineerGeeksforGeeks, 2025 (opens in a new tab)
- Capgemini GenAI Engineer: five candidate reports (compilation)EasyLearnSpace, 2025 (opens in a new tab)
- OpenAI Software Engineer, Applied AI interview experienceAced, 2025 (opens in a new tab)
- OpenAI L4 software engineer interview guideHello Interview, 2026 (opens in a new tab)
- Are Anthropic and OpenAI forward deployed engineer loops the same as SWE?Blind (opens in a new tab)
- Anthropic interview experienceBlind, 2025 (opens in a new tab)
- LeetCode questions asked for AI, MLE and research scientist roles (r/MachineLearning)Reddit, 2025 (opens in a new tab)
- How to prepare for AI engineer interviews (r/LangChain)Reddit, 2026 (opens in a new tab)
- Do agentic AI interviews still ask LeetCode? (r/LangChain)Reddit, 2026 (opens in a new tab)
- How long would an AI engineer RAG take-home take? (r/cscareerquestions)Reddit, 2025 (opens in a new tab)
- Production-grade code in take-home tests (r/recruitinghell)Reddit, 2025 (opens in a new tab)
- Take-home challenge: an AI knowledge assistantGitHub (Tucows) (opens in a new tab)
- AI engineer technical interview test, 2025GitHub (TXT Arcan), 2025 (opens in a new tab)
- What applied-AI engineer interviews test in 2026 (prep site)techinterview, 2026 (opens in a new tab)
- Anthropic forward deployed engineer interview guide (prep site)FDEInterviews, 2026 (opens in a new tab)
- Flipkart Data Scientist 2 interviewLeetCode Discuss, 2025 (opens in a new tab)
- OpenAI Applied Engineering interview (r/FAANGJobs)Reddit, 2026 (opens in a new tab)
- Companies embrace in-person interviews to dodge the chatbotsAxios, 2025 (opens in a new tab)
- Anthropic forward deployed engineer interview guide (prep site)The Forward Deployed, 2026 (opens in a new tab)
- Guidelines for virtual interviews at Google (candidate guide)Google (opens in a new tab)
- Hiring process FAQMeta Careers (opens in a new tab)
- Remote interviewAmazon Jobs (opens in a new tab)
- How we hire (Candidate Code of Conduct)Microsoft Careers (opens in a new tab)
Walk the interviewer through the pipeline
Your first 30 minutes are free. After that it’s $5 an hour, pay as you go, with no subscription.
Start free — 30 minutes, no card