ai-engineering-interview-questions-company-wise
Your Cheat Sheet For AI Engineering Interviews at Top AI Companies - Questions and Answers.
Automatically checked · GitHub checked 2026-11-14

Overview
- Questions are compiled from publicly reported interview experiences. Nothing here is confidential. Interview loops change constantly and vary by team, level, and region, so treat each company section as a map of what that company cares about, not a script of what you will be asked. - Start with Common Questions Asked Across Companies. These are the questions that recur across many companies. Each one is listed once, with the companies that ask it, so nothing is repeated in the company sections. - Then go to your target companies. Each company section has the roles it covers, the interview loop as publicly reported, and the company-specific questions grouped by topic. - Wherever we have an answer, it is linked right below the question. We will keep adding answers. - Explain scaled dot-product attention and why the 1/sqrt(d_k) scaling factor matters. - Answer: Math behind √dₖ Scaling Factor in Attention and Math behind Attention - Q, K, and V - What is the KV cache, and what are its memory implications at scale? Derive the formula. - Asked at: OpenAI, xAI, Mistral AI, Amazon, Apple, NVIDIA, Together AI, Character.AI - Answer: What is KV Cache in LLMs? and KV Cache Compression - What are Multi-Query Attention (MQA) and Grouped-Query Attention (GQA), and what do they trade away? - Asked at: Meta, Mistral AI - Answer: Grouped Query Attention - What is Multi-head Latent Attention (MLA) and why did DeepSeek introduce it? - Asked at: DeepSeek, Moonshot AI - Answer: KV Cache Compression - Explain FlashAttention. It does not reduce FLOPs, so why is it faster? - Asked at: Together AI - Answer: Decoding Flash Attention in LLMs - How does Byte Pair Encoding work, and what are its failure modes (numbers, code, non-Latin scripts)? - Asked at: Alibaba, Sarvam AI, Hugging Face - Answer: Byte Pair Encoding and Tokenization in Large Language Models (LLMs) and Tokenization in LLMs - What is positional encoding in transformers, and how has it evolved (sinusoidal → learned → RoPE → ALiBi)? - Answer: Positional Embeddings in LLMs and Math Behind RoPE (Rotary Position Embedding)