92An auditor asks why your assistant gave that answer three months ago. How do you version a knowledge base?▼hardBloombergDatabricksMicrosoft◆ premiumFreshness and reproducibility pull in opposite directions, and almost every team builds only for freshness. A pointer into a mutable index is not a record. Here is what an auditable knowledge base actually requires.Open full answer →
18How do you ensure end-to-end lineage and reproducibility for a production model (for debugging and audit)?▼mediumDatabricksMicrosoftGoogle1 replies○ sign inWhen a model regresses or an auditor asks 'how was this built,' guessing is a failing answer. What matters is tracking the entire chain so any model can be reproduced and any past decision explained. Here is the chain.Open full answer →
31A customer disputes a prediction your model made three months ago. How do you reproduce it exactly?▼hardStripeCapital OneGoogle2 replies◆ premiumRegulators and customers will ask 'Why was I denied?', and 'we retrained since then' will not satisfy them. Reproducing a prediction exactly requires versioning everything. This spells out what 'everything' really covers.Open full answer →
02How do you handle PII and data governance for an enterprise LLM deployment (SOC 2, GDPR, the EU AI Act)?▼hard★ EssentialMicrosoftGoogleDatabricks2 repliesunlockedA CISO-facing question that trips up engineers who focus only on model quality. What matters is treating governance as architecture rather than a checkbox: minimization, isolation, auditability, and never training on customer data by default. Here is the framework.Open full answer →
10What does an AI governance and compliance program look like (model cards, audit, EU AI Act risk tiers)?▼medium★ EssentialMicrosoftGoogleIBM1 repliesunlockedEnterprise AI deals turn on governance, and engineers who can speak it stand out. What lands is treating it as documentation, accountability, and risk-tiered controls across the lifecycle rather than a legal afterthought.Open full answer →