GDS Herbsttagung 2026 — German Data Science Society · Berlin
Trust, but Trace
A field report on running AI agents inside a regulated bank, where every action an agent takes has to be reconstructable afterwards.
- Date
- 19 November 2026
- Location
- Berlin, Germany
- Participation
- Confirmed
About the conference
GDS Herbsttagung 2026 is a single-track German Data Science Society conference for around 60 attendees. My session is a 20-minute talk plus questions.
Agents in production — governance, safety, observability
Two halves. The trust half: deterministic guards on every command an agent tries to run, no standing permissions, and the same allowlist enforced at build time — a prompt that teaches a forbidden command fails the build. The trace half: sixteen Grafana dashboards, none of them planned, each one built after somebody asked a question nobody could answer. Plus three occasions when the telemetry lied — a percentile that pinned to its top histogram bucket and looked healthy for weeks, cost counters that reset on every machine restart, and a run that exited with status zero and posted a half-finished answer. Ends with what the system still cannot tell me. No product demo, no vendor. Prometheus, Loki, and a set of label choices that mattered more than the model choice did.