[
  {
    "startMs": 12760,
    "text": "Uh, my name is Anirudh, and I'm lead security engineer at Fieldguide, where we're defining what agentic audit means. So, in audit, the opinion is the product. An opinion is only as good as the basis behind it. So it's not so much whether you're correct or wrong, it's really about the decision-making process behind what you're putting forward. And so this raises the question: What does an agentic decision-making process look like? So to kind of dive into this, let's build a"
  },
  {
    "startMs": 42440,
    "text": "financial agent. So we'll take a financial audit use case, and we'll take this specific audit procedure, where we're testing a bank rec-re-reconciliation. Uh, to any auditors in the room, please bear with me on the simplification. But bank reconciliation is where you take the client's book and the cash balance that they have on the, those books, and you compare it to the cash balance that their bank has. And any differences should be explained by things like deposits in transit, outstanding checks. Bas-basically, you wanna make sure that whatever the client"
  },
  {
    "startMs": 72400,
    "text": "is saying is their financial reality actually matches the truth. So how would you kind of build this out if you wanted to build an agent for this? Because this can be kinda tedious, high-volume work. So what you would do is you would take your client's book, you would take the list of reconciling items, you would take evidence, you would give it to your agent, which has some audit methodology for doing the, the matching. You can even have some prior year audits as examples. You can even build an eval of previously reviewed audits, and then you kind of surface everything to a human reviewer to finally sign off."
  },
  {
    "startMs": 102740,
    "text": "This is totally reasonable, great, great approach. So, you know, we build this out, we have great evals, great metrics, users are happy, everyone wins. We ship this to GA, and the story ends there. Until your audit is selected for inspection, and someone asks you, \"Why was this sufficient?\" That is, I don't care what your evals say, I don't care what your metrics say, I don't even care what your users say. For this specific audit, for this specific test procedure, for this specific"
  },
  {
    "startMs": 132700,
    "text": "piece of evidence, how did you arrive at this decision? And you may be wondering, this seems like a little overkill. You know, this is maybe not gonna happen that much in practice. But the thing is, financial fraud is very much real. Peregrine Financial Group is, or I guess  I should say was, a brokerage firm that was, uh, based in Iowa, and for over twenty years they committed bank account fraud. On paper, they claimed they had over two hundred million dollars, and in reality, at the bank, there was only five million dollars. And when this"
  },
  {
    "startMs": 162640,
    "text": "fraud came to light, two hundred million dollars basically just vanished. And I'm not here to litigate who or what or why this happened, but what this shows us is that in the financial industry, the consequences of being wrong are quite severe. So we need to have confidence behind the decisions that we make, and we need to be able to stand behind them in case things do go awry in the future. So in terms of how to do this, I think the audit industry has, like, a nice definition we can take some inspiration from. Uh, they say that an"
  },
  {
    "startMs": 192420,
    "text": "experienced auditor who hasn't done the work before should be able to understand the tests you performed, the evidence you collected, the decision that was reached. In other words, an experienced auditor new to the work can follow it. And we can adopt this to the agent world, where we say an experienced auditor new to the work can follow the agent. And in order to follow the agent, you need these different controls in place around authorization, execution control, evidence provenance, and evaluation integrity. And"
  },
  {
    "startMs": 221960,
    "text": "ultimately, all of this rests upon knowing when the agent should stop and the human should decide instead. So this is a pattern for decision assurance, and I'll kind of walk through this financial audit example again, but it really applies to many more domains than just this one. So let's kinda go back to our audit. You know, we're going back to bank reconciliation. We have this fictional client called Air Freight Lines, and we're closing the books for twenty twenty-six. So as per their bank, they have around two point nine million dollars. On their books,"
  },
  {
    "startMs": 251920,
    "text": "they have two point seven million dollars, and the difference is explained by forty-one reconciling items. So we'll take these forward, two checks, two deposits, and let's kind of see what our agent does, and let's walk through these different controls to ensure we're making defensible decision-making. So the first one is around authorization. So you can imagine that a human reviewer is kind of going through these reconciling items. They flag one of these checks, says, \"Hey, I think there may be something wrong here.\" And a few days later, we get some additional context, we get some more additional information"
  },
  {
    "startMs": 281940,
    "text": "around why that is not an exception, which triggers the agent run, and then it rewrites that to no exception. Now, the thing h-here is that the human already-- a human already reviewed it, and they already signed it, but what they reviewed, the content behind it has now changed. The agent didn't do anything wrong. It had the permission, it had the evidence, and it arrived at the right conclusion. But in this specific instance, it shouldn't have overridden anything because now what the reviewer has claimed to review doesn't match what they actually looked"
  },
  {
    "startMs": 312000,
    "text": "at. So what we're seeing here is that authorization isn't just about, is this tool call allowed? It's, is this tool call allowed for this object, given this state at this point in time? The agent should be allowed to draft unreviewed rows as itself, but it cannot overwrite what a human reviewed. It cannot replace what a human did. It has to kinda exist as its own suggestion as opposed to its own authoritative truth. The next control is around execution control. Uh, so you can imagine, you know, in twenty"
  },
  {
    "startMs": 341600,
    "text": "twenty-seven, we kind of go through this exercise, we have no exception, and then maybe a year or two later, we're selected for review. We rerun it, and we get a completely different result. So now the question arises, like, what happened? How did this-- How could this have happened? So we have logs. We know that the agent fetched evidence, it did some reasoning, it outputted, uh, its final answer. But that's not enough to reconstruct what happened in twenty twenty-seven against what happened in twenty twenty-eight and identify the gap. So really what we need is a record. We need a"
  },
  {
    "startMs": 371172,
    "text": "record of these were the steps that happened, this is the culmination of the run, and you can interrogate each point along the way. So this run is a chain of recorded steps where each step has a ID that kinda lets you understand what is being done here, what are the inputs, what are the outputs, and you can clearly dif- delineate between deterministic steps where you're using code to fetch an item or to do a match versus where you're using the agent to extract, you know, a field from a"
  },
  {
    "startMs": 400912,
    "text": "PDF or to arrive at the final conclusion. And given this chain of recorded steps, you can then rerun individual steps as opposed to the whole thing and seeing what happens. And this gives you much stronger assurance around being able to contr- uh, being able to compare runs against different points in time, because now we can kinda compare a new run against our old run, identify the exact step where something went wrong. And in this example, we're seeing that our original run was actually correct, even though the"
  },
  {
    "startMs": 430752,
    "text": "run of this newer run is wrong. But again, it's not so much about whether you're correct or not, it's about being able to demonstrate with a high level of conviction that you know you are right. You didn't just get lucky that the model picked the right answer. You can clearly show that you had these steps, and when you rerun this step, this is why there's now a difference compared to when we originally ran it, the model did arrive at the right answer. Then you-- next, we have evidence provenance. So in this example, the model arrived at the wrong conclusion. It said that this was"
  },
  {
    "startMs": 460612,
    "text": "valid, but it actually pointed to the wrong account. Um, and if you look at the citation, the model claims that it found this piece of evidence from January bank statement page two. And the thing is, th-this citation isn't useful because you can imagine if you have a big engagement, you could have many such documents with the same name. Even if this is a unique document name, what version did the model look at? Who uploaded this? Like, where did this even come from? And this isn't even related to hallucination. It can be a real document, but we need to understand more about the"
  },
  {
    "startMs": 490652,
    "text": "context behind that document. So what we arrive at is a citation is identity. It's not just a string. It's-- you have a very specific ID, a very specific version of the document, a hash of the contents behind it. And being able to concretely tie where an agent picks something from allows you to then assert rules around the evidence that's allowed or any kinda, um, quality constraints you want around it. For example, we may only want evidence that's sourced directly from the bank as opposed to something that the client"
  },
  {
    "startMs": 520352,
    "text": "uploaded where they may be able to tamper w-with it in some sort of way. And finally, we arrive at evaluation integrity. So we claim we have this eval, this gold data that was based on last year's reviewed audits. But just because the audit was reviewed doesn't necessarily mean it's correct. So it's important to audit that data set as well because mistakes in it could punish a right agent or it could reward a wrong agent. So there's some examples here of how in the reviewed audit you could"
  },
  {
    "startMs": 550312,
    "text": "have examples that were then superseded, you could have, uh, you could have decisions that were made based on out-of-band evidence, or you could even have changes in methodology and all of these are examples of how your underlying gold data may not be as gold as you thought it was. And what this can kinda look like in practice is that this kinda headline great overall score can hide a lot of underlying failures. So in this case we have ninety-seven percent, but out of nine of the misses, four was because the"
  },
  {
    "startMs": 580132,
    "text": "eval itself was just wrong. So our agent is actually doing better than expected. But there are twelve examples where our eval said this should be no exception, but because of some business rule changes or because of some audit methodology changes, these are now wrong. So these are examples where the agent actually missed and was incorrect. So what we see is we don't know if our agent is doing better than expected, it's doing worse than expected. The score is hiding a lot of important context behind how effective our agent actually is."
  },
  {
    "startMs": 609852,
    "text": "And, you know, ultimately there is a point where the agent has to stop and ask a human, and all of this ties back to kinda examples we've already covered through these past few controls. If it's trying to change work a human has already reviewed, if a new run is disagreeing with a previous run, if evidence is not conforming with these different rules, all of these are examples where something has gone awry and a human needs to step in to determine what's happening. And the key thing here is that these escalations, they should be easy to verify but not necessarily easy to"
  },
  {
    "startMs": 639852,
    "text": "approve. We know automation bias is real. If you can-- if you continually ping the human, they'll just start hitting yes to everything. So we only want to flag exceptional cases, and those exceptional cases should very clearly call out like what is wrong and where does someone need to step in. So the example here is we have this deposit. It was cleared in eleven business days, but it's calling out what is the discrepancy and what needs to be investigated. It may take some time for the human to do this review and to eventually arrive at an approval decision, but"
  },
  {
    "startMs": 669732,
    "text": "that's okay because we know eighty percent of the time the agent will do what it needs to do and for those twenty percent of cases when we want the human to step in, we wanna make sure they're stepping in where it counts and they have the context they need to arrive at the right decision. So if we kinda take a step back, we've covered these four controls and what we arrive at is defensibility is an and in the sense that you need all of them, otherwise things can only s-- can always slip through the cracks. If you skip authorization, then you could"
  },
  {
    "startMs": 699452,
    "text": "have, uh, a scenario where someone reviewed something but then the answer changes out underneath them. If you skip execution control, you can arrive at the right answer but you can't show how. You may as well attribute it to luck at that point. If you skip evidence provenance, you can have the wrong answer but you don't know where the wrong answer came from. It came from some citation that you can't tie back to a concrete source. And if you skip evaluation integrity, you can arrive at a great flagship number of ninety-seven percent, but you have no idea what the reality is. Are you"
  },
  {
    "startMs": 729392,
    "text": "doing better than that? Are you doing worse than that? All you know is you have this number to go off of. And this pattern for assurance, you know, I've kind of been talking about audit, but it really scales beyond audit into many other domains. In credit, if you're approving or declining a loan, you can interrogate that. You know, why did you make that decision? In AML, if you're clo-closing or escalating alert, again, what was the evidence behind that? So these same four questions can apply to different domains where you may change the nouns behind them, but the principles, uh,"
  },
  {
    "startMs": 759572,
    "text": "are still the same. So, you know, I think, uh, what this really comes down to is anytime you're making a financial decision where the impact could be quite, uh, tremendous, you need to have some defensibility behind how you're arriving at that decision. And if your a-- if your defense is the model said so, that's, uh, not really gonna cut it in today's day and world. So thank you all for your time. Uh, these are some of the things we're working"
  },
  {
    "startMs": 789512,
    "text": "on at Fieldguide, so if you're interested, we are hiring. And if you want to learn-- talk more about this, feel free to find me at the conference. But yeah, thank you all for your time and hope you enjoy the rest of today."
  }
]
