Contents
  1. Delegating decisions
    1. Locate the dynamic decision
    2. Define the permitted task
  2. Feedback and knowledge
    1. Feed results into the next choice
    2. Separate observations from state
  3. Architectural development
    1. A short history of agent architectures
    2. Language models enter the loop
  4. Planning and action selection
    1. Maintain an executable plan
      1. Selective revision
    2. Choose a useful next action
  5. Autonomy and intervention
    1. Constrain accumulated effects
    2. Request the right human decision
  6. Completion, stopping and recovery
    1. Establish the achieved outcome
    2. Decide whether to continue
    3. Repair the strategy from known effects
  7. Evidence for architectural choices
    1. Explain the consequential divergence
    2. Measure the value of discretion
  8. Reference
    1. Frequently asked questions
      1. Does a chatbot become an agent when it calls a tool?
      2. Can a workflow contain an agent?
      3. Does an agent need a plan or new training after each result?
      4. When should an agent ask for help?
      5. Does a successful tool response mean the task is done?
      6. Does giving the agent more autonomy improve results?
      7. Do I need a framework or several agents?
  9. Check understanding
  10. Open questions
  11. Selected talks
  12. References
  13. Talk library
← All topics

Agent engineering

Agent engineering is the design of software that lets a model choose its next action using the task and the results of earlier actions. In Building effective agents, Erik Schluntz and Barry Zhang of Anthropic distinguish workflows, where code prescribes the paths between operations, from agents, where the model directs some of that work at run time. In Dex Horthy’s deployment workflow, a model proposes an order for human review.

Delegating decisions

Locate the dynamic decision

At the testing step, Horthy explains, “we go right back out into deterministic code.”

All three designs deploy two components and check them together. The first two are alternatives to Horthy’s mixed system.
DesignWho chooses the next step?Who authorizes deployment?What to inspect after failure
Fixed workflowCode specifies the order and any error branches.The application enforces the operator’s standing deployment policy.The rule that fired, its input and the result of the step.
Model-selected loopThe model reads the last result and requests the next operation.The same application policy can govern each request.The result the model received, the request it selected and the attempted effect.
Mixed systemModel proposes, reviewer revises, code tests.The reviewer.Approved order, actual order, test result.

Deployment order

Review changes which component deploys first.

Model proposes front end first
Reviewer requests and approves back end first
Deploy back end
Deploy front end
Code runs end-to-end check
The model proposes deploying the front end first. The reviewer changes the order to back end first and approves it. After both components deploy in that order, code runs the end-to-end check.
Read the diagram as text
  • Model proposes front end first.
  • Reviewer requests and approves back end first.
  • Deploy back end.
  • Deploy front end.
  • Code runs end-to-end check.
  • Model proposes front end first → Reviewer requests and approves back end first: proposal.
  • Reviewer requests and approves back end first → Deploy back end: approval.
  • Deploy back end → Deploy front end: then.
  • Deploy front end → Code runs end-to-end check: both deployed.

A workflow can branch, run steps concurrently or repeat a step until a condition holds. Even if a model extracts the fact used at a branch, code can still own the transition. Discretion enters when the model uses a finding to choose among approaches. Sam Bhagwat captures both directions of composition in Agents vs Workflows: Why Not Both?: “An agent can be a step. A workflow can be a tool.” A fixed incident process can delegate investigation, and the investigator can invoke a prescribed diagnostic procedure.

Different input values alone are a poor reason to delegate sequencing. If every record needs the same conversion and its validation errors have known remedies, ordinary code can express the procedure. If a model must interpret free text but the next steps are known, put that judgment inside a fixed workflow. A bounded agent becomes a candidate when an intermediate discovery can make a different investigation worthwhile. That flexibility adds calls, delay and paths to test. Workflow Automation treats the broader allocation of work across a process.

Define the permitted task

A task specification gives the agent something stable to pursue as its approach changes. Identify the target and starting conditions, the resources it may use, the changes it may make, and the limits on the attempt. State success as a postcondition, a property that must hold when the work succeeds. This gives a reviewer a way to check a different solution from the one originally imagined.

For a request to archive one project, the project record can show the final status. Checking which writes took place requires a record of the actions as well.
CommitmentPermitted workEvidence
Identify the intended active project.Read project metadata within the requester’s workspace.The ID matches the requester’s target, and its status is active.
Archive that project once.Change its archive status within the assigned allowance.The action record shows one archive change for that ID. A subsequent read confirms the archived status.
Leave other projects untouched.Limit writes to the chosen project.The record of writes for this attempt contains no other project IDs.

If two projects fit the description, a lookup can establish which was created earlier. It cannot establish that the requester meant the older one. Present the distinguishing details and ask which project they intend. Conversely, when the requester supplies an unambiguous ID, asking them to look up its status adds an interruption the application could avoid. Prompt instructions communicate the task. The service performing the write still has to enforce its scope.

Feedback and knowledge

Feed results into the next choice

An agent can use the result of one operation to choose the next. To identify the project to archive, for example, a model might request a search by name. That request is a tool call. It names a function and supplies its arguments. If the application runs the search, the matching project records give the model an observation about its environment, the system where the work takes place. The rule or model that uses those observations and the task to select an action is called the policy.

Observations inform the next decision. Application software validates and authorizes proposed calls before execution; those controls are omitted from this overview. Feedback changes the next input, not the model’s trained parameters.

The harness is the software around the model that manages this interaction. Its runtime carries out approved operations. Given a request, the application checks the argument values, the target and the authority to act. A rejection before dispatch gives the model a reason it can use on the next turn. On the other branch of the figure, the function actually runs. Its response, including a possible execution error, is associated with the original call. See the call interface, argument validation and what a harness controls.

Two routes back to the next decision

A rejection and an execution result both supply feedback, but only one follows dispatch.

Model selects an operation
Application checks requestValidate arguments and authority for the target.
Reject before dispatch
Execute tool
Model chooses againA later invocation receives feedback associated with this call.
If the application rejects a call before dispatch, it returns the reason to the model. After dispatch, it can pass along the tool’s result, including an execution error, if the response arrives. A lost acknowledgment can leave the effect of a write unknown.
Read the diagram as text
  • Model selects an operation.
  • Application checks request. Validate arguments and authority for the target.
  • Reject before dispatch.
  • Execute tool.
  • Model chooses again. A later invocation receives feedback associated with this call.
  • Model selects an operation → Application checks request: data: operation and arguments.
  • Application checks request → Reject before dispatch: control: a check fails.
  • Application checks request → Execute tool: control: valid and authorized.
  • Reject before dispatch → Model chooses again: data: rejection reason.
  • Execute tool → Model chooses again: tool result or error, if received.

Execution is closed-loop when feedback reaches a later decision. A search returning two plausible projects can lead to clarification. A search rejected for an invalid field can lead to a corrected query. The ordered observations, actions and results of one attempt form its trajectory. The same model can take those different paths with fixed weights, because the next invocation receives different evidence. Prompting and in-context learning explains how changing the input changes predictions.

Separate observations from state

An agent works under partial observability whenever relevant parts of the environment are hidden from it. Consider a service that returns a reference to a long-running operation. The client can use the reference to request status, as in Google’s AIP-151. Suppose the first read reports that the operation is running. The service can finish while that response is still the most recent one available to the model.

Between the two reads in the figure, the client can say when it last saw the operation running. It learns that the operation finished only when it receives the second response. If that lookup times out, the current status remains unknown. If the responsible service instead reports that it found no matching operation, the client has evidence that the operation was absent from the records covered by that lookup.

One operation, two status reads

Example

The server can finish while the client’s latest observation still says running.

1 / 3 · Read while running

The service reports that A is running. The client can justify that statement as of the first read.

New this stepOperation AThe reference identifies the same work across reads.
New this stepServer during first read: running
New this stepFirst response: runningA delivered record of the earlier server state.
Both reads concern operation A. Its first response records running. The server finishes before the client receives its second response. Only that later response gives the client evidence of completion.
Read the diagram as text
  • Operation A. The reference identifies the same work across reads.
  • Server during first read: running.
  • First response: running. A delivered record of the earlier server state.
  • Server after finishing: completed.
  • Second response: completed. A new observation available to the client.
  • Operation A → Server during first read: running: state at first read.
  • Server during first read: running → First response: running: reported to client.
  • Operation A → Server after finishing: completed: later server state.
  • Server after finishing: completed → Second response: completed: reported on next read.
  1. Read while running. The service reports that A is running. The client can justify that statement as of the first read. Active: Operation A, Server during first read: running, First response: running. New: Operation A, Server during first read: running, First response: running.
  2. Work finishes. A has completed on the server. The first response remains the client’s latest evidence. Active: Operation A, Server during first read: running, First response: running, Server after finishing: completed. New: Server after finishing: completed.
  3. Read after completion. The client receives the new status. The first response remains historical evidence about the same operation. Active: Operation A, Server during first read: running, First response: running, Server after finishing: completed, Second response: completed. New: Second response: completed.

Record what was observed, where and when. Keep an inference such as the job may have stalled separate from the observed status and the unresolved question of whether it finished. When observations conflict, compare targets, versions and times before discarding either one. Consider how each possible answer would change the next decision. Read again when the expected benefit justifies the lookup’s cost and delay. The external state, the evidence retained across turns and the subset visible in the current model input can all differ. See Agent Memory and Context Engineering.

Architectural development

A short history of agent architectures

Moving boxes gave early agent designers a concrete planning problem. Shakey, a project at SRI’s Artificial Intelligence Center from 1966 to 1972, combined finding routes with rearranging objects. A goal could specify where two boxes should end up while leaving open which one to move first. In their 1971 paper on STRIPS, the Stanford Research Institute Problem Solver, Richard Fikes and Nils Nilsson represented actions by their preconditions and predicted effects. To plan a push, the planner needed a world description in which the robot was in position to push. Applying the operator changed that description. Moving the physical box required a separate act.

The gap between a predicted effect and an observed one made monitoring part of the planning problem. Fikes’s April 1971 PLANEX report describes checking the conditions needed by the remaining plan. If a goal already held, the robot could skip work. If a prerequisite had been lost, a short repair could restore it. If no continuation fit the current world description, the monitor could request a new plan. Keeping a plan therefore saved work even in an environment where some steps would have to change.

Other architectures changed what had to be decided in advance. In Intelligence without representation in 1991, Rodney Brooks described building mobile robots in layers, each connecting sensing to action. A working behavior could respond to its surroundings without waiting for a central description of the whole scene. The engineering question shifted from finding a sequence of modeled actions to making complete behaviors operate together in the world.

Responsiveness has its own cost. An agent that reopens every decision at every observation can spend its time choosing instead of acting. Rao and Georgeff’s 1995 belief–desire–intention account separated information about the world (beliefs), possible objectives (desires) and adopted courses of action (intentions). Retaining an intention lets later choices build on a commitment. New events can still trigger reconsideration. Dependency planning, immediate reaction and selective reconsideration answer different needs within a single task.

Language models enter the loop

In 2022, Shunyu Yao and colleagues described ReAct, a pattern for interleaving reasoning and acting with a language model. A model could express a subgoal, request a search and read the returned evidence before deciding what to investigate next. That made it possible to revise a subgoal in language midway through a task. The environment supplied the evidence. An uninformative search could also lead the model to repeat itself, a failure the authors observed in their experiments.

Aditya Bhargava of Etsy made the difference visible with a median function. An early version of his agent read the code and suggested a correction, leaving the file untouched. With a test-running tool and a feedback loop, it read the files, ran the tests, observed a failure, edited the file and ran the tests again. The second test result concerned the edited implementation. It established that the supplied tests passed. The demonstration changed both the available tools and the instructions guiding their use. Bhargava’s walkthrough shows the interaction, while Coding Agents covers repository work in depth.

Planning and action selection

Maintain an executable plan

A plan arranges actions around intermediate goals and their dependencies. If a report needs data from two independent sources, either lookup can start first, but combining the findings requires both results. A stage planned in advance exposes that dependency and the opportunity to run the lookups together. Choosing one step at a time becomes attractive where the first result determines whether the second source is even relevant. Breaking the plan into finer steps clarifies individual choices while increasing the number the agent must get right.

FactSet separates deciding on an approach from choosing individual tool calls. Its adaptation of the LLMCompiler planning architecture first produces a blueprint in ordinary language describing what the available tools can do to answer a request. A domain specialist can review the approach at that level. The blueprint also narrows the set of tools shown to the planner, which turns the steps into executable tasks. An executor runs them, and a component called the joiner combines the results so the system can finish or plan further work. Yogendra Miraje’s walkthrough shows how FactSet represents these jobs as nodes in LangGraph.

Replace a method while retaining its prerequisites

Example

A service outage can block one route without invalidating the checked document or the output requirement.

1 / 3 · Plan conversion

The primary method has a checked input and an explicit output requirement.

New this stepChecked documentThe same validated input version is available throughout.
New this stepPrimary converterA proposed method.
New this stepReadable text requiredA postcondition to check after conversion.
The checked document is eligible input to the planned conversion. An outage blocks the primary converter. A later check establishes that an authorized alternative accepts the same input. Both routes face the same readability requirement. No output has been produced yet.
Read the diagram as text
  • Checked document. The same validated input version is available throughout.
  • Primary converter. A proposed method.
  • Primary service offline. A new observation blocks use of this method.
  • Alternative converter. An independently available method within the delegation.
  • Alternative accepts this format. The capability check establishes eligibility for this input.
  • Readable text required. A postcondition to check after conversion.
  • Checked document → Primary converter: planned input.
  • Primary converter → Readable text required: must satisfy if used.
  • Primary service offline → Primary converter: blocks execution.
  • Checked document → Alternative converter: same checked input.
  • Alternative accepts this format → Alternative converter: supports eligibility.
  • Alternative converter → Readable text required: must satisfy if used.
  1. Plan conversion. The primary method has a checked input and an explicit output requirement. Active: Checked document, Primary converter, Readable text required. New: Checked document, Primary converter, Readable text required.
  2. Observe the outage. The availability assumption fails. The document check still applies. Active: Checked document, Primary converter, Readable text required, Primary service offline. New: Primary service offline.
  3. Confirm a continuation. The alternative can be tried within scope. The result will need the same check. Active: Checked document, Primary converter, Readable text required, Primary service offline, Alternative converter, Alternative accepts this format. New: Alternative converter, Alternative accepts this format.

Selective revision

Revise the part of a plan that depends on a failed assumption. Suppose a validated document needs conversion to readable text. The primary converter goes offline. The document check still holds for that version, and the output requirement still applies. Establishing that a permitted alternative accepts the same input makes another route feasible. The figure stops there: the converted text still has to be produced and checked.

A related pattern in model predictive control is to plan several inputs ahead, apply the first and solve again from the new state estimate. Its guarantees depend on a predictive model, constraints and other mathematical assumptions. For a language agent the useful analogy is choosing a point to observe again. The work spent considering possible continuations before acting is deliberation, developed in Reasoning and Test-Time Compute.

Choose a useful next action

For each eligible operation, identify the unmet requirement it could advance. For an inspection, consider what you would do with each plausible result. Checking a converter’s availability has value if one answer allows conversion and another calls for a different method. Checking again immediately after a sufficiently fresh answer usually buys little. An extra call costs time even when it changes nothing. While a turn waits for a complete response, other events may go unobserved.

Match the action to what is missing. Search can supply an external fact. A focused question can distinguish two interpretations when only the requester knows which they intended. A pending job may warrant waiting until a useful status update is available. If the evidence already answers the question, return the answer. Generating another tool call is one possible response to a turn. Choosing whether to call a tool describes that interface decision.

When several operations repeatedly serve one purpose, a task-oriented tool can perform the predictable sequence and return the result and identifiers needed downstream. A skill offers a different kind of reuse: procedural instructions in a folder with optional scripts and references. In FactSet’s report-generation example, an explicit request for a PDF distinguishes its PDF procedure from the HTML one. Selecting a matching procedure settles how to proceed only if the required inputs, tools and permissions are available. The agent must still run it and inspect the output. Agent Skills covers packaging, loading and testing such procedures.

Autonomy and intervention

Constrain accumulated effects

Bounded autonomy gives an agent discretion within explicit task, authority and resource limits. Delegated authority identifies whose permission the application is exercising, for which operation and on which resource. Someone may authorize reading a project and drafting an archive request while reserving the archive itself for review. The distinction matters most when a change is consequential or hard to reverse. A staging environment and a production environment can accept identical arguments while requiring different authority.

Suppose a task permits creating one test environment for a specified project. Before creation, a request for one environment fits that allowance. After a confirmed creation, the identical proposal would exceed it. While a creation is in flight, hold its allowance until the effect is known. Otherwise two overlapping requests could each appear individually affordable. Apply the same whole-task perspective to calls, elapsed time and spending. A turn limit alone leaves the expense of each turn open. See preserving limits across restarts.

One creation request under a task-wide allowance

Example

The same well-formed request can receive different decisions depending on its target and the allowance already committed.

Create one test environmentA proposal naming a project.
Authorized project
Remaining creation allowanceAn in-flight creation holds its place within the limit of one.
Check project, then reserve slot atomically
Deny target
Withhold new creationResolve any pending operation before reconsidering.
Dispatch permitted creationThe resulting environment still needs verification.
The application rejects requests for other projects. For the authorized project, it checks availability and reserves the slot in one atomic operation. Even if two requests arrive together, only the request that secures the slot can proceed.
Read the diagram as text
  • Create one test environment. A proposal naming a project.
  • Authorized project.
  • Remaining creation allowance. An in-flight creation holds its place within the limit of one.
  • Check project, then reserve slot atomically.
  • Deny target.
  • Withhold new creation. Resolve any pending operation before reconsidering.
  • Dispatch permitted creation. The resulting environment still needs verification.
  • Create one test environment → Check project, then reserve slot atomically: data: target and quantity.
  • Authorized project → Check project, then reserve slot atomically: data: delegation.
  • Remaining creation allowance → Check project, then reserve slot atomically: data: available allowance.
  • Check project, then reserve slot atomically → Deny target: control: wrong project.
  • Check project, then reserve slot atomically → Withhold new creation: control: in scope, reservation failed.
  • Check project, then reserve slot atomically → Dispatch permitted creation: control: in scope, slot reserved.

Enforce these limits in the application at the protected operation. A page or tool response can contain text from someone outside the delegation. Indirect prompt injection occurs when the model treats such material as instructions and changes its behavior. For example, a page being inspected could direct the agent to export private data. Reading that direction confers no permission to comply. Scope checks must also apply during recovery, when the agent may try another tool. See untrusted content and placing controls on the action path.

Request the right human decision

In a mixed-initiative system, people and software share control. An interruption has a cost, and so does acting on a mistaken interpretation. Eric Horvitz’s 1999 account describes Microsoft’s LookOut extracting tentative appointment fields from email for a person to edit and save. When the exact time was unclear, showing a broader calendar view offered assistance without committing to a time. Narrowing the proposed action can be more useful than asking a person to approve a guess.

Ask for the contribution the task requires. The same person may supply all three at different points.
DecisionWhat the person needs to inspectWhat changes
Clarify intentThe plausible interpretations and the detail that separates them.The agent knows which outcome to pursue.
Approve an effectThe proposed operation, exact target and significant parameters.The reviewed operation may proceed if the remaining checks pass.
Accept a handoffThe outstanding work, evidence, pending effects and next action.An identified person accepts responsibility for continuing.

Horthy’s reviewer approved the revised order. In an application, bind approval to the significant details and recheck them immediately before execution. Changing the destination or payload can invalidate the approval. n8n’s review demonstration puts the pause directly in the tool’s execution path, so enforcing review does not depend on the model remembering to ask. See transaction authorization.

For a handoff, PagerDuty’s incident lifecycle illustrates the difference between notification, acknowledgment and resolution. A responder who acknowledges an incident owns work that is still open. For review, give the person access to evidence they can judge independently. In Duolingo’s fabricated-alert studies, exam reviewers accepted some false alerts even with guidance to inspect the video. A review record establishes who decided. Its quality depends in part on what they could see. Design Engineering and AI Interfaces covers that interaction.

Completion, stopping and recovery

Establish the achieved outcome

A verifier checks a stated property against evidence. Start from each required postcondition and identify where it can be observed. In WebArena, a posting task checks the destination subreddit as well as the posted content. Looking at the requested text in the assistant’s reply checks neither delivery nor destination. Reading the post in the wrong community confirms a real write and reveals that the task failed.

For a service that generates a report asynchronously, interpret each observation at the boundary where it was made.
ObservationSupported claimStill outstanding
Proposed report requestThe model selected a target and parameters.Authority, dispatch and result.
Service returns an operation referenceThe client can track the requested work.Whether it finishes successfully.
Job reports successThe service reports finishing the specified operation.Whether the right report is usable at the requested destination.
Read back the delivered artifactChecks on this version support claims about its target, contents and usability.Any requirements the checks omitted.

Keep the artifact identity, check, result and any open requirement together. A skipped check remains open. A passing check on an earlier version needs a reason to apply to the delivered version. Another model can help interpret a result, but agreement between two summaries supplies no missing observation. Claiming the deployment passed requires the test result. See matching graders to requirements and enforcing completion checks.

Decide whether to continue

A termination condition ends the current attempt. Verified completion is one reason to finish. An exhausted allowance or a cancellation can also end an attempt with work outstanding. A pause is different again: the attempt may be waiting for an identified event that will let it resume. Deciding among these outcomes requires tracking the task, the attempt and any external operation separately.

Consider one unmet requirement: a requested environment has yet to be verified as ready. If creation is pending and time remains, wait for a status update. If status access is denied, seek an authorized reader. If repeated inspections return the same inconclusive evidence, look for a different source or defer the check. If the last permitted lookup confirms the correct environment is ready, report its identity and that evidence. If it reports pending at the deadline, end incomplete and hand off the original operation reference. Starting a replacement would risk a second creation.

Magentic-One gives progress and resource limits different jobs. Its task ledger separates facts, guesses and planned work. A progress ledger asks whether the request is satisfied, whether work is looping and whether it is advancing. Repeated stalls can send the system back to planning. Those judgments come from the model. Separate time and attempt limits can end the run even if the model would continue. Likewise, LangGraph can return a partial result before its graph-step limit is exhausted. A normal exit is compatible with an unfinished task.

When ending an attempt, report what was achieved and the evidence for it, what remains open, which operations may still take effect, why the attempt stopped, and who owns the next action or still needs to accept it. Cancellation stops further choices only to the extent the system enforces it. A remote operation may continue after the caller stops waiting. Runtime shutdown addresses how to stop owned work.

Repair the strategy from known effects

Recovery starts with what the last attempt could have changed. If validation rejected malformed arguments before dispatch, use the error to correct the request. If the application denied authority, respect that decision across other tools that reach the same resource. If a write was dispatched and its response never arrived, the receiver may already have performed it. Identical client-side errors can conceal different external states.

Reconciliation means checking what happened against the system responsible for the effect. Keep the original operation identity. If the intended effect is confirmed, preserve it and check what remains. If the receiver establishes that the operation ended without an effect, consider a corrected attempt subject to current permission and budget. An empty search while the operation could still be in flight establishes neither case. Keep that uncertainty visible. Stripe’s error guide explains why even a server error can leave payment effects indeterminate.

Choose recovery from evidence of the effect

After a timeout, a fresh write could duplicate the original effect.

Inspect attempt evidence
Respect denialSeek the authorized decision if the task still requires the protected effect.
Check original operationUse its identity and authoritative receiver state.
Retain confirmed progressVerify remaining task requirements.
Assess a corrected requestCheck the reason for failure, current authority, prerequisites and allowance.
Start a fresh bounded attempt
Retry the original requestKeep the key and parameters unchanged. Check what the response establishes about the effect.
Defer or hand offRecord the evidence, outstanding work and original operation reference if pending.
Look up the original operation. If its effect remains unknown, an authorized retry can reuse the same key and parameters while the receiver still guarantees deduplication. A replayed acceptance receipt can still leave delivery unconfirmed.
Read the diagram as text
  • Inspect attempt evidence.
  • Respect denial. Seek the authorized decision if the task still requires the protected effect.
  • Check original operation. Use its identity and authoritative receiver state.
  • Retain confirmed progress. Verify remaining task requirements.
  • Assess a corrected request. Check the reason for failure, current authority, prerequisites and allowance.
  • Start a fresh bounded attempt.
  • Retry the original request. Keep the key and parameters unchanged. Check what the response establishes about the effect.
  • Defer or hand off. Record the evidence, outstanding work and original operation reference if pending.
  • Inspect attempt evidence → Respect denial: authorization denied before dispatch.
  • Inspect attempt evidence → Assess a corrected request: invalid arguments, never dispatched.
  • Inspect attempt evidence → Retain confirmed progress: intended effect confirmed.
  • Inspect attempt evidence → Check original operation: dispatched, effect uncertain.
  • Check original operation → Retain confirmed progress: intended effect confirmed.
  • Check original operation → Assess a corrected request: terminal with no effect.
  • Check original operation → Retry the original request: effect unknown, key still honored, retry within authority and budget.
  • Check original operation → Defer or hand off: pending at deadline or no safe continuation.
  • Assess a corrected request → Start a fresh bounded attempt: feasible, permitted and affordable.
  • Assess a corrected request → Defer or hand off: no permitted continuation.

Idempotency can make a retry safe when the receiver recognizes repeated submissions as one logical request. Reuse the original key and parameters under the receiver’s contract. Two intentionally distinct purchases can have identical parameters, so argument equality alone cannot identify a retry. A deduplicated response might recover only the original acceptance receipt. Readiness or delivery may still need a separate check. See recovery under uncertain effects and runtime handling of retries.

If an unwanted effect has already occurred, compensation is a new authorized action intended to counter it. Canceling a reservation may incur a fee and can itself fail. Restoring an old record wholesale could erase someone else’s later edit. Choose a remedy that accounts for intervening work, verify its result and escalate if no authorized remedy is available. Microsoft’s compensating transaction pattern describes this form of recovery.

Evidence for architectural choices

Explain the consequential divergence

A trace links recorded operations within an attempt. To diagnose a failed requirement, find the earliest choice or execution boundary that affected it. Two agents can inspect independent sources in opposite orders and both deliver a valid answer. The useful difference is one that changes the available evidence, violates a constraint or prevents delivery. Correlate the observation before the choice, the proposed call, the dispatch decision, the result and the final outcome. Observability covers how to link these records.

Laurie Voss found repeated file-write failures in recorded runs of a financial research agent. The Apple run shows why delivery and content need separate checks.
StageWhat happened in the Apple run
RequestVoss asked the agent to write a report. He wanted it in the notebook output, but the instruction left the destination open.
ResearchThe agent gathered information about Apple before it attempted delivery.
File writeThe agent tried to save a Markdown file. The notebook lacked write permission, so the write failed.
Report contentsThe agent still presented a concise report. It omitted the recommendation Voss wanted about whether to buy the stock.

The failed write suggests a testable change: explicitly request the report in the notebook output. Repeat the case with the same model, tools and permissions, then check both destination and report contents. Include a case that genuinely requires a file in a writable environment. That tests whether the repair clarified the choice or merely discouraged every file write. If the product always has one delivery destination, ordinary code can own publication and leave research dynamic. Testing failure explanations develops this comparison.

Check what the model actually received, whether the tool could express the needed operation, whether its executor worked, and whether the grader examined the right outcome. Each points to a different repair. A generated rationale can suggest a hypothesis. In Anthropic’s hint experiments, hints sometimes shifted answers without appearing in the model’s explanation. Likewise, varying resource allocation with the model and tasks held fixed changed outcomes in coding-agent evaluations. Preserve the identifiers, versions and diagnostic fields needed to distinguish such explanations, with access and retention limits for sensitive records.

Measure the value of discretion

Compare a particular delegation on the workload it is meant to serve. For instance, let one design follow programmed diagnostic branches and another select inspections from its findings. Give each the same tasks, initial state, operations, authority, assistance and resource ceilings. Include ordinary code or a fixed workflow with a model step wherever it offers a credible baseline. Reset state between trials so later runs cannot inherit earlier work. See defining the case and outcome boundary.

Score the achieved state and the process requirements separately. τ-bench checks final database state and, where required, information supplied to the user. A correct database update can pass even if the agent skipped a required confirmation. Add an explicit check for that ordering while allowing unrelated searches to vary. Repeat trials to distinguish occasional capability from consistent behavior. For a task, pass@k asks whether at least one of k independent trials succeeds. Pass^k asks whether all k succeed. Report the number of trials, the cases sampled and the assistance each attempt received. Attempts and selection policies explains how to interpret repeated results.

Exercise recovery at the point where failure matters. A fault inserted before a write tests whether the agent can correct or retry an operation that had no effect. Dropping the acknowledgment after a successful write tests whether it avoids duplicating the effect. ReliabilityBench pairs injected tool faults with checks on synthetic application state. For a changed policy, generate observations from the state its actions produce. Replaying a receipt from the old run after the new policy skipped the write gives the agent evidence of an event that never happened. See replay limits and RL Environments and Simulators.

A simple feedback procedure can be a demanding baseline. In AI Agents That Matter, researchers evaluated 164 short HumanEval function-generation tasks, running each system five times. One procedure generated another solution after failed tests and increased sampling temperature to encourage variation. Its accuracy did not differ significantly from that of the best-performing complex architecture, and it cost less than several tested agents. That comparison concerns short functions with supplied tests. Open-ended investigations and human supervision present different costs.

For each design, report acceptable completions, prohibited effects, premature success claims and unresolved tasks. Record which interventions were needed, how much reviewer time they took, total elapsed time and expense per attempt. A handoff can be the correct response to missing authority and still impose work on a person. These measures support a specific decision: retain dynamic investigation if it resolves cases the fixed procedure misses, and reserve a consequential write for software or a reviewer if delegating it brings little benefit.

Reference

Frequently asked questions

Does a chatbot become an agent when it calls a tool?

Look at who selects subsequent work. A chatbot can collect arguments for a predetermined lookup and format its result inside a fixed workflow. If it can inspect that result and choose which investigation to pursue, the application has delegated an agent decision.

Can a workflow contain an agent?

Yes. A workflow can assign a bounded investigation to an agent and resume its prescribed steps when the agent returns a finding. Composition also works in reverse. An agent can select a diagnostic workflow as a tool while code determines each step inside that procedure.

Does an agent need a plan or new training after each result?

An agent can choose just its next action from the goal and the latest evidence. An explicit plan helps when actions have dependencies worth inspecting in advance. Feedback changes the input to the next model invocation, so the model’s trained parameters can stay fixed throughout the task.

When should an agent ask for help?

Ask for clarification if only the requester can resolve a choice that changes the acceptable outcome. Request approval when a specific effect requires their authority. Seek a handoff when progress requires another owner’s access or judgment. Give that person the proposed action or outstanding work and enough evidence to decide.

Does a successful tool response mean the task is done?

Interpret success according to the tool’s contract. A job service may have accepted work, or a publishing tool may have written text to the wrong destination. Check the identified artifact or state against the requester’s requirements before claiming delivery.

Does giving the agent more autonomy improve results?

More autonomy is valuable when observations reveal useful actions that the prescribed path would miss. It also introduces variable costs, additional failure paths and possible review work. Compare the smallest delegation that solves the problem with a simpler procedure under the same task conditions.

Do I need a framework or several agents?

One model and an application loop can select an action, execute a permitted request, return the result and stop. A framework can supply machinery for that loop. Add collaborators when the work warrants coordination. Multi-Agent Systems covers division of work, and Model Context Protocol covers interoperability between applications and tools.

Open questions

  1. How much discretion pays for itself once human effort is counted? More adaptive paths can solve unfamiliar cases while creating extra review and correction. Matched trials that vary a single delegated decision and record both acceptable outcomes and reviewer time would make that tradeoff visible.

  2. How can an agent distinguish a stalled strategy from productive waiting? Both can produce the same status on successive reads. A better progress test would detect futile loops without discarding valid pending operations or repeatedly interrupting their owners.

  3. Which human interventions improve the decision enough to justify the interruption? Reviewers may accept incorrect automated suggestions, yet withholding review can allow consequential mistakes. Comparing review designs on the same proposed effects, with independent outcome checks and measured reviewer effort, would help identify where review adds value.

Follow the curated reading path through the speakers and demonstrations behind this entry.

Explore more talks

The rest of the library, beyond the curated path. Cited talks support this entry; reviewed transcripts were processed in full. Metadata candidates have not been reviewed as sources or verified as topic members.

1050 matching talks

TalkSpeakerEventYear
Chip HuyenAI Engineer Summit 20252025
Adam TerlsonAI Engineer Summit 20252025
Chau TranAI Engineer World's Fair 20252025
Jesse HuAI Engineer Code 20252025
Angus J. McLeanAI Engineer Europe 20262026
Roy DerksAI Engineer Summit 20252025
Leo PekelisAI Engineer World's Fair 20242024
Jim BennettAI Engineer World's Fair 20252025
Aditya BhargavaAI Engineer World's Fair 20262026
Ornella Bahidika, Joel AllouAI Engineer World's Fair 20262026
Harnesses in AI: A Deep Dive

Transcript reviewed

Tejas KumarAI Engineer Europe 20262026
Leonie MonigattiAI Engineer Europe 20262026
Sally-Ann DeLuciaAI Engineer Europe 20262026
Gaurav MishraAI Engineer World's Fair 20262026
Zhou YuAI Engineer Summit 20252025
Hanna Lichtenberg, Aamir ShakirAI Engineer World's Fair 20262026
Anna Marie BenzonAI Engineer World's Fair 20262026
Vinoth GovindarajanAI Engineer World's Fair 20262026
Samuel ColvinAI Engineer Code 20252025
Eric AllamAI Engineer World's Fair 20252025
Security Firewall for Agents

Transcript reviewed

Ryan DahlAI Engineer World's Fair 20262026
Fouad MatinAI Engineer World's Fair 20252025
Angel Ortmann LeeAI Engineer World's Fair 20262026
Talha SheikhAI Engineer Europe 20262026
Nick Ung, Akshay SharmaAI Engineer World's Fair 20262026
Mahmoud MabroukAI Engineer Europe 20262026
Fuzzing in the GenAI Era

Transcript reviewed

Leonard TangAI Engineer World's Fair 20252025
Darius EmraniAI Engineer World's Fair 20252025
Nishant GuptaAI Engineer World's Fair 20262026
Cornelia DavisAI Engineer Code 20252025
Sumaiya ShrabonyAI Engineer World's Fair 20262026
Sarmad QadriAI Engineer World's Fair 20252025
Yohei NakajimaAI Engineer World's Fair 20262026
Agents need more than a chat

Transcript reviewed

Jacob LauritzenAI Engineer Europe 20262026
Ronak MaldeAI Engineer World's Fair 20262026
Michael AlbadaAI Engineer World's Fair 20252025
Divakar KumarAI Engineer World's Fair 20262026
Nishant GuptaAI Engineer World's Fair 20262026
Maxime Rivest, Isaac MillerAI Engineer World's Fair 20262026
Alex GavrilescuAI Engineer Code 20252025
fighting slop with slop

Transcript reviewed

Vaibhav GuptaAI Engineer World's Fair 20262026
How to Kill the Code Review

Transcript reviewed

Ankit JainAI Engineer World's Fair 20262026
Ilan BigioAI Engineer Summit 20252025
Misha Kaletsky, Jonas TemplesteinAI Engineer Europe 20262026
Thor Schaeff, Philipp SchmidAI Engineer Europe 20262026
Joel Allou, Ornella BahidikaAI Engineer World's Fair 20262026
Cornelia DavisAI Engineer World's Fair 20262026
Eno ReyesAI Engineer World's Fair 20242024
Elizabeth Fuentes LeoneAI Engineer World's Fair 20262026
Erik MeijerAI Engineer World's Fair 20262026
Liam McGarrigleAI Engineer Europe 20262026
Dan MasonAI Engineer World's Fair 20252025
Ameya BhatawdekarAI Engineer World's Fair 20262026
Shreya Rajpal, Aman GuptaAI Engineer World's Fair 20262026
Lukas PeterssonAI Engineer World's Fair 20262026
Alex Shaw, Ryan MartenAI Engineer World's Fair 20262026
Kobie CrawfordAI Engineer Europe 20262026
Aparna Dhinkaran, Aparna DhinakaranAI Engineer Summit 20252025
Al HarrisAI Engineer Code 20252025
Kyle MisteleAI Engineer World's Fair 20262026
Gabe De MesaAI Engineer World's Fair 20262026
Aparna DhinakaranAI Engineer World's Fair 20252025
Jeff NgAI Engineer World's Fair 20262026
Yuval BelferAI Engineer World's Fair 20252025
Matija SosicAI Engineer Summit 20232023
Jon PeckAI Engineer World's Fair 20252025
Sarthak AggarwalAI Engineer World's Fair 20262026
Build Systems, Not Code

Transcript reviewed

Angie JonesAI Engineer World's Fair 20262026
Anju KambadurAI Engineer Summit 20252025
Scott WuAI Engineer World's Fair 20252025
DottaAI Engineer World's Fair 20262026
Respect The Process

Transcript reviewed

Andrew DumitAI Engineer World's Fair 20262026
Rustem FeyzkhanovAI Engineer World's Fair 20262026
Dat Ngo, Aman KhanAI Engineer World's Fair 20252025
Eduardo Simon, Javier CasalAI Engineer NYC 2026 Online Talks2026
Donald HruskaAI Engineer World's Fair 20252025
Mingsheng HongAI Engineer World's Fair 20262026
Arjun Chintapalli, Bhavani KalisettyAI Engineer Summit 20252025
Kenny WorkmanAI Engineer World's Fair 20262026
Barry Zhang, Mahesh MuragAI Engineer Code 20252025
Yogendra MirajeAI Engineer World's Fair 20262026
Matthew RagoneAI Engineer NYC 2026 Online Talks2026
Ford PriorEvent unknownUnknown
Tim TylerEvent unknownUnknown
Nnenna NdukweAI Engineer World's Fair 20262026
Salman MunafAI Engineer World's Fair 20262026
Dor SassonAI Engineer World's Fair 20262026
Roberto Milev, Uday KanagalaAI Engineer World's Fair 20262026
Jess WangEvent unknownUnknown
Laurie VossAI Engineer Europe 20262026
Benjamin ClaviéEvent unknownUnknown
Harrison ChaseAI Engineer World's Fair 20252025
Matthias LuebkenAI Engineer Europe 20262026
A Song of Types and Agents

Metadata candidate

Roberto StagiAI Engineer World's Fair 20262026
Ari HeljakkaAI Engineer Summit 20252025
Bala RamdossAI Engineer World's Fair 20262026
Will Hang, Cathy ZhouAI Engineer Code 20252025
Ido SalomonAI Engineer Europe 20262026
Ezra Tanzer, Dan ArpinoAI Engineer World's Fair 20262026
Brendan O'LearyAI Engineer Europe 20262026
Hubert MisztelaAI Engineer World's Fair 20252025
Nicholas Kang, Michael AaronAI Engineer Europe 20262026
Cedric VidalAI Engineer World's Fair 20252025
Stephen ChinAI Engineer World's Fair 20252025
Zach BlumenfeldAI Engineer World's Fair 20252025
Uday Kiran Medisetty, Adam HudaAI Engineer World's Fair 20262026
Steve YeggeAI Engineer World's Fair 20262026
Kevin HouAI Engineer Summit 20252025
Dan Fu, Olive SongAI Engineer World's Fair 20262026
Agents Building Agents

Metadata candidate

Alfonso GrazianoAI Engineer World's Fair 20262026
Mike SpitzAI Engineer Europe 20262026
Shawn "swyx" WangAI Engineer Europe 20262026
Agents Need Feature Flags

Metadata candidate

Sachin GuptaAI Engineer World's Fair 20262026
Armanas PovilionisAI Engineer World's Fair 20262026
Armanas PovilionisAI Engineer World's Fair 20262026
Steve RuizAI Engineer Europe 20262026
Nick Nisi, Lizzie SiegleAI Engineer World's Fair 20252025
Ian Butler, Nick GregoryAI Engineer World's Fair 20252025
Rajat ShahAI Engineer World's Fair 20262026
Anita KirkovskaAI Engineer Summit 20252025
Matt PocockAI Engineer Europe 20262026
Nick Nisi, Zack ProserAI Engineer World's Fair 20252025
Nagkumar Arkalgud, Keiji KanazawaAI Engineer World's Fair 20252025
Brendan RappazzoAI Engineer World's Fair 20262026
Justin SmithAI Engineer World's Fair 20262026
Gagan Bhat, Isabella Kai HeAI Engineer World's Fair 20262026
Frank CoyleAI Engineer World's Fair 20262026
Patrick LöberAI Engineer Europe 20262026
Richmond AlakeAI Engineer World's Fair 20252025
Lance MartinAI Engineer World's Fair 20242024
Robert BrennanAI Engineer Code 20252025
Sina ShahandehAI Engineer World's Fair 20262026
Denys LinkovAI Engineer World's Fair 20262026
Greg BensonAI Engineer World's Fair 20252025
Paul Klein IVAI Engineer World's Fair 20262026
Dr. Sajjan KanukolanuAI Engineer World's Fair 20262026
Raj NavakotiAI Engineer Europe 20262026
Louis-François Bouchard, Paul Iusztin, Samridhi VaidAI Engineer Europe 20262026
Will BrykAI Engineer World's Fair 20252025
Michael HablichAI Engineer Europe 20262026
Julián Duque, Anush DSouzaAI Engineer World's Fair 20252025
Antje BarthAI Engineer World's Fair 20252025
Rita KozlovAI Engineer World's Fair 20252025
Du’An Lightfoot, Banjo ObayomiAI Engineer World's Fair 20252025
Mahesh MuragAI Engineer Summit 20252025
Jerry LiuAI Engineer World's Fair 20252025
Bruno Passos, Beyang LiuAI Engineer Summit 20252025
Bennet FennerAI Engineer Europe 20262026
Ben KusAI Engineer World's Fair 20252025
Ekaterina DeynekaAI Engineer World's Fair 20262026
Lou BichardAI Engineer World's Fair 20252025
Soumya Gupta, Jai ChopraAI Engineer World's Fair 20262026
Cedric VidalAI Engineer World's Fair 20252025
Thor Schaeff, PaulAI Engineer World's Fair 20252025
Peter WielanderAI Engineer Code 20252025
Anoop Kotha, Toki SherbakovAI Engineer World's Fair 20252025
Shaan DesaiAI Engineer Summit 20252025
Matt PocockAI Engineer World's Fair 20262026
Ivan LeoAI Engineer Code 20252025
Apoorva JoshiAI Engineer World's Fair 20252025
Michael FesterAI Engineer World's Fair 20252025
Damien MurphyAI Engineer World's Fair 20242024
Building Self-Coding Agents

Metadata candidate

Colin FlahertyAI Engineer Summit 20252025
Tom MoorAI Engineer World's Fair 20252025
Dominik KundelAI Engineer World's Fair 20252025
Anant ShankhdharAI Engineer World's Fair 20262026
Hugo Santos, Madison FaulknerAI Engineer Europe 20262026
Michael GrinichAI Engineer World's Fair 20252025
Thariq ShihiparAI Engineer Code 20252025
Boris ChernyAI Engineer World's Fair 20252025
Codex and Subagents

Metadata candidate

Vaibhav Srivastav, Katia Gil GuzmanAI Engineer Europe 20262026
Jon Peck, Christopher HarrisonAI Engineer World's Fair 20252025
Francesco Bonacci, Dillon DuPont, Robert WendtAI Engineer World's Fair 20262026
Dhruv BatraAI Engineer World's Fair 20262026
Conquering Agent Chaos

Metadata candidate

Rick BlalockAI Engineer World's Fair 20252025
Containing Agent Chaos

Metadata candidate

Solomon HykesAI Engineer World's Fair 20252025
Andreas Kollegger, Zaid ZaimAI Engineer Europe 20262026
Soheil FeiziAI Engineer World's Fair 20262026
Liam HamptonAI Engineer Europe 20262026
Karina NguyenAI Engineer Summit 20252025
Anushrut GuptaAI Engineer World's Fair 20252025
Ben HylakAI Engineer World's Fair 20262026
Chintan Agrawal, Daniel WirjoAI Engineer World's Fair 20262026
Max Kanat-AlexanderAI Engineer Code 20252025
Ahmad AwaisAI Engineer Code 20252025
Ara KhanAI Engineer Europe 20262026
Laurie VossAI Engineer World's Fair 20252025
Barry ZhangAI Engineer Summit 20252025
Sylendran ArunagiriAI Engineer World's Fair 20252025
Kevin HouAI Engineer World's Fair 20242024
Satya NittaAI Engineer World's Fair 20242024
Rishabh BhargavaAI Engineer Europe 20262026
Ishita DagaAI Engineer World's Fair 20262026
Mason EggerAI Engineer World's Fair 20252025
Danny Gollapalli, Ben Hylak, Zubin KotichaAI Engineer Europe 20262026
Katelyn LesseAI Engineer Code 20252025
Nina Lopatina, Rajiv ShahAI Engineer World's Fair 20252025
Cormac BrickAI Engineer Europe 20262026
May WalterAI Engineer World's Fair 20262026
Sandipan BhaumikAI Engineer Europe 20262026
Joel HronAI Engineer World's Fair 20252025
Abhishek BhardwajAI Engineer World's Fair 20262026
Daniel Kim, Daria SobolevaAI Engineer World's Fair 20252025
Brooke HopkinsAI Engineer World's Fair 20252025
Jason LopateckiAI Engineer World's Fair 20262026
Paola Estefanía de CamposAI Engineer World's Fair 20262026
Future-Proof Coding Agents

Metadata candidate

Bill Chen, Brian FiocaAI Engineer Code 20252025
Luke HarriesAI Engineer Europe 20262026
Giving a Voice to AI Agents

Metadata candidate

Scott StephensonAI Engineer World's Fair 20242024
Mark MyshatynAI Engineer World's Fair 20252025
Anirban ChatterjeeAI Engineer World's Fair 20262026
Brian JohnAI Engineer Code 20252025
Nik PashAI Engineer Code 20252025
Ryan Lopopolo, Vibhu SapraAI Engineer Europe 20262026
Vasant KearneyAI Engineer World's Fair 20262026
Phil HetzelAI Engineer Europe 20262026
Evan BoyleAI Engineer World's Fair 20252025
Hailong ZhangAI Engineer Summit 20252025
Preetika Bhateja, Daniel BumpAI Engineer World's Fair 20262026
KP Sawhney, Ian BallantyneAI Engineer Europe 20262026
Niels RoggeAI Engineer World's Fair 20262026
Ash Prabaker, Andrew WilsonAI Engineer Europe 20262026
Patrick DoughertyAI Engineer Summit 20252025
Jared HansonAI Engineer World's Fair 20252025
Kyle CorbittAI Engineer World's Fair 20252025
Rene BrandelAI Engineer World's Fair 20252025
Mustafa Ali, Kyle CorbittAI Engineer Summit 20252025
HTML Is All Agents Need

Metadata candidate

James RussoAI Engineer World's Fair 20262026
Amol KapoorAI Engineer World's Fair 20262026
Radek SienkiewiczAI Engineer Europe 20262026
Kyle Jaejun LeeAI Engineer World's Fair 20262026
Identity for AI Agents

Metadata candidate

AI Engineer Code 20252025
Vivek TrivedyAI Engineer World's Fair 20262026
Tariq ShaukatAI Engineer World's Fair 20262026
Mahmoud AbdelwahabAI Engineer Code 20252025
Suman DebnathAI Engineer World's Fair 20252025
Justin McCartyAI Engineer World's Fair 20242024
Kim MaidaAI Engineer World's Fair 20262026
Tom SmokerAI Engineer World's Fair 20252025
Kam LasaterAI Engineer Summit 20252025
Michael RichmanAI Engineer Europe 20262026
Rukma SenAI Engineer World's Fair 20242024
Shafik Quoraishee, Joanne SongAI Engineer World's Fair 20262026
Eno ReyesAI Engineer Code 20252025
Ronan McGovernAI Engineer World's Fair 20252025
Stefania DrugaAI Engineer World's Fair 20262026
Mark Bain, Vasilije Markovic, Daniel Chalef, Alex GilmoreAI Engineer World's Fair 20252025
Kwindla Kramer, Shrestha Basu MallickAI Engineer World's Fair 20252025
Amy Boyd, Nitya NarasimhanAI Engineer Europe 20262026
Shirsha ChaudhuriAI Engineer Summit 20252025
Jess Grogan-Avignon, Jack WangAI Engineer Europe 20262026
Ola MabadejeAI Engineer World's Fair 20252025
Arjun SinghAI Engineer World's Fair 20262026
Maggie AppletonAI Engineer Europe 20262026
Frank CoyleAI Engineer World's Fair 20262026
Lech KalinowskiAI Engineer World's Fair 20262026
Antje BarthAI Engineer World's Fair 20262026
Benjamin SteinAI Engineer World's Fair 20242024
Christopher HarrisonAI Engineer World's Fair 20252025
Kwindla Hultman KramerAI Engineer World's Fair 20252025
Juan Herreros ElorzaAI Engineer Europe 20262026
Samuel ColvinAI Engineer Europe 20262026
Steven MoonAI Engineer Summit 20252025
Proactive Agents

Metadata candidate

Kath KorevecAI Engineer Code 20252025
Luke AlvoeiroAI Engineer Europe 20262026
Douwe KielaAI Engineer Summit 20252025
Hursh AgrawalAI Engineer World's Fair 20262026
Recursive Coding Agents

Metadata candidate

Raymond WeitekampAI Engineer World's Fair 20262026
Connor AdamsAI Engineer Europe 20262026
Patrick DeboisAI Engineer Summit 20252025
Daniel HanAI Engineer World's Fair 20252025
Onur SolmazAI Engineer Europe 20262026
Preeti SomalAI Engineer World's Fair 20252025
Sam MorrowAI Engineer Europe 20262026
Bobby Tiernay, Kam SweenAI Engineer World's Fair 20252025
Merve NoyanAI Engineer Europe 20262026
Kyle Penfound, Jeremy Adams - CasañasAI Engineer World's Fair 20252025
Mike ChambersAI Engineer World's Fair 20252025
Peter BarAI Engineer World's Fair 20252025
Pedro RodriguesAI Engineer Europe 20262026
Marc KlingenAI Engineer Europe 20262026
Robert BrennanAI Engineer World's Fair 20252025
Steven WillmottAI Engineer Europe 20262026
Charles PackerAI Engineer Summit 20252025
Josh PurtellAI Engineer World's Fair 20252025
Brandon WaselnukAI Engineer Europe 20262026
Cedric ClyburnAI Engineer World's Fair 20262026
Vikash Agrawal, LindaAI Engineer World's Fair 20252025
Rishi DesaiAI Engineer World's Fair 20262026
Ibragim BadertdinovAI Engineer Europe 20262026
Nuno CamposAI Engineer Europe 20262026
Sohail Shaikh, Ankush RastogiAI Engineer World's Fair 20262026
Apoorva Joshi, Ben PerlmutterAI Engineer World's Fair 20242024
The Age of the Agent

Metadata candidate

Flo CrivelloAI Engineer Summit 20232023
Christopher Harrison, John PeckAI Engineer World's Fair 20252025
Zack Reneau-WedeenAI Engineer Summit 20252025
The Agent-Native Company

Metadata candidate

Rick BlalockAI Engineer World's Fair 20252025
Tara AgyemangAI Engineer Europe 20262026
The Agentic AI Engineer

Metadata candidate

Benedikt Sanftl, Burak Cemil ÖzafşarAI Engineer World's Fair 20262026
Ramesh Raskar, Maria GorskikhAI Engineer World's Fair 20262026
Vincent ChenAI Engineer Europe 20262026
Jerry Wu, Wyatt MarshallAI Engineer World's Fair 20252025
Corey GallonAI Engineer World's Fair 20262026
Brook RiggioAI Engineer World's Fair 20252025
Beyang LiuAI Engineer World's Fair 20252025
Rushabh DoshiAI Engineer World's Fair 20262026
Justin SchroederAI Engineer World's Fair 20262026
Aparna DhinakaranAI Engineer World's Fair 20262026
Junyang LinAI Engineer World's Fair 20252025
The Log Is The Agent

Metadata candidate

Ishaan SehgalAI Engineer World's Fair 20262026
Hassan El MghariAI Engineer World's Fair 20262026
Lou BichardAI Engineer Europe 20262026
Kshitij GroverAI Engineer Summit 20252025
Sandipan BhaumikAI Engineer Europe 20262026
Omer PrimorAI Engineer World's Fair 20262026
Jan CurnAI Engineer World's Fair 20252025
Alberto RomeroAI Engineer Code 20252025
Emil EifremAI Engineer World's Fair 20262026
MuhtesemAI Engineer Summit 20252025
Manoj Nair, Ezra, RandallAI Engineer World's Fair 20262026
Cormac BrickAI Engineer Europe 20262026
Forrest Brazeal, Matt BallAI Engineer World's Fair 20252025
Training Agentic Reasoners

Metadata candidate

Will BrownAI Engineer World's Fair 20252025
Dr. Sarah BuchnerAI Engineer World's Fair 20242024
Mike ConoverAI Engineer Summit 20252025
Paul Iusztin, Louis-François BouchardAI Engineer World's Fair 20262026
Tushar JainAI Engineer World's Fair 20262026
João MouraAI Engineer World's Fair 20242024
Erik HanchettAI Engineer World's Fair 20262026
Victor DibiaAI Engineer World's Fair 20252025
Eddie SiegelAI Engineer Summit 20252025
Sidney PrimasAI Engineer World's Fair 20262026
Moritz JohnerAI Engineer World's Fair 20262026
Sai Krishna RallabandiAI Engineer World's Fair 20262026
Soumith ChintalaAI Engineer Summit 20252025
What RL Means for Agents

Metadata candidate

Will BrownAI Engineer Summit 20252025
What the Best Agents Share

Metadata candidate

Mardu SwanepoelAI Engineer Europe 20262026
Dmitry PetrovAI Engineer World's Fair 20262026
Why Agent Engineering

Metadata candidate

swyx (Shawn Wang)AI Engineer Summit 20252025
Nupur SharmaAI Engineer Europe 20262026
Philipp SchmidAI Engineer Europe 20262026
Ahmad AwaisAI Engineer World's Fair 20252025
Subbiah Sethuraman, Abhilash AsokanAI Engineer World's Fair 20262026
Diane LinAI Engineer World's Fair 20262026
Zach BlumenfeldAI Engineer Europe 20262026
Christopher Lovejoy, Saul HowardAI Engineer World's Fair 20262026
Ari HeljakkaAI Engineer World's Fair 20252025
Prukalpa SankarAI Engineer World's Fair 20262026
Dan FarrellyAI Engineer World's Fair 20262026
Tisha Chawla, Susheem KoulAI Engineer World's Fair 20262026
Rachel Lee Nabors (RL Nabors)AI Engineer Europe 20262026
Your agent is blindfolded

Metadata candidate

Johan LajiliAI Engineer Europe 20262026
Erik HanchettAI Engineer World's Fair 20262026
Rafael LeviAI Engineer Europe 20262026
Hamza TahirAI Engineer World's Fair 20262026
Rizel ScarlettAI Engineer Summit 20252025
Zack ProserAI Engineer Europe 20262026
Rustin BanksAI Engineer World's Fair 20252025
Ben BurtenshawAI Engineer Europe 20262026
Ramana Siddanth EmaniAI Engineer World's Fair 20262026
Alex HancockEvent unknownUnknown
Sumanyu SharmaEvent unknownUnknown
Philipp SchmidEvent unknownUnknown
Jo Kristian BergumAI Engineer World's Fair 20262026
Evan KormosEvent unknownUnknown
Adi SinghAI Engineer World's Fair 20262026
Lincoln MurrEvent unknownUnknown
Maximillian PirasEvent unknownUnknown
Erina KaratiAI Engineer World's Fair 20262026
Jay Sahnan, Arik BirdEvent unknownUnknown
Will BrykAI Engineer World's Fair 20262026
Felippe Felisola Caso, Francesco GallettaEvent unknownUnknown
Kamil PotrecEvent unknownUnknown
Dmitry BuykinAI Engineer World's Fair 20262026
Sait IzmitAI Engineer World's Fair 20262026
Dan Barrett, Raymond Weitekamp, Jose Montes de OcaEvent unknownUnknown
Howie Liu, Shawn "swyx" Wang, Joshua XuAI Engineer World's Fair 20262026
Jeremy AdamsEvent unknownUnknown
Giedrius ŠteimantasAI Engineer World's Fair 20262026
Arman VaziriAI Engineer World's Fair 20262026
Giselle van DongenEvent unknownUnknown
Ahnaf PrioAI Engineer World's Fair 20262026
Max DrakeEvent unknownUnknown
Xander SongEvent unknownUnknown
Vlad LuzinAI Engineer World's Fair 20262026
George HeEvent unknownUnknown
Michael Manapat, Jack McDonaldEvent unknownUnknown
Harshal BhangaleEvent unknownUnknown
Jan CurnEvent unknownUnknown
Laurie VossAI Engineer World's Fair 20262026
Matt GibiecAI Engineer World's Fair 20262026
Emile Baizel, Shruti AroraAI Engineer World's Fair 20262026
Sachin MalhotraAI Engineer World's Fair 20262026
Fuad AliAI Engineer World's Fair 20262026
Zubin AysolaAI Engineer World's Fair 20262026
Armen AghajanyanAI Engineer World's Fair 20262026
Michele GrantAI Engineer NYC 2026 Online Talks2026
Thomas Wolf, Olive SongEvent unknownUnknown
Patrick DeboisAI Engineer World's Fair 20262026
Fuad AliEvent unknownUnknown
Du’An Lightfoot, Khaja OmerAI Engineer World's Fair 20262026
Jose PalafoxAI Engineer World's Fair 20262026
Robert BrennanAI Engineer World's Fair 20262026
Ankur DuggalAI Engineer World's Fair 20262026
Killian Carlsen-PhelanAI Engineer World's Fair 20262026
Tisha Chawla, Susheem KoulAI Engineer World's Fair 20262026
Dan BălăceanuAI Engineer World's Fair 20262026
Yohan RajuAI Engineer World's Fair 20262026
Bohan LiEvent unknownUnknown
Jakub HojsanAI Engineer Code 2025Unknown
Priyanka Phatak, Gabe CemajAI Engineer World's Fair 20262026
Andrew QuEvent unknownUnknown
Jack WotherspoonEvent unknownUnknown
Wolfram RavenwolfAI Engineer World's Fair 20262026
Eyal BlumAI Engineer World's Fair 20262026
Brandon WaselnukEvent unknownUnknown
Fuad AliEvent unknownUnknown
Marc KlingenAI Engineer World's Fair 20262026
Ajay PrakashEvent unknownUnknown
Jan CurnAI Engineer Code 2025Unknown
Jake BroekhuizenAI Engineer World's Fair 20262026
Rémi LoufAI Engineer World's Fair 20262026
Charlie GuoEvent unknownUnknown
Laurie VossAI Engineer World's Fair 20262026
Mikyo KingEvent unknownUnknown
Will Bond, Ameya KetkarAI Engineer World's Fair 20262026
Varun KrovvidiEvent unknownUnknown
Priyanka Phatak, Gabe CemajAI Engineer World's Fair 20262026
Joshua MoAI Engineer World's Fair 20262026
Philipp SchmidAI Engineer World's Fair 20262026
Jean-Denis GrezeEvent unknownUnknown
Priyanka Phatak, Gabe CemajAI Engineer World's Fair 20262026
Justin JoyceAI Engineer World's Fair 20262026
Kamalakannan NandagopalEvent unknownUnknown
Sandhya SubramaniEvent unknownUnknown
Kevin OrellanaAI Engineer World's Fair 20262026
Nidhi Kaushik VyasEvent unknownUnknown
Jim ClarkAI Engineer World's Fair 20262026
Harish GaggarAI Engineer NYC 2026 Online Talks2026
Corey GallonAI Engineer NYC 2026 Online Talks2026
Anna SpyszEvent unknownUnknown
Shu FangEvent unknownUnknown
William LyonEvent unknownUnknown
Anil NadimintiEvent unknownUnknown
Ang LiAI Engineer World's Fair 20262026
Sandhya Subramani, Elizabeth Fuentes LeoneAI Engineer World's Fair 20262026
CJ Avilla, Harrison StallEvent unknownUnknown
Karthic RaoAI Engineer NYC 2026 Online Talks2026
Dan AdlerAI Engineer World's Fair 20262026
Jerry LiuAI Engineer World's Fair 20262026
Isabelle WilliamsEvent unknownUnknown
Nick Nisi, Zack ProserEvent unknownUnknown
Brendan RappazzoEvent unknownUnknown
Tariq Shaukat, Ali-Reza Adl-TabatabaiAI Engineer World's Fair 20262026
Ryan AhernEvent unknownUnknown
Liad YosefAI Engineer World's Fair 20262026
Jay Mok, Ben CoumesEvent unknownUnknown
Matt LawlerAI Engineer World's Fair 20262026
Viren BaraiyaAI Engineer World's Fair 20262026
Neil ZeghidourEvent unknownUnknown
Annabell Schäfer, Doneyli De JesusEvent unknownUnknown
Mark Lummus, Navinkumar PatilAI Engineer World's Fair 20262026
Kim MaidaAI Engineer NYC 2026 Online Talks2026
Andrey RybkaEvent unknownUnknown
Adit AbrahamAI Engineer World's Fair 20262026
James ZouAI Engineer World's Fair 20262026
Jesse HallEvent unknownUnknown
Ben KusAI Engineer World's Fair 20262026
Allie Howe, Ian Livingstone, Michael Davis, Dick HardtEvent unknownUnknown
Rodrigo Coelho, Pranav MaheshwariEvent unknownUnknown
Michael GrinichAI Engineer World's Fair 20262026
Shubhankar SrivastavaAI Engineer World's Fair 20262026
Midam KimEvent unknownUnknown
Thor SchaeffAI Engineer World's Fair 20262026
Charles DickensAI Engineer World's Fair 20262026
Mike ChambersEvent unknownUnknown
Dhruv NathawaniAI Engineer World's Fair 20262026
Sarah SandersEvent unknownUnknown
Anders SwansonAI Engineer World's Fair 20262026
Vlad LuzinEvent unknownUnknown
David LevineEvent unknownUnknown
Jediah KatzEvent unknownUnknown
John FeminellaEvent unknownUnknown
Lotte Verheyden, Annabell SchäferAI Engineer World's Fair 20262026
Kushan RajEvent unknownUnknown
Ido SalomonAI Engineer World's Fair 20262026
Fuad AliEvent unknownUnknown
Tim SweeneyAI Engineer World's Fair 20262026
Daksh GuptaEvent unknownUnknown
Thorsten HansEvent unknownUnknown
Gabe Cemaj, Priyanka PhatakAI Engineer World's Fair 20262026
Karan VaidyaEvent unknownUnknown
Derek MeeganAI Engineer Code 2025Unknown
Yoni Michael, Brandon CallenderAI Engineer World's Fair 20262026
Safia AbdallaAI Engineer World's Fair 20262026
Stephanie JarmakEvent unknownUnknown
Rafal WilinskiAI Engineer World's Fair 20262026
Aman SinghEvent unknownUnknown
Rowan ChristmasAI Engineer Code 2025Unknown
Nixon DinhAI Engineer World's Fair 20262026
Karthik Ranganathan, Heather DowningAI Engineer World's Fair 20262026
Sam ParsonsAI Engineer World's Fair 20262026
Nacho MartinezEvent unknownUnknown
Pedro LopezAI Engineer World's Fair 20262026
Sam ProdgerAI Engineer World's Fair 20262026
Elizabeth Fuentes LeoneAI Engineer World's Fair 20262026
Venky BEvent unknownUnknown
Cedric VidalAI Engineer World's Fair 20242024
Daniel HanAI Engineer World's Fair 20262026
Joel BeckerAI Engineer Code 20252025
Cormac BrickAI Engineer World's Fair 20262026
Jesús BarrasaAI Engineer World's Fair 20252025
Cody MenefeeAI Engineer World's Fair 20262026
Carlos SanchezAI Engineer World's Fair 20262026
Byung-Gon (Gon) ChunAI Engineer World's Fair 20262026
Ignacio MartinezAI Engineer World's Fair 20262026
Laurie VossEvent unknownUnknown
Laurie VossEvent unknownUnknown
Diego CarpinteroAI Engineer Europe 20262026
Vivek MuppallaAI Engineer World's Fair 20262026
John DickersonAI Engineer World's Fair 20252025
2026: The Year the IDE Died

Metadata candidate

Steve Yegge, Gene KimAI Engineer Code 20252025
A Genius With Amnesia

Metadata candidate

Victor SavkinAI Engineer World's Fair 20262026
Nathan LambertAI Engineer World's Fair 20252025
Damien MurphyAI Engineer World's Fair 20252025
Chintan Parikh, Weiyi WangAI Engineer Europe 20262026
AGI: The Path Forward

Metadata candidate

Eiso Kant, Jason WarnerAI Engineer Code 20252025
Christopher ChedeauAI Engineer World's Fair 20252025
Nathaniel Whittemore (NLW)AI Engineer Code 20252025
Boris Bogatin, Toufic BoubezAI Engineer Code 20252025
Olivier Leplus, Yohan LasorsaAI Engineer Europe 20262026
Philipp SchmidAI Engineer World's Fair 20252025
swyxAI Engineer World's Fair 20242024
Vibhor KumarAI Engineer World's Fair 20242024
Natalie SerrinoAI Engineer Code 20252025
Zach Blumenfeld, Ben Squire, Ryan KnightAI Engineer World's Fair 20262026
AI’s Jurassic Park Period

Metadata candidate

Aaron StanleyAI Engineer World's Fair 20262026
AI SDK v6

Metadata candidate

Nico AlbaneseAI Engineer Europe 20262026
Vasuman MozaAI Engineer World's Fair 20262026
Amazon AGI

Metadata candidate

Amazon AGI, Aditya KhandelwalAI Engineer World's Fair 20262026
Beyang LiuAI Engineer Code 20252025
Henry MaoAI Engineer World's Fair 20252025
Abhishek BhardwajAI Engineer World's Fair 20252025
Corey CooperAI Engineer World's Fair 20252025
Ivan BurazinAI Engineer World's Fair 20252025
Don Bosco DuraiAI Engineer Summit 20252025
Michal CichraAI Engineer Europe 20262026
Nimrod HauserAI Engineer Europe 20262026
Marlene MhangamiAI Engineer Europe 20262026
Filip KozeraAI Engineer World's Fair 20252025
Parth AsawaAI Engineer World's Fair 20262026
Grace IsfordAI Engineer Summit 20252025
Rajiv ChandegraAI Engineer World's Fair 20262026
Josh AlbrechtAI Engineer World's Fair 20252025
Hervé BredinAI Engineer Europe 20262026
Stephen BatifolAI Engineer Europe 20262026
Siddharth AhujaAI Engineer World's Fair 20252025
Samuel DentonAI Engineer World's Fair 20262026
SallyAnn DeLucia, Fuad AliAI Engineer Code 20252025
Paige Bailey, Guillaume Vernade, Ian BallantyneAI Engineer Europe 20262026
Eliza Cabrera, Jeremy SilvaAI Engineer World's Fair 20252025
Varun Badrinath Krishna, Petro Junior Milan, Rachelle MatternAI Engineer World's Fair 20242024
Max Brodeur-UrbasAI Engineer World's Fair 20252025
John CrepezziAI Engineer Summit 20252025
Angie JonesAI Engineer World's Fair 20262026
Harrison ChaseAI Engineer Summit 20232023
Building Cursor Composer

Metadata candidate

Lee RobinsonAI Engineer Code 20252025
David KaramAI Engineer World's Fair 20252025
Building Reactive AI Apps

Metadata candidate

Matt WelshAI Engineer Summit 20232023
Steve KaliskiAI Engineer Europe 20262026
Building security around ML

Metadata candidate

Dr. Andrew DavisAI Engineer World's Fair 20242024
Jamie Neuwirth, Zack WittenAI Engineer World's Fair 20242024
Eric ZakariassonAI Engineer Europe 20262026
Andrew ThompsonAI Engineer World's Fair 20252025
Abed MatiniAI Engineer World's Fair 20262026
Prasenjit SarkarAI Engineer Europe 20262026
Atul RamachandranAI Engineer World's Fair 20262026
Nathan SoboAI Engineer World's Fair 20252025
Cat Wu, Thariq Shihipar, Simon WillisonAI Engineer World's Fair 20262026
Lance MartinAI Engineer World's Fair 20262026
Derek BinghamAI Engineer World's Fair 20242024
Morgante PellAI Engineer World's Fair 20242024
Sunil PaiAI Engineer Europe 20262026
Jacob KahnAI Engineer Code 20252025
Codex, Behind the Harness

Metadata candidate

Dominik KundelAI Engineer World's Fair 20262026
Naman JainAI Engineer Code 20252025
Cohere for VPs of AI

Metadata candidate

Vivek MuppallaAI Engineer World's Fair 20242024
Pedro RodriguesAI Engineer Europe 20262026
Jedrick Kosinski, ComfyAnonymousAI Engineer World's Fair 20252025
Yusuf OlokobaAI Engineer Code 20252025
Priscila Andre de OliveiraAI Engineer Europe 20262026
Pierluca D'OroAI Engineer World's Fair 20262026
Stephen ChinAI Engineer Europe 20262026
Stephen ChinAI Engineer Code 20252025
Dex HorthyAI Engineer Code 20252025
Context Is the New Code

Metadata candidate

Patrick DeboisAI Engineer Europe 20262026
Val Bercovici, Callan FoxAI Engineer Code 20252025
Convex Launch

Metadata candidate

Jamie TurnerAI Engineer World's Fair 20242024
Dominik KundelAI Engineer World's Fair 20242024
Copilots Everywhere

Metadata candidate

Thomas Dohmke, Eugene YanAI Engineer World's Fair 20242024
Santosh RadhaAI Engineer World's Fair 20242024
Dmytro (Dima) DzhulgakovAI Engineer World's Fair 20242024
Vincent KocAI Engineer Europe 20262026
Mahesh SathiamoorthyAI Engineer World's Fair 20262026
#define AI Engineer

Metadata candidate

Greg Brockman, swyx, Jensen HuangAI Engineer World's Fair 20252025
Defying Gravity

Metadata candidate

Kevin HouAI Engineer Code 20252025
Shawn Wang (swyx)AI Engineer World's Fair 20252025
Develop at Idea Velocity

Metadata candidate

Jeffrey Lee-ChanAI Engineer World's Fair 20262026
Dan ShipperAI Engineer Code 20252025
Phil HetzelAI Engineer Europe 20262026
Don't be data poor

Metadata candidate

Anuj IravaneAI Engineer World's Fair 20262026
Tomas ReimersAI Engineer World's Fair 20252025
Arthur ObjartelAI Engineer Summit 20252025
Philipp SchmidAI Engineer World's Fair 20262026
Sheila Gulati, Nischal NadhamuniAI Engineer World's Fair 20242024
Joseph Wang, SidAI Engineer World's Fair 20262026
Ofer MendelevitchAI Engineer Code 20252025
Doug GuthrieAI Engineer World's Fair 20252025
Ara KhanAI Engineer Europe 20262026
Carlos Esteban, DougAI Engineer World's Fair 20252025
Julia Neagu, Deanna Emery, Maitar AsherAI Engineer World's Fair 20252025
Garry TanAI Engineer World's Fair 20262026
Sam BhagwatAI Engineer World's Fair 20262026
Theo BrowneAI Engineer World's Fair 20262026
Sarah ChiengAI Engineer Europe 20262026
Field Guide to Fable

Metadata candidate

Thariq ShihiparAI Engineer World's Fair 20262026
Ankur GoyalAI Engineer World's Fair 20252025
Craig WattrusAI Engineer World's Fair 20252025
Emma Ning, Tsavo KnottAI Engineer World's Fair 20252025
Samir ModyAI Engineer Code 20252025
Rafael LeviAI Engineer Europe 20262026
Mounir MouawadAI Engineer World's Fair 20252025
Antje Barth, Mike ChambersAI Engineer World's Fair 20242024
Romain HuetAI Engineer World's Fair 20242024
KitzeAI Engineer World's Fair 20252025
Chris NoringAI Engineer Europe 20262026
Frontier Feud

Metadata candidate

Barr Yaron, Mihir, John, Tina, Shresta, Paige, Colin, Petra, StevenAI Engineer Summit 20252025
Mark Backman, AleixAI Engineer World's Fair 20252025
Jason LiuAI Engineer World's Fair 20262026
Jerry LiuAI Engineer World's Fair 20242024
The Future of MCP

Metadata candidate

David Soria ParraAI Engineer Europe 20262026
Gateways are All You Need

Metadata candidate

Karan SampathAI Engineer Europe 20262026
Cassidy HardinAI Engineer Europe 20262026
Omar SansevieroAI Engineer Europe 20262026
Ruben CasasAI Engineer Europe 20262026
Keegan McCallumAI Engineer World's Fair 20262026
Dave BurnisonAI Engineer World's Fair 20242024
Sarah KhalifeAI Engineer World's Fair 20242024
John PhamAI Engineer World's Fair 20252025
Mike BursellAI Engineer World's Fair 20252025
Andreas KolleggerAI Engineer World's Fair 20252025
Iman MakaremiAI Engineer World's Fair 20252025
Kyle KranenAI Engineer World's Fair 20252025
Why Software Factories Fail

Metadata candidate

Dex HorthyAI Engineer World's Fair 20262026
Zhengyao JiangAI Engineer World's Fair 20262026
Brian ScanlanAI Engineer Europe 20262026
How Claude Code Works

Metadata candidate

Jared ZoneraichAI Engineer Code 20252025
How Deep Research Works

Metadata candidate

Mukund Sridhar, Aarush SelvanAI Engineer Summit 20252025
Sunny RekhiAI Engineer World's Fair 20262026
Eno ReyesAI Engineer World's Fair 20262026
Leo MehrAI Engineer World's Fair 20262026
Vinoo GaneshAI Engineer World's Fair 20262026
Alex BauerAI Engineer World's Fair 20262026
Benjamin VerbeekAI Engineer Europe 20262026
Dan FengAI Engineer World's Fair 20262026
Kwindla Hultman KramerAI Engineer World's Fair 20242024
Hamel Husain, Emil SedghAI Engineer World's Fair 20242024
David MyttonAI Engineer World's Fair 20252025
Beth GlenfieldAI Engineer World's Fair 20252025
Ian ButlerAI Engineer World's Fair 20252025
Christopher LovejoyAI Engineer Europe 20262026
Jeff Huber, Jason LiuAI Engineer World's Fair 20252025
Muktesh MishraAI Engineer World's Fair 20252025
Joe ReeveAI Engineer Europe 20262026
Samuel ColvinAI Engineer World's Fair 20252025
Mitesh PatelAI Engineer World's Fair 20252025
Nicolas SchlaepferAI Engineer World's Fair 20242024
Imagination Engineering

Metadata candidate

Eve BouffardAI Engineer World's Fair 20262026
Yu SuAI Engineer World's Fair 20262026
Alex LissAI Engineer World's Fair 20252025
Judging LLMs

Metadata candidate

Alex VolkovAI Engineer World's Fair 20242024
Robert ChandlerAI Engineer World's Fair 20252025
Lawrence JonesAI Engineer Europe 20262026
David KaramAI Engineer World's Fair 20252025
Raymond FengAI Engineer World's Fair 20262026
Juan PeredoAI Engineer Summit 20252025
Xiaofeng WangAI Engineer Summit 20252025
Guillaume VernadeAI Engineer Europe 20262026
Danilo CamposAI Engineer Europe 20262026
Ben HolmesAI Engineer World's Fair 20262026
Dat NgoAI Engineer Europe 20262026
Daniel WhitenackAI Engineer World's Fair 20242024
Sally Ann O'MalleyAI Engineer Europe 20262026
Joel BeckerAI Engineer Code 20252025
Daniel HanAI Engineer World's Fair 20242024
Adam BehrensAI Engineer World's Fair 20252025
Vincent KocAI Engineer Europe 20262026
Eashan SinhaAI Engineer World's Fair 20252025
Pietro ZulloAI Engineer World's Fair 20262026
MCP is all you need

Metadata candidate

Samuel ColvinAI Engineer World's Fair 20252025
David CramerAI Engineer World's Fair 20252025
Matt CareyAI Engineer Europe 20262026
Liad Yosef, Ido SalomonAI Engineer Europe 20262026
Manuel OdendahlAI Engineer World's Fair 20252025
Greg KamradtAI Engineer World's Fair 20252025
Drasko ProfirovicAI Engineer World's Fair 20262026
Mentoring the Machine

Metadata candidate

Eric HouAI Engineer World's Fair 20252025
Peter Werry, BrandonAI Engineer Europe 20262026
Minimax M2

Metadata candidate

Olive SongAI Engineer Code 20252025
Ilan BigioAI Engineer World's Fair 20252025
Alvaro MoralesAI Engineer World's Fair 20252025
Martin Harrysson, Natasha ManiarAI Engineer Code 20252025
Neil ZeghidourAI Engineer Europe 20262026
Mark HenningsAI Engineer Summit 20232023
Notion's Token Town

Metadata candidate

Sarah SachsAI Engineer World's Fair 20262026
On AI and Knowledge

Metadata candidate

Pablo CastroAI Engineer World's Fair 20262026
Sharif ShameemAI Engineer World's Fair 20252025
Garrett GalowAI Engineer Europe 20262026
Sonny Merla, Mauro Luchetti, Mattia RedaelliAI Engineer Europe 20262026
Saoud RizwanAI Engineer World's Fair 20262026
OpenAI for VPs of AI

Metadata candidate

Prashant Mital, Toki SherbakovAI Engineer Summit 20252025
Phil NashAI Engineer Europe 20262026
DottaAI Engineer Europe 20262026
Ishan AnandAI Engineer World's Fair 20262026
Mario ZechnerAI Engineer Europe 20262026
Randall HuntAI Engineer World's Fair 20252025
Dmitry KuchinAI Engineer World's Fair 20252025
Pragmatic AI With TypeChat

Metadata candidate

Daniel RosenwasserAI Engineer Summit 20232023
Steve KorshakovAI Engineer World's Fair 20262026
Anish Agarwal, Matthew SchoenbauerAI Engineer World's Fair 20252025
Sander SchulhoffAI Engineer World's Fair 20252025
Prompt Engineering is Dead

Metadata candidate

Nir GazitAI Engineer World's Fair 20252025
Nick NisiAI Engineer Europe 20262026
RAG for VPs of AI

Metadata candidate

Jerry LiuAI Engineer World's Fair 20242024
Kuba RogutAI Engineer Europe 20262026
Chris ParsonsAI Engineer Europe 20262026
Raza HabibAI Engineer World's Fair 20242024
Stefania DrugaAI Engineer World's Fair 20252025
Harald Kirschner, Christopher HarrisonAI Engineer World's Fair 20252025
Chad Bailey, Brian JohnsonAI Engineer World's Fair 20252025
Idan GazitAI Engineer World's Fair 20262026
Recursive Model Improvement

Metadata candidate

Lee RobinsonAI Engineer World's Fair 20262026
Will BrownAI Engineer World's Fair 20262026
David GomesAI Engineer Europe 20262026
Rayan GargAI Engineer World's Fair 20262026
Anton TroynikovAI Engineer Summit 20232023
Kshitij GroverAI Engineer World's Fair 20252025
Boris StarkovAI Engineer Europe 20262026
Rewiring the State

Metadata candidate

Eoin MulgrewAI Engineer Europe 20262026
Clay Bavor, Alessio FanelliAI Engineer World's Fair 20252025
RL Environments at Scale

Metadata candidate

Will BrownAI Engineer Code 20252025
Aakanksha ChowdheryAI Engineer World's Fair 20252025
Shashi JagtapAI Engineer World's Fair 20262026
Stephan SteinfurtAI Engineer Europe 20262026
Michael YuanAI Engineer World's Fair 20252025
Scaffold Wisely

Metadata candidate

Rahul SengottuveluAI Engineer Summit 20252025
Alessandro CappelliAI Engineer Europe 20262026
Adrian BertagnoliAI Engineer Europe 20262026
Scaling to Long Horizons

Metadata candidate

Ross Taylor, Chengxi TaylorAI Engineer World's Fair 20262026
See, Hear, Speak, Draw

Metadata candidate

Logan Kilpatrick, Simón FishmanAI Engineer Summit 20232023
Joshua SnyderAI Engineer Europe 20262026
Raahul Singh, Vanč LevstikAI Engineer World's Fair 20262026
Eno ReyesAI Engineer World's Fair 20252025
Aman KhanAI Engineer World's Fair 20252025
Jared JoselowitzAI Engineer World's Fair 20262026
Giran Moodley, Mayan Soni, Oussama Hafferssas, Mayank SoniAI Engineer Europe 20262026
Ben SteinAI Engineer World's Fair 20252025
Skills are the New SDKs

Metadata candidate

Elvin AghammadzadaAI Engineer World's Fair 20262026
Skills at Scale

Metadata candidate

Nick Nisi, Zack ProserAI Engineer Europe 20262026
Asaf BordAI Engineer Code 20252025
Louis Knight-WebbAI Engineer Europe 20262026
Matt PocockAI Engineer Europe 20262026
Gus Martins, Ian BallantyneAI Engineer Europe 20262026
The New Code

Metadata candidate

Sean GroveAI Engineer World's Fair 20252025
State of Data

Metadata candidate

Sean CaiAI Engineer World's Fair 20262026
Sarah GuoAI Engineer World's Fair 20252025
Peter Steinberger, swyxAI Engineer Europe 20262026
Annabell SchäferAI Engineer World's Fair 20262026
Manish SanwalAI Engineer Summit 20252025
Thiyagarajan MaruthavananAI Engineer World's Fair 20262026
Stop Using RAG as Memory

Metadata candidate

Daniel ChalefAI Engineer World's Fair 20252025
Taylor Jordan SmithAI Engineer World's Fair 20252025
Pydantic is all you need

Metadata candidate

Jason LiuAI Engineer Summit 20232023
Jack MorrisAI Engineer Code 20252025
Brian BalfourAI Engineer World's Fair 20252025
Kobie CrawfordAI Engineer Europe 20262026
Ronan McGovernAI Engineer World's Fair 20252025
swyxAI Engineer Summit 20232023
Barr YaronAI Engineer World's Fair 20252025
Barr YaronAI Engineer World's Fair 20262026
Michele CatastaAI Engineer Code 20252025
Patrick DeboisAI Engineer World's Fair 20252025
Sumit AgarwalAI Engineer World's Fair 20242024
Jack CableAI Engineer World's Fair 20262026
Dani Grant, Chelcie TaylorAI Engineer World's Fair 20252025
Chris White, Bryan Bischof, Brittany WalkerAI Engineer Summit 20232023
Kevin Madura, Mo BhasinAI Engineer World's Fair 20252025
Travis FrisingerAI Engineer World's Fair 20252025
Diamond BishopAI Engineer Summit 20252025
Natalie MeurerAI Engineer World's Fair 20262026
The End of Apps

Metadata candidate

KitzeAI Engineer Europe 20262026
Addy OsmaniAI Engineer World's Fair 20262026
Kieran KlaassenAI Engineer World's Fair 20262026
Sam FertigAI Engineer World's Fair 20252025
Armin Ronacher, Cristina Poncela CubeiroAI Engineer Europe 20262026
Ankur GoyalAI Engineer World's Fair 20252025
The Future of Work

Metadata candidate

Toran Bruce Richards, Silen Naihin, PootsAI Engineer Summit 20232023
Alexander Embiricos, Romain Huet, Peter SteinbergerAI Engineer World's Fair 20262026
Allie Howe, Dex Horthy, Geoffrey Huntley, Ian Livingstone, Greg PstruchaAI Engineer World's Fair 20262026
Chang She, Noah ShpakAI Engineer World's Fair 20242024
Jesse HanAI Engineer World's Fair 20252025
William LyonAI Engineer World's Fair 20252025
Itamar FriedmanAI Engineer World's Fair 20262026
Almog BakuAI Engineer Summit 20252025
The Making of Devin

Metadata candidate

Scott WuAI Engineer World's Fair 20242024
Ray MyersAI Engineer World's Fair 20252025
Phil HetzelAI Engineer Europe 20262026
Marah Abdin, Robert McHardyAI Engineer World's Fair 20262026
Jacob E. ThomasAI Engineer World's Fair 20262026
Raphael KalandadzeAI Engineer World's Fair 20262026
The New Application Layer

Metadata candidate

Malte UblAI Engineer Europe 20262026
Kwindla Kramer, Kwindla Hultman KramerAI Engineer World's Fair 20262026
Arturo NunezAI Engineer World's Fair 20262026
The Prompt is the Platform

Metadata candidate

Dominik, Dominik TornowAI Engineer World's Fair 20262026
Jonathan FernandesAI Engineer World's Fair 20252025
Elmer Thomas, Maria BermudezAI Engineer World's Fair 20252025
Filip MakraduliAI Engineer World's Fair 20252025
Itamar FriedmanAI Engineer Code 20252025
Alex Volkov, Benjamin EckelAI Engineer World's Fair 20252025
Walden, Carter, Tanay, Alex Atallah, NavAI Engineer World's Fair 20262026
Aparna DhinakaranAI Engineer Code 20252025
Gregory BrussAI Engineer World's Fair 20252025
Paul Klein IVAI Engineer World's Fair 20252025
Alex VolkovAI Engineer World's Fair 20262026
tldraw computer

Metadata candidate

Steve RuizAI Engineer World's Fair 20252025
Stefania DrugaAI Engineer Summit 20252025
Ayush BhardwajAI Engineer World's Fair 20262026
Rafal Wilinski, Vitor BaloccoAI Engineer World's Fair 20252025
Geoffrey LittAI Engineer World's Fair 20252025
Thabang LedwabaAI Engineer World's Fair 20252025
Jon PeckAI Engineer World's Fair 20252025
Useful General Intelligence

Metadata candidate

Danielle PerszykAI Engineer World's Fair 20252025
Sonam PankajAI Engineer World's Fair 20262026
Eugene YanAI Engineer World's Fair 20262026
Matt DaileyAI Engineer World's Fair 20262026
Veo 3 for developers

Metadata candidate

Paige BaileyAI Engineer World's Fair 20252025
Nico AlbaneseAI Engineer Summit 20252025
Harald KirschnerAI Engineer World's Fair 20252025
Harald KirschnerAI Engineer World's Fair 20252025
Itamar FriedmanAI Engineer World's Fair 20252025
Michael ArnaldiAI Engineer Europe 20262026
James LeAI Engineer World's Fair 20262026
Fryderyk WiatrowskiAI Engineer Europe 20262026
Nik CaryotakisAI Engineer Summit 20252025
Allen PikeAI Engineer World's Fair 20262026
Dippu Kumar SinghAI Engineer Europe 20262026
Suman DebnathAI Engineer World's Fair 20252025
Rajkumar SakthivelAI Engineer World's Fair 20262026
Lucas PalmaAI Engineer World's Fair 20262026
Bilge YücelAI Engineer Europe 20262026
Nicholas ArcolanoAI Engineer Code 20252025
Tobin SouthAI Engineer World's Fair 20252025
Remy GuercioAI Engineer Europe 20262026
Lei ZhangAI Engineer Code 20252025
Eugene Yan, Hamel Husain, Jason Liu, Dr Bryan Bischof, Charles Frye, Shreya ShankarAI Engineer World's Fair 20242024
Andy TriedmanAI Engineer Summit 20252025
Fryderyk Wiatrowski, Peter AlbertAI Engineer World's Fair 20242024
Victoria MelnikovaAI Engineer World's Fair 20252025
Phil HetzelAI Engineer Europe 20262026
Garrett GalowAI Engineer Europe 20262026
Tom Shapland, PhDAI Engineer World's Fair 20252025
Sunil Pai, Matt CareyAI Engineer Europe 20262026
Why MLX

Metadata candidate

AI Engineer Europe 20262026
Daniel SzokeAI Engineer Europe 20262026
Samuel HumeauAI Engineer Europe 20262026
Dr. Jasper ZhangAI Engineer World's Fair 20252025
Mike ChristensenAI Engineer Europe 20262026
James LoweAI Engineer World's Fair 20252025
Kevin HouAI Engineer World's Fair 20252025
Chin Keong LamAI Engineer World's Fair 20252025
Eugene CheahAI Engineer Summit 20252025
Balázs HorváthAI Engineer World's Fair 20262026
Ravi MadabhushiAI Engineer World's Fair 20262026
Veronica HylakAI Engineer World's Fair 20262026
Dan BjornnAI Engineer World's Fair 20262026
Tun Shwe, Jeremy FrenayAI Engineer Europe 20262026
Sachin KumarAI Engineer World's Fair 20262026
Jeremiah LowinAI Engineer Code 20252025
Mike PhippsAI Engineer World's Fair 20262026
Sean DuBois, Kwindla Hultman Kramer, YaxinAI Engineer World's Fair 20252025
Lisa OrrAI Engineer Code 20252025
Melanie WarrickAI Engineer World's Fair 20262026
Olive SongEvent unknownUnknown
Patrick SmythEvent unknownUnknown
Tanmai GopalEvent unknownUnknown
Remy GuercioAI Engineer World's Fair 20262026
Denys LinkovEvent unknownUnknown
Anekha SokhalEvent unknownUnknown
Daksh GuptaAI Engineer World's Fair 20262026
Matt BrockmanAI Engineer World's Fair 20262026
Yuchen Fama, Ashish KamraAI Engineer World's Fair 20262026
Davis PalmieAI Engineer World's Fair 20262026
Hari KumarEvent unknownUnknown
Devansh TandonAI Engineer World's Fair 20262026
Noyan TokgozogluEvent unknownUnknown
Jemima AbuAI Engineer NYC 2026 Online Talks2026
Vayum Arora, Zhengyao Jiang, Dixing Xu, Dhruv SrikanthAI Engineer World's Fair 20262026
Vincent WendyEvent unknownUnknown
Marina PetzelEvent unknownUnknown
Flora LiuAI Engineer World's Fair 20262026
Jeremiah LowinEvent unknownUnknown
Edo LibertyAI Engineer World's Fair 20262026
Soukaïna AbelhadAI Engineer NYC 2026 Online Talks2026
Hiral Shah, Sean SodhaEvent unknownUnknown
Katelyn Lesse, Angela JiangEvent unknownUnknown
Kay MalcolmEvent unknownUnknown
Dylan CouzonAI Engineer Code 2025Unknown
Prathik NaiduEvent unknownUnknown
Averi Kitsch, Prerna KakkarEvent unknownUnknown
Jan CurnEvent unknownUnknown
Jetashree RaviAI Engineer World's Fair 20262026
Suraj GuptaAI Engineer World's Fair 20262026
Javier GarzaAI Engineer World's Fair 20262026
Rania KhalafAI Engineer World's Fair 2026Unknown
Gil FeigAI Engineer World's Fair 20262026
Ryan AhernEvent unknownUnknown
Taylor Luttrell-Williams, Killian Carlsen-PhelanEvent unknownUnknown
Jonathan KelleyEvent unknownUnknown
Bogdan GazaAI Engineer Code 2025Unknown
Hossein NiazmandiAI Engineer World's Fair 20262026
Matt PocockAI Engineer Code 2025Unknown
Zack Proser, Nick NisiEvent unknownUnknown
Charlie HoltzAI Engineer World's Fair 20262026
Aparna DhinakaranEvent unknownUnknown
Ali-Reza Adl-TabatabaiAI Engineer World's Fair 20262026
Jeff Vestal, James WilliamsAI Engineer World's Fair 20262026
Laurie VossAI Engineer World's Fair 2026Unknown
Hariprasad SudharshanAI Engineer NYC 2026 Online Talks2026
Pamela FoxAI Engineer World's Fair 20262026
Charlie Guo, Gabriel ChuaAI Engineer World's Fair 20262026
Felipe BlanesAI Engineer World's Fair 20262026
Paula DozsaEvent unknownUnknown
Gabriel Spencer-HarperAI Engineer Code 2025Unknown
Tejas KumarAI Engineer World's Fair 20262026
Kent C. DoddsEvent unknownUnknown
Andrew GarvinAI Engineer World's Fair 20262026
Ryan CookeAI Engineer World's Fair 20262026
Elie BakouchAI Engineer World's Fair 20262026
Morgan SuoEvent unknownUnknown
Eugene CheahEvent unknownUnknown
Ivan LeoAI Engineer World's Fair 20262026
Greg PstruchaAI Engineer World's Fair 20262026
Connor Guerrero, Young Jeong, Nikhil GuptaAI Engineer Code 2025Unknown
Sarah SimionescuAI Engineer Code 2025Unknown
Chris VelaEvent unknownUnknown
Cyrus ClarkeEvent unknownUnknown
Gabriel MartinezAI Engineer World's Fair 20262026
Jesse HallAI Engineer World's Fair 20262026
Eric SchwartzAI Engineer Code 2025Unknown
Mike KriegerAI Engineer World's Fair 20262026
Dru KnoxAI Engineer World's Fair 20262026
Mahmoud AbdelwahabAI Engineer NYC 2026 Online Talks2026
Andrew OrobatorAI Engineer World's Fair 20262026
Miguel González Fernández, Corby RossetEvent unknownUnknown
Laurie VossEvent unknownUnknown
Em ShreveAI Engineer World's Fair 20262026
Kevin HouEvent unknownUnknown
Palak Agarwal, Omar AlhaitAI Engineer World's Fair 20262026
Nina Žižakić, Eleonora DrykinaAI Engineer NYC 2026 Online Talks2026
Steve JamisonAI Engineer NYC 2026 Online Talks2026
Simran AroraAI Engineer World's Fair 20262026
Nilofer RajpurkarAI Engineer World's Fair 20262026
Joseph KimEvent unknownUnknown
John OusterhoutEvent unknownUnknown
Peter WerryAI Engineer World's Fair 20262026
Varun ShenoyAI Engineer World's Fair 20262026
The Highest Loop — swyx

Metadata candidate

Shawn "swyx" WangAI Engineer World's Fair 20262026
Peter WerryAI Engineer World's Fair 20262026
Al ChenEvent unknownUnknown
Zach LloydEvent unknownUnknown
Daniel KimAI Engineer World's Fair 20262026
Yunmo KooAI Engineer World's Fair 20262026
Stephanie JarmakAI Engineer World's Fair 20262026
Tariq ShaukatEvent unknownUnknown
Andy Wong, Andrei Bocan, Shane WolfAI Engineer World's Fair 20262026
Paige BaileyAI Engineer World's Fair 20262026
Tereza TížkováAI Engineer World's Fair 20262026
Charles FryeAI Engineer World's Fair 20262026
Roland GavrilescuAI Engineer World's Fair 20262026
Archana Kamath, Tyler GillamAI Engineer World's Fair 20262026
Jeffrey WangAI Engineer World's Fair 20262026
Laurent Gil, Žilvinas UrbonasAI Engineer Code 2025Unknown
Dumitru Erhan, Shane Gu, Nicole Brichtova, swyxAI Engineer World's Fair 20262026
Ben DickenAI Engineer World's Fair 20262026
Zixuan LiEvent unknownUnknown
Gautam KorlamAI Engineer NYC 2026 Online Talks2026
Michael PattersonEvent unknownUnknown
Jiachen JiangAI Engineer NYC 2026 Online Talks2026
Dominik KundelAI Engineer World's Fair 20262026
Sandhya SubramaniAI Engineer World's Fair 20262026
Imad TouilAI Engineer World's Fair 20262026
Kent C. DoddsEvent unknownUnknown
Eli CohenAI Engineer World's Fair 20262026
Lakshya AgrawalAI Engineer World's Fair 20262026
Abduallah MohamedAI Engineer World's Fair 20262026
Alvin PaneAI Engineer NYC 2026 Online Talks2026
Clare LiguoriAI Engineer World's Fair 20262026
Taylor Luttrell-WilliamsEvent unknownUnknown
Paul BakausEvent unknownUnknown
Benjamin GuoEvent unknownUnknown
Nyah MacklinAI Engineer World's Fair 20262026
Everett BerryAI Engineer World's Fair 20262026
Paden GayleAI Engineer NYC 2026 Online Talks2026
Doug GuthrieAI Engineer World's Fair 20262026
Sam Green, Aaron LinskyEvent unknownUnknown
Merve NoyanAI Engineer World's Fair 20262026
Justin ReockEvent unknownUnknown
Michael Forrester, Whitney LeeAI Engineer World's Fair 20262026
Suchet BargotiAI Engineer World's Fair 20262026
Christopher BurnsAI Engineer World's Fair 20262026
Filip MakraduliAI Engineer World's Fair 20262026
Manish Kapur, Addy OsmaniEvent unknownUnknown
Abhi AryaEvent unknownUnknown
Maximilian-David RumpfAI Engineer World's Fair 20262026
Micah SilvermanAI Engineer World's Fair 20262026
Aditya GautamAI Engineer World's Fair 20262026
Yuxuan ZhangAI Engineer Code 20252025
Sanja GrbicAI Engineer World's Fair 20262026
Yegor Denisov-BlanchAI Engineer World's Fair 20252025
Charles FryeAI Engineer Summit 20232023
Building a Chess Coach

Metadata candidate

Anant Dole, Asbjørn SteinskogAI Engineer Europe 20262026
Sherwood Callaway, Satwik SinghAI Engineer World's Fair 20252025
Amelia WattenbergerAI Engineer Summit 20232023
Šimon PodhajskýAI Engineer Europe 20262026
Jun Yu TanAI Engineer World's Fair 20252025
Alex CheemaAI Engineer Europe 20262026
Kenton VardaAI Engineer World's Fair 20262026
Jaspreet SinghAI Engineer World's Fair 20252025
Kent C. DoddsAI Engineer World's Fair 20252025
No More Slop – swyx

Metadata candidate

Shawn "swyx" WangAI Engineer Code 20252025
Adrien GrondinAI Engineer Europe 20262026
Scaling Compute on Context

Metadata candidate

Jack MorrisAI Engineer World's Fair 20262026
What's next after RLHF?

Metadata candidate

Diogo AlmeidaAI Engineer World's Fair 20262026
Luis Romero-SevillaAI Engineer World's Fair 20262026
Anant SrivastavaAI Engineer Code 2025Unknown
Vishal Srivastava, Tanmay SahEvent unknownUnknown
Shy RuparelAI Engineer New York 20262026
Aidan SochowskiEvent unknownUnknown
Sofia JakovcevicEvent unknownUnknown
Peter WerryAI Engineer World's Fair 20262026

References

Coverage and source review
Processed transcripts
95 processed in full · 4 in the curated path
Automated source review
Passed
Metadata candidates
959 unreviewed; not verified topic membership
Corpus version
c76f4395d1050f81b2bfd27df900224591ef94b026792d1b65896097daa9f77c

Automated review checks source support; it is not publication approval.

A synthesis of selected conference talks and technical references. Citations link to the source material; they do not imply that every talk on this subject is included.

  1. 12-Factor Agents: Patterns of reliable LLM applications — Dex Horthy

    https://www.youtube.com/watch?v=8kMaTybvDUw&t=790s

  2. Workflow Patterns

    https://pure.tue.nl/ws/files/2053121/613310.pdf

  3. The Protection of Information in Computer Systems

    https://www.cs.virginia.edu/~evans/cs551/saltzer/

  4. Building effective agents

    https://www.anthropic.com/engineering/building-effective-agents

  5. Function calling

    https://developers.openai.com/api/docs/guides/function-calling

  6. Agents vs Workflows: Why Not Both?

    https://www.youtube.com/watch?v=8SUJEqQNClw&t=714

  7. Agents vs Workflows: Why Not Both? — Sam Bhagwat

    https://www.youtube.com/watch?v=8SUJEqQNClw&t=602s

  8. How to Build Planning Agents Without Losing Control - Yogendra Miraje, FactSet

    https://www.youtube.com/watch?v=sl3icG-IjHo&t=715

  9. Design by Contract Introduction

    https://www.eiffel.com/values/design-by-contract/introduction/

  10. Coding Agents Are Guessing: Measuring Action-Boundary Violations in Underspecified DevOps Instructions

    https://arxiv.org/html/2607.02294v1

  11. When Search Agents Should Ask: DiscoBench for Clarification-Aware Deep Search

    https://arxiv.org/html/2606.27669v1

  12. Principles of Mixed-Initiative User Interfaces

    https://erichorvitz.com/chi99horvitz.pdf

  13. OWASP Access Control

    https://owasp.org/www-community/Access_Control

  14. Planning and Acting in Partially Observable Stochastic Domains

    https://people.csail.mit.edu/lpk/papers/aij98-pomdp.pdf

  15. ReAct: Synergizing Reasoning and Acting in Language Models

    https://arxiv.org/abs/2210.03629

  16. Tools — Model Context Protocol specification 2025-06-18

    https://modelcontextprotocol.io/specification/2025-06-18/server/tools

  17. Building Multi-agent Systems with Finite State Machines

    https://www.youtube.com/watch?v=OD13PiXw60o&t=506

  18. ReAct: Synergizing Reasoning and Acting in Language Models

    https://arxiv.org/html/2210.03629v3

  19. Language Models are Few-Shot Learners

    https://arxiv.org/html/2005.14165v4

  20. AIP-151: Long-running operations

    https://google.aip.dev/151

  21. PROV-DM: The PROV Data Model

    https://www.w3.org/TR/prov-dm/

  22. Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks

    https://arxiv.org/html/2411.04468v1

  23. Your Agent Didn’t Fail. Your Harness Did.

    https://www.youtube.com/watch?v=BInpv7lGp1o&t=318

  24. On Optimal Game-Tree Search Using Rational Meta-Reasoning

    https://www.ijcai.org/Proceedings/89-1/Papers/053.pdf

  25. Shakey the Robot — SRI

    https://www.sri.com/hoi/shakey-the-robot/

  26. STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving

    https://www.cs.cmu.edu/~mmv/planning/readings/strips.pdf

  27. Monitored Execution of Robot Plans Produced by STRIPS

    https://www.researchgate.net/publication/23815496_Monitored_execution_of_robot_plans_produced_by_STRIPS

  28. Intelligence without representation

    https://people.csail.mit.edu/brooks/papers/representation.pdf

  29. BDI Agents: From Theory to Practice

    https://cdn.aaai.org/ICMAS/1995/ICMAS95-042.pdf

  30. What if the harness mattered more than the model? - Aditya Bhargava, Etsy

    https://www.youtube.com/watch?v=2e9ANoOEn28&t=1058

  31. Real AI Agents Need Planning, Not Just Prompting

    https://www.youtube.com/watch?v=Th5e4h-oVmc&t=258

  32. Building Reliable Agentic Systems

    https://www.youtube.com/watch?v=bjNYEc908oQ&t=245

  33. How to Build Planning Agents Without Losing Control - Yogendra Miraje, FactSet

    https://www.youtube.com/watch?v=sl3icG-IjHo&t=286

  34. How to Build Planning Agents Without Losing Control - Yogendra Miraje, FactSet

    https://www.youtube.com/watch?v=sl3icG-IjHo&t=480

  35. Building Reliable Agentic Systems

    https://www.youtube.com/watch?v=bjNYEc908oQ&t=296

  36. Model Predictive Control: Theory, Computation, and Design, second edition

    https://sites.engineering.ucsb.edu/~jbraw/mpc/MPC-book-2nd-edition-3rd-printing.pdf

  37. Agents are Robots Too: What Self-Driving Taught Me About Building Agents — Jesse Hu, Abundant

    https://www.youtube.com/watch?v=qqXdLf3wy1E&t=298

  38. Writing effective tools for AI agents

    https://www.anthropic.com/engineering/writing-tools-for-agents

  39. Agent Skills Overview

    https://agentskills.io/home

  40. Skills are new features: Building Skill-Centric Harness — Yogendra Miraje, FactSet

    https://www.youtube.com/watch?v=7jjudsEhBtM&t=568

  41. From RL to IRL — Gaurav Mishra, Amazon AGI Lab

    https://www.youtube.com/watch?v=Cc0_nyxROBA&t=622

  42. OWASP LLM10:2025 Unbounded Consumption

    https://genai.owasp.org/llmrisk/llm102025-unbounded-consumption/

  43. Every AI Company Is Accidentally Building a Bank — Dor Sasson, Stigg

    https://www.youtube.com/watch?v=cf2IhzqeQH4&t=936

  44. Temporal Activity Execution

    https://docs.temporal.io/activity-execution

  45. Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection

    https://arxiv.org/pdf/2302.12173

  46. OWASP Transaction Authorization Cheat Sheet

    https://cheatsheetseries.owasp.org/cheatsheets/Transaction_Authorization_Cheat_Sheet.html

  47. PagerDuty: Incidents

    https://support.pagerduty.com/main/docs/incidents

  48. What Does Done Even Mean? Agents and Paperclip's Liveness Model - Dotta, Paperclip

    https://www.youtube.com/watch?v=7P0elyLIxXo&t=67

  49. Building Your Own Secure AI Workflows: Human-in-the-Loop Automation with n8n

    https://www.youtube.com/watch?v=tDArkCqjA-c&t=3045

  50. When Machines Mislead: Human Review of Erroneous AI Cheating Signals

    https://aclanthology.org/2025.aimecon-wip.11.pdf

  51. WebArena: A Realistic Web Environment for Building Autonomous Agents

    https://arxiv.org/html/2307.13854v2

  52. Demystifying evals for AI agents

    https://www.anthropic.com/engineering/demystifying-evals-for-ai-agents

  53. What Does Done Even Mean? Agents and Paperclip's Liveness Model - Dotta, Paperclip

    https://www.youtube.com/watch?v=7P0elyLIxXo&t=11

  54. Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

    https://arxiv.org/html/2306.05685v4

  55. A practical guide to building agents

    https://cdn.openai.com/business-guides-and-resources/a-practical-guide-to-building-agents.pdf

  56. LangGraph: Interrupts

    https://docs.langchain.com/oss/python/langgraph/interrupts

  57. LangGraph: Graph API overview

    https://docs.langchain.com/oss/python/langgraph/graph-api

  58. Resolving an ambiguous payment request

    https://docs.stripe.com/error-low-level

  59. Making retries safe with idempotent APIs — Amazon Builders' Library

    https://aws.amazon.com/builders-library/making-retries-safe-with-idempotent-APIs/

  60. Compensating Transaction pattern

    https://learn.microsoft.com/en-us/azure/architecture/patterns/compensating-transaction

  61. OpenTelemetry: Traces

    https://opentelemetry.io/docs/concepts/signals/traces/

  62. Ship Real Agents: Hands-On Evals for Agentic Applications

    https://www.youtube.com/watch?v=Xfl50508LZM&t=1037

  63. Ship Real Agents: Hands-On Evals for Agentic Applications

    https://www.youtube.com/watch?v=Xfl50508LZM&t=2607

  64. Ship Real Agents: Hands-On Evals for Agentic Applications

    https://www.youtube.com/watch?v=Xfl50508LZM&t=2400

  65. Agents in Orbit: Workflows, Not Autopilot — Eduardo Simon & Javier Casal, Flywire

    https://www.youtube.com/watch?v=rAUyRDOFyHU&t=184

  66. Reasoning models don't always say what they think

    https://www.anthropic.com/research/reasoning-models-dont-say-think

  67. Quantifying infrastructure noise in agentic coding evals

    https://www.anthropic.com/engineering/infrastructure-noise

  68. OWASP Logging Cheat Sheet

    https://cheatsheetseries.owasp.org/cheatsheets/Logging_Cheat_Sheet.html

  69. Testing if "bash is all you need"

    https://vercel.com/blog/testing-if-bash-is-all-you-need

  70. NIST AI RMF Playbook: Measure

    https://airc.nist.gov/airmf-resources/playbook/measure/

  71. τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

    https://arxiv.org/html/2406.12045v1

  72. ReliabilityBench: Evaluating LLM Agent Reliability Under Production-Like Stress Conditions

    https://arxiv.org/html/2601.06112v1

  73. AI Agents That Matter

    https://arxiv.org/html/2407.01502v1

  74. Using RL-based Agent to Detect and Remediate ETL Pipeline Failures

    https://www.youtube.com/watch?v=LrGCT7G_rU8&t=371

  75. Real AI Agents Need Planning, Not Just Prompting

    https://www.youtube.com/watch?v=Th5e4h-oVmc&t=156

  76. Ensure AI Agents Work: Evaluation Frameworks for Scaling Success

    https://www.youtube.com/watch?v=OC04sP_QgTI&t=181

  77. AI Agents Are Just Distributed Systems Now — Salman Munaf, TikTok

    https://www.youtube.com/watch?v=hD9-V56FNRI&t=509

  78. Building Your Own Secure AI Workflows: Human-in-the-Loop Automation with n8n

    https://www.youtube.com/watch?v=tDArkCqjA-c&t=659

  79. Backlog.md: Terminal Kanban Board for Managing Tasks with AI Agents — Alex Gavrilescu, Funstage

    https://www.youtube.com/watch?v=zMXKhhwiCIc&t=735

  80. Your Agent Didn’t Fail. Your Harness Did.

    https://www.youtube.com/watch?v=BInpv7lGp1o&t=793