[
  {
    "startMs": 160,
    "text": "Welcome to our session on multiplayer"
  },
  {
    "startMs": 2399,
    "text": "software factories where I'll walk you"
  },
  {
    "startMs": 4240,
    "text": "through what the tensions are, what the"
  },
  {
    "startMs": 6400,
    "text": "solutions are when multiple people and"
  },
  {
    "startMs": 9120,
    "text": "multiple agents are working on the same"
  },
  {
    "startMs": 11679,
    "text": "software delivery pipeline. Software"
  },
  {
    "startMs": 14639,
    "text": "delivery pipelines are of course not new"
  },
  {
    "startMs": 16960,
    "text": "and existed before uh uh AI and you know"
  },
  {
    "startMs": 21119,
    "text": "we have the typical build test and then"
  },
  {
    "startMs": 24000,
    "text": "kind of wait for the release and the"
  },
  {
    "startMs": 26240,
    "text": "merge to go out into main. uh this is"
  },
  {
    "startMs": 28880,
    "text": "pretty much a serial flow and it has"
  },
  {
    "startMs": 31279,
    "text": "helped us automate and be more robust in"
  },
  {
    "startMs": 34079,
    "text": "the delivery. At the same time, people"
  },
  {
    "startMs": 36960,
    "text": "are building factories and I call them"
  },
  {
    "startMs": 38960,
    "text": "solo factories on their laptops on their"
  },
  {
    "startMs": 41360,
    "text": "kind of systems uh within their coding"
  },
  {
    "startMs": 43680,
    "text": "agents and increasingly they're using"
  },
  {
    "startMs": 46480,
    "text": "multiple agents and doing kind of"
  },
  {
    "startMs": 48800,
    "text": "delivery with agents. Now they often"
  },
  {
    "startMs": 52079,
    "text": "have to still make the decisions and"
  },
  {
    "startMs": 53760,
    "text": "they also have to do the merges and they"
  },
  {
    "startMs": 56879,
    "text": "kind of are a little bit of this central"
  },
  {
    "startMs": 59039,
    "text": "piece or almost like they have to keep"
  },
  {
    "startMs": 61199,
    "text": "the memory what they're doing and so on."
  },
  {
    "startMs": 64400,
    "text": "I'm talking not single player of not"
  },
  {
    "startMs": 67119,
    "text": "solo player but uh multiplayer and"
  },
  {
    "startMs": 69920,
    "text": "there's probably a gradation in between"
  },
  {
    "startMs": 72000,
    "text": "currently people doing it on our laptops"
  },
  {
    "startMs": 74880,
    "text": "then people sharing their setups like"
  },
  {
    "startMs": 76960,
    "text": "their context their skills their loops"
  },
  {
    "startMs": 79280,
    "text": "within their factories pretty much the"
  },
  {
    "startMs": 81040,
    "text": "state of many factories out there and"
  },
  {
    "startMs": 83600,
    "text": "then the multiplayer factories of people"
  },
  {
    "startMs": 86560,
    "text": "collaborating at the same time uh in the"
  },
  {
    "startMs": 89520,
    "text": "same kind of uh kind of ticket board uh"
  },
  {
    "startMs": 92479,
    "text": "on their same code base And that's what"
  },
  {
    "startMs": 94560,
    "text": "I'll work you through today. Now on the"
  },
  {
    "startMs": 98000,
    "text": "left, the tension is everybody wants to"
  },
  {
    "startMs": 101040,
    "text": "merge into main. On the right, there's"
  },
  {
    "startMs": 103600,
    "text": "multiple people on the board and they"
  },
  {
    "startMs": 105360,
    "text": "have to collaborate and work together."
  },
  {
    "startMs": 107360,
    "text": "So that's kind of the two parts of this"
  },
  {
    "startMs": 109600,
    "text": "talk. Let's start with the first part,"
  },
  {
    "startMs": 112320,
    "text": "the code, and how to make that like a"
  },
  {
    "startMs": 114640,
    "text": "central piece of agents being able to"
  },
  {
    "startMs": 116880,
    "text": "work together."
  },
  {
    "startMs": 118479,
    "text": "You know, one of the first things when"
  },
  {
    "startMs": 120000,
    "text": "you turn on a factory or multiplayer"
  },
  {
    "startMs": 122079,
    "text": "factory, you'll see that there's"
  },
  {
    "startMs": 124320,
    "text": "definitely an increase in pull requests,"
  },
  {
    "startMs": 126960,
    "text": "you know, it almost like a factor 10 uh"
  },
  {
    "startMs": 130160,
    "text": "of more and more pull requests landing."
  },
  {
    "startMs": 132800,
    "text": "Uh that's good because we're being more"
  },
  {
    "startMs": 135120,
    "text": "productive. We get more changes done and"
  },
  {
    "startMs": 137520,
    "text": "but that also builds up some of the"
  },
  {
    "startMs": 139599,
    "text": "tension."
  },
  {
    "startMs": 141280,
    "text": "For example, um we have a lot more"
  },
  {
    "startMs": 144400,
    "text": "merges and they have to make sure that"
  },
  {
    "startMs": 146959,
    "text": "they're not conflicting and if we're"
  },
  {
    "startMs": 149200,
    "text": "unlucky, the agents also spend time of"
  },
  {
    "startMs": 152640,
    "text": "going rounds around us. Uh you know, one"
  },
  {
    "startMs": 155120,
    "text": "agent changing something then the other"
  },
  {
    "startMs": 156879,
    "text": "agent changing it back. These conflicts"
  },
  {
    "startMs": 159440,
    "text": "are real when you turn on a multiplayer"
  },
  {
    "startMs": 161760,
    "text": "factory. And one of the most noticeable"
  },
  {
    "startMs": 165200,
    "text": "things is we start to wait more for"
  },
  {
    "startMs": 167920,
    "text": "releases because when we merge a change"
  },
  {
    "startMs": 170720,
    "text": "all the other PRs need to rebase and"
  },
  {
    "startMs": 172879,
    "text": "they typically rerun their tests uh and"
  },
  {
    "startMs": 175680,
    "text": "you'll have to wait and at the same time"
  },
  {
    "startMs": 178160,
    "text": "that means actually your CI/CD system is"
  },
  {
    "startMs": 181920,
    "text": "becoming a lot lot slower because of"
  },
  {
    "startMs": 184640,
    "text": "that multi- thing and also more costly"
  },
  {
    "startMs": 186879,
    "text": "but that's a side effect."
  },
  {
    "startMs": 189360,
    "text": "Now the PRQ is kind of building up not"
  },
  {
    "startMs": 192560,
    "text": "just with features. There's also the"
  },
  {
    "startMs": 194879,
    "text": "agent incidents that we have to solve as"
  },
  {
    "startMs": 197360,
    "text": "I mentioned and then there's factory"
  },
  {
    "startMs": 199360,
    "text": "maintenance on their own like the"
  },
  {
    "startMs": 200879,
    "text": "improvement of the skills the"
  },
  {
    "startMs": 202159,
    "text": "improvement of the loops that we've been"
  },
  {
    "startMs": 203760,
    "text": "using all more more and more work that"
  },
  {
    "startMs": 208000,
    "text": "needs to get approved by us. So why"
  },
  {
    "startMs": 211840,
    "text": "can't we flip this from being this"
  },
  {
    "startMs": 214159,
    "text": "concurrency and it being an exception to"
  },
  {
    "startMs": 216799,
    "text": "becoming the routine? And this is what I"
  },
  {
    "startMs": 218959,
    "text": "call conc concurrent delivery and going"
  },
  {
    "startMs": 221760,
    "text": "from continuous delivery to concurrent"
  },
  {
    "startMs": 223599,
    "text": "delivery and design for people to work"
  },
  {
    "startMs": 226319,
    "text": "and agents to work together on the same"
  },
  {
    "startMs": 228319,
    "text": "codebase."
  },
  {
    "startMs": 230239,
    "text": "Now one of the simple things that we uh"
  },
  {
    "startMs": 232640,
    "text": "can do is instead of just running and"
  },
  {
    "startMs": 235920,
    "text": "running agents just in parallel we can"
  },
  {
    "startMs": 238560,
    "text": "get smarter about this uh almost like"
  },
  {
    "startMs": 241360,
    "text": "splitting up the work like we would do"
  },
  {
    "startMs": 243280,
    "text": "with units like you get to do this task"
  },
  {
    "startMs": 245920,
    "text": "you get to do that task and there's"
  },
  {
    "startMs": 248239,
    "text": "different ways of splitting this in a"
  },
  {
    "startMs": 250239,
    "text": "way that we can say well you work on"
  },
  {
    "startMs": 251680,
    "text": "authentication I work on payment I work"
  },
  {
    "startMs": 254080,
    "text": "on other parts and we can use even the"
  },
  {
    "startMs": 256799,
    "text": "ASD graph to determine which pieces are"
  },
  {
    "startMs": 259759,
    "text": "like able to split quite well and then"
  },
  {
    "startMs": 262320,
    "text": "we can go have the agents go on more"
  },
  {
    "startMs": 264240,
    "text": "granular level and they would do like"
  },
  {
    "startMs": 266639,
    "text": "hey this file this function and even"
  },
  {
    "startMs": 269199,
    "text": "they would go on certain keystrokes like"
  },
  {
    "startMs": 271120,
    "text": "in certain files doing together. So this"
  },
  {
    "startMs": 273520,
    "text": "is a way of kind of dealing with kind of"
  },
  {
    "startMs": 276320,
    "text": "more uh splitting of the work before you"
  },
  {
    "startMs": 279280,
    "text": "actually do uh the actual coding. This"
  },
  {
    "startMs": 282080,
    "text": "is a better way of planning the changes."
  },
  {
    "startMs": 285280,
    "text": "And then once uh you start planning and"
  },
  {
    "startMs": 287919,
    "text": "you start actually executing the plan uh"
  },
  {
    "startMs": 291600,
    "text": "much like you would do on your uh scrum"
  },
  {
    "startMs": 293919,
    "text": "board, you would say I'm going to take"
  },
  {
    "startMs": 295600,
    "text": "care of this and the agent writes and"
  },
  {
    "startMs": 297600,
    "text": "says it claims the ticket. It says I"
  },
  {
    "startMs": 299840,
    "text": "want to do that ticket. So no other"
  },
  {
    "startMs": 301600,
    "text": "agent can actually step in at the same"
  },
  {
    "startMs": 303600,
    "text": "time. And it also announces which files"
  },
  {
    "startMs": 306479,
    "text": "and which changes it's going to make. So"
  },
  {
    "startMs": 309280,
    "text": "this is something that is helpful for"
  },
  {
    "startMs": 310960,
    "text": "other agents to see that they're not"
  },
  {
    "startMs": 312960,
    "text": "starting to overlap during the planning"
  },
  {
    "startMs": 315199,
    "text": "and the execution."
  },
  {
    "startMs": 317840,
    "text": "Now to make sure that they can keep"
  },
  {
    "startMs": 320160,
    "text": "executing um a lot of people use work"
  },
  {
    "startMs": 322880,
    "text": "trees to kind of separate them. When you"
  },
  {
    "startMs": 324960,
    "text": "kind of think about this broader there"
  },
  {
    "startMs": 327039,
    "text": "is a lot more splitting that you could"
  },
  {
    "startMs": 328720,
    "text": "do. You basically are phrasing the world"
  },
  {
    "startMs": 331120,
    "text": "of an agent. You give them their own"
  },
  {
    "startMs": 333600,
    "text": "kind of machine. You give their their"
  },
  {
    "startMs": 335520,
    "text": "own phrase of the context. to give them"
  },
  {
    "startMs": 337520,
    "text": "their own version of the API that's"
  },
  {
    "startMs": 339600,
    "text": "being locked and even the database gets"
  },
  {
    "startMs": 341759,
    "text": "their snapshot their test data and even"
  },
  {
    "startMs": 345039,
    "text": "outside world like digital twins and uh"
  },
  {
    "startMs": 348000,
    "text": "kind of making sure that everything's"
  },
  {
    "startMs": 349680,
    "text": "mocked and that they can do these things"
  },
  {
    "startMs": 352400,
    "text": "without having to deal with any impact"
  },
  {
    "startMs": 354560,
    "text": "of the outside world."
  },
  {
    "startMs": 357199,
    "text": "Now when two agents do collide during"
  },
  {
    "startMs": 360160,
    "text": "the work there's a couple of strategies"
  },
  {
    "startMs": 361840,
    "text": "they can either start like waiting for"
  },
  {
    "startMs": 363680,
    "text": "each other um one after the other they"
  },
  {
    "startMs": 366479,
    "text": "can retry after the wait they can say"
  },
  {
    "startMs": 369199,
    "text": "like okay I'm going to wait but I'll"
  },
  {
    "startMs": 370800,
    "text": "recue and I'll wait until it's done or"
  },
  {
    "startMs": 373199,
    "text": "they can start changing and optimizing"
  },
  {
    "startMs": 374960,
    "text": "the plan like you do this I do that and"
  },
  {
    "startMs": 378000,
    "text": "that's renegotiation uh in the end so"
  },
  {
    "startMs": 380319,
    "text": "they're changing actually the planning"
  },
  {
    "startMs": 383039,
    "text": "while they're doing the execution to"
  },
  {
    "startMs": 385280,
    "text": "make sure that they don't interfere with"
  },
  {
    "startMs": 387280,
    "text": "each other."
  },
  {
    "startMs": 389360,
    "text": "Now on a conflict you could rerun it. Um"
  },
  {
    "startMs": 392720,
    "text": "and within get you're merging today and"
  },
  {
    "startMs": 395440,
    "text": "you say okay there's a conflict. What do"
  },
  {
    "startMs": 397840,
    "text": "I do? You rerun and see if it merges on"
  },
  {
    "startMs": 401759,
    "text": "the rerun which was typically our PR uh"
  },
  {
    "startMs": 404560,
    "text": "change or you could just kind of make"
  },
  {
    "startMs": 406880,
    "text": "sure that the agents do that for you"
  },
  {
    "startMs": 409199,
    "text": "instead. So they can see whether they"
  },
  {
    "startMs": 412080,
    "text": "can merge instead of just by code lines."
  },
  {
    "startMs": 414319,
    "text": "they can merge by function and it"
  },
  {
    "startMs": 416479,
    "text": "becomes smarter and then the agent maybe"
  },
  {
    "startMs": 418800,
    "text": "can fix [clears throat] the merge so you"
  },
  {
    "startMs": 420560,
    "text": "don't have to do that again and"
  },
  {
    "startMs": 422319,
    "text": "ultimately it can even start seeing"
  },
  {
    "startMs": 425120,
    "text": "changes coming so hey this agent is"
  },
  {
    "startMs": 427840,
    "text": "probably going to change this I'm going"
  },
  {
    "startMs": 429840,
    "text": "to see this coming and I'm already kind"
  },
  {
    "startMs": 431840,
    "text": "of adapting my code uh at the same time"
  },
  {
    "startMs": 434720,
    "text": "so this is thinking in concurrency"
  },
  {
    "startMs": 437120,
    "text": "instead of being kind of serial in the"
  },
  {
    "startMs": 439360,
    "text": "changes"
  },
  {
    "startMs": 441120,
    "text": "now one of the things you can see is"
  },
  {
    "startMs": 443120,
    "text": "that you agents have been optimized to"
  },
  {
    "startMs": 446000,
    "text": "merge stuff, right? Like with the"
  },
  {
    "startMs": 448000,
    "text": "merging of code, this is clear. But what"
  },
  {
    "startMs": 450800,
    "text": "if two changes land at the same time? In"
  },
  {
    "startMs": 454240,
    "text": "this case, you're calculating and"
  },
  {
    "startMs": 456080,
    "text": "changing the function of calculating the"
  },
  {
    "startMs": 458000,
    "text": "the total for an invoice and say it's"
  },
  {
    "startMs": 461039,
    "text": "not just in dollars, but it in dollar"
  },
  {
    "startMs": 463360,
    "text": "cents. Now, at the same time, there is"
  },
  {
    "startMs": 465680,
    "text": "another PR that changes the fact of"
  },
  {
    "startMs": 468319,
    "text": "reporting out. Now two mergers that"
  },
  {
    "startMs": 471759,
    "text": "consistently could merge with the test"
  },
  {
    "startMs": 474560,
    "text": "succeeding but at the same time it was a"
  },
  {
    "startMs": 478080,
    "text": "different intent. The report don't want"
  },
  {
    "startMs": 480800,
    "text": "to have it in euro cents or in dollar"
  },
  {
    "startMs": 482879,
    "text": "cents. Right? So they're not conflicting"
  },
  {
    "startMs": 485919,
    "text": "in code but they're conflicting on"
  },
  {
    "startMs": 488000,
    "text": "intent. So we could have agents actually"
  },
  {
    "startMs": 490479,
    "text": "look at the intent whether they're still"
  },
  {
    "startMs": 492639,
    "text": "consistent across the multiple mergers"
  },
  {
    "startMs": 495039,
    "text": "and warn us or change the PR"
  },
  {
    "startMs": 497840,
    "text": "accordingly."
  },
  {
    "startMs": 500240,
    "text": "Now, if you want to kind start merging,"
  },
  {
    "startMs": 503120,
    "text": "um the PRs are able to merge, they're"
  },
  {
    "startMs": 505919,
    "text": "good to merge. Um but what if one of"
  },
  {
    "startMs": 509919,
    "text": "those mages uh merges doesn't uh merge"
  },
  {
    "startMs": 513039,
    "text": "well, right? Then you'll have typically"
  },
  {
    "startMs": 515360,
    "text": "rebase all the others, they'll have to"
  },
  {
    "startMs": 517360,
    "text": "do rework and so on. Now, there's a"
  },
  {
    "startMs": 519680,
    "text": "better way of dealing with these merge"
  },
  {
    "startMs": 521519,
    "text": "trains is by looking uh in a concept"
  },
  {
    "startMs": 524320,
    "text": "called speculative merge trains. And it"
  },
  {
    "startMs": 527440,
    "text": "looks at all the PRs coming in and it"
  },
  {
    "startMs": 530000,
    "text": "sees which ones are compatible with each"
  },
  {
    "startMs": 532240,
    "text": "other and it kind of already checks them"
  },
  {
    "startMs": 534399,
    "text": "in pairs. And then it says like when"
  },
  {
    "startMs": 536640,
    "text": "that is landing and this one isn't"
  },
  {
    "startMs": 538560,
    "text": "landing, but you could still do the"
  },
  {
    "startMs": 539920,
    "text": "others, it goes faster because all the"
  },
  {
    "startMs": 542080,
    "text": "others that can go through already go"
  },
  {
    "startMs": 544080,
    "text": "through in the merge cube."
  },
  {
    "startMs": 546720,
    "text": "Uh these are just some examples of kind"
  },
  {
    "startMs": 549760,
    "text": "of new strategies of dealing with merges"
  },
  {
    "startMs": 552160,
    "text": "and conflicts and reviews and better"
  },
  {
    "startMs": 554240,
    "text": "planning. I think in general there's a"
  },
  {
    "startMs": 556480,
    "text": "new kind of infra layer coming and you"
  },
  {
    "startMs": 558320,
    "text": "see that almost from the vendors you"
  },
  {
    "startMs": 560399,
    "text": "know it's a new developer infrastructure"
  },
  {
    "startMs": 562720,
    "text": "mergers are going to be handled"
  },
  {
    "startMs": 564320,
    "text": "differently there's now an analytics"
  },
  {
    "startMs": 566160,
    "text": "there's now a better planning there's"
  },
  {
    "startMs": 567680,
    "text": "now a better tool for anything and"
  },
  {
    "startMs": 569839,
    "text": "that's kind of what we're building up uh"
  },
  {
    "startMs": 572080,
    "text": "right now a lot of the factories are"
  },
  {
    "startMs": 573839,
    "text": "just glorified loops as we would do with"
  },
  {
    "startMs": 576160,
    "text": "the SCD but the concurrency will only"
  },
  {
    "startMs": 578880,
    "text": "increase"
  },
  {
    "startMs": 580480,
    "text": "now I told you there was a flip side to"
  },
  {
    "startMs": 582480,
    "text": "this there's also the humans working"
  },
  {
    "startMs": 584640,
    "text": "together, not just the agents. And the"
  },
  {
    "startMs": 586480,
    "text": "typically the change is that you're"
  },
  {
    "startMs": 588880,
    "text": "working together in one kind of task"
  },
  {
    "startMs": 591279,
    "text": "board, right? And all the humans are"
  },
  {
    "startMs": 594000,
    "text": "being able to see what changes are"
  },
  {
    "startMs": 595920,
    "text": "coming, what tasks are being done. And"
  },
  {
    "startMs": 598480,
    "text": "this creates the visibility where in"
  },
  {
    "startMs": 600560,
    "text": "your solo factory, you would have that"
  },
  {
    "startMs": 602959,
    "text": "doing that all alone, but it wouldn't be"
  },
  {
    "startMs": 605120,
    "text": "a central kind of board that you're"
  },
  {
    "startMs": 606720,
    "text": "working on. Now, they all need your"
  },
  {
    "startMs": 609279,
    "text": "attention, and that's probably the easy"
  },
  {
    "startMs": 611440,
    "text": "part, right? So we want to reduce also"
  },
  {
    "startMs": 613519,
    "text": "that attention uh from the agents having"
  },
  {
    "startMs": 616000,
    "text": "to call you all the time. So this is a"
  },
  {
    "startMs": 618079,
    "text": "side effect of having multiple agents"
  },
  {
    "startMs": 620800,
    "text": "working at the same time."
  },
  {
    "startMs": 623279,
    "text": "Now one of the nice features is and uh"
  },
  {
    "startMs": 625920,
    "text": "it's been kind of interesting to see"
  },
  {
    "startMs": 628240,
    "text": "that agents can join your chat and this"
  },
  {
    "startMs": 630880,
    "text": "is a different way of coding. It is not"
  },
  {
    "startMs": 633279,
    "text": "you prompting but it's you kind of"
  },
  {
    "startMs": 636160,
    "text": "pulling an agent into a conversation. Uh"
  },
  {
    "startMs": 639040,
    "text": "and that's really powerful because the"
  },
  {
    "startMs": 640800,
    "text": "agent is picking up clues not just from"
  },
  {
    "startMs": 643120,
    "text": "you from your team members at the same"
  },
  {
    "startMs": 645200,
    "text": "time. And what it's actually doing it is"
  },
  {
    "startMs": 647680,
    "text": "refining the ticket from all the input."
  },
  {
    "startMs": 650560,
    "text": "And that is really powerful because you"
  },
  {
    "startMs": 652720,
    "text": "actually not only had like adversarial"
  },
  {
    "startMs": 655120,
    "text": "review by agents, but you also get"
  },
  {
    "startMs": 657519,
    "text": "multiple input by humans on the same"
  },
  {
    "startMs": 659600,
    "text": "ticket while during the conversation."
  },
  {
    "startMs": 663680,
    "text": "And what it's really good at is"
  },
  {
    "startMs": 666000,
    "text": "prompting you with questions instead of"
  },
  {
    "startMs": 668399,
    "text": "having to ask everything over and over"
  },
  {
    "startMs": 670880,
    "text": "again. So one thing that helpful is that"
  },
  {
    "startMs": 674160,
    "text": "it clarifies what is the test, what"
  },
  {
    "startMs": 676800,
    "text": "should it do, what are the requests"
  },
  {
    "startMs": 679680,
    "text": "uh requirements that it needs to do. And"
  },
  {
    "startMs": 682880,
    "text": "the ticket actually becomes almost like"
  },
  {
    "startMs": 685360,
    "text": "a plan the plan mode in your coding"
  },
  {
    "startMs": 687760,
    "text": "agent but now as a share feature within"
  },
  {
    "startMs": 690880,
    "text": "your board um of looking at all the"
  },
  {
    "startMs": 693360,
    "text": "requirements."
  },
  {
    "startMs": 695440,
    "text": "Now what's even more powerful is that it"
  },
  {
    "startMs": 698880,
    "text": "doesn't only have to be engineers. Think"
  },
  {
    "startMs": 701760,
    "text": "of this as in the past sales marketing"
  },
  {
    "startMs": 704399,
    "text": "support they were kind of filing tickets"
  },
  {
    "startMs": 706959,
    "text": "to the engineering that would get"
  },
  {
    "startMs": 709200,
    "text": "somewhere on a board and they all have"
  },
  {
    "startMs": 711360,
    "text": "to wait until an engineering comes that"
  },
  {
    "startMs": 713360,
    "text": "could have taken weeks. Right now what"
  },
  {
    "startMs": 715600,
    "text": "we see in our factory at Tesla is that"
  },
  {
    "startMs": 718000,
    "text": "people are just sharing and doing a chat"
  },
  {
    "startMs": 720880,
    "text": "within kind of the uh organization and"
  },
  {
    "startMs": 723760,
    "text": "the agent is there. Now they don't need"
  },
  {
    "startMs": 726720,
    "text": "to build um the uh uh the code all the"
  },
  {
    "startMs": 731680,
    "text": "time and before [clears throat] they"
  },
  {
    "startMs": 734079,
    "text": "were maybe doing vibe coding but one of"
  },
  {
    "startMs": 736320,
    "text": "the problems with the vibe coding is it"
  },
  {
    "startMs": 738480,
    "text": "didn't fit according to engineering"
  },
  {
    "startMs": 741120,
    "text": "practices. Now with a multiplayer"
  },
  {
    "startMs": 744000,
    "text": "factory people are using the same"
  },
  {
    "startMs": 745920,
    "text": "pipeline the same knowledge the same"
  },
  {
    "startMs": 747839,
    "text": "skills the same loops to actually"
  },
  {
    "startMs": 750000,
    "text": "already fit into that flow of"
  },
  {
    "startMs": 752399,
    "text": "engineering itself. So they can"
  },
  {
    "startMs": 754959,
    "text": "experiment, they can refine the feature"
  },
  {
    "startMs": 757200,
    "text": "and they can also even build the feature"
  },
  {
    "startMs": 759519,
    "text": "where before we would wait they can just"
  },
  {
    "startMs": 761519,
    "text": "kickstart it and engineering refused"
  },
  {
    "startMs": 764000,
    "text": "that. That's a very powerful flow of"
  },
  {
    "startMs": 766800,
    "text": "getting everybody on board and being in"
  },
  {
    "startMs": 769360,
    "text": "the flow of that one multiplayer"
  },
  {
    "startMs": 771920,
    "text": "factory."
  },
  {
    "startMs": 774000,
    "text": "Now sometimes the agent while executing"
  },
  {
    "startMs": 777040,
    "text": "is unsure and you might have the same"
  },
  {
    "startMs": 780720,
    "text": "feeling that sometimes the ticket mode"
  },
  {
    "startMs": 783680,
    "text": "within a factory is slow and you want to"
  },
  {
    "startMs": 785760,
    "text": "do fast iteration. Now there's a way to"
  },
  {
    "startMs": 788480,
    "text": "do this hybridly when for example your"
  },
  {
    "startMs": 790959,
    "text": "agent is is stuck. Uh there was a very"
  },
  {
    "startMs": 793760,
    "text": "interesting ID from Helix ML where when"
  },
  {
    "startMs": 796320,
    "text": "your agent is stuck is actually starts a"
  },
  {
    "startMs": 799360,
    "text": "new kind of coding IDE with the exact"
  },
  {
    "startMs": 802720,
    "text": "context that the agent was working on"
  },
  {
    "startMs": 805120,
    "text": "you as a human almost jump in uh to help"
  },
  {
    "startMs": 808880,
    "text": "the agent figure out like with all the"
  },
  {
    "startMs": 811279,
    "text": "context available with all kind of the"
  },
  {
    "startMs": 813120,
    "text": "files available and then when you made"
  },
  {
    "startMs": 815120,
    "text": "the right choices when you did the right"
  },
  {
    "startMs": 816880,
    "text": "experiments you hand it actually back to"
  },
  {
    "startMs": 819279,
    "text": "the agent and the factory to continue."
  },
  {
    "startMs": 821760,
    "text": "So this is a nice way of finding the"
  },
  {
    "startMs": 823920,
    "text": "middle ground between a personal coding"
  },
  {
    "startMs": 826000,
    "text": "agent fast iterations and still doing"
  },
  {
    "startMs": 828480,
    "text": "the factory uh and the agent can use it"
  },
  {
    "startMs": 830880,
    "text": "as well to kind of clarify and help uh"
  },
  {
    "startMs": 833600,
    "text": "and ask for help."
  },
  {
    "startMs": 835760,
    "text": "Now what we really want to do is reduce"
  },
  {
    "startMs": 838240,
    "text": "kind of the choices uh that it has to"
  },
  {
    "startMs": 841120,
    "text": "kind of make and what is really powerful"
  },
  {
    "startMs": 844320,
    "text": "is that it represents actually questions"
  },
  {
    "startMs": 847360,
    "text": "to us for decisions not just what should"
  },
  {
    "startMs": 851600,
    "text": "I do and open questions you know you see"
  },
  {
    "startMs": 854480,
    "text": "that in coding agents as well it gives"
  },
  {
    "startMs": 856560,
    "text": "you a couple of options that you can"
  },
  {
    "startMs": 858320,
    "text": "choose for and then it goes off this is"
  },
  {
    "startMs": 861279,
    "text": "really powerful and it is less trained"
  },
  {
    "startMs": 865040,
    "text": "on like having to tell the agent all the"
  },
  {
    "startMs": 867920,
    "text": "time what to do by presenting options"
  },
  {
    "startMs": 870959,
    "text": "there as well. Of course, you can"
  },
  {
    "startMs": 872399,
    "text": "override, but this is really a powerful"
  },
  {
    "startMs": 874880,
    "text": "multiplayer thing."
  },
  {
    "startMs": 877519,
    "text": "Now, every decision that people make"
  },
  {
    "startMs": 879839,
    "text": "actually goes onto a ledger. This is"
  },
  {
    "startMs": 881680,
    "text": "like your context locally maybe that you"
  },
  {
    "startMs": 884079,
    "text": "have in your coding agent. But if you"
  },
  {
    "startMs": 886160,
    "text": "are in a multiplayer factory, this is"
  },
  {
    "startMs": 888880,
    "text": "shared somewhere on a decision log and"
  },
  {
    "startMs": 891760,
    "text": "that can be used either by agents, it"
  },
  {
    "startMs": 894079,
    "text": "could be used by humans to find and you"
  },
  {
    "startMs": 896320,
    "text": "can trace things back like who made what"
  },
  {
    "startMs": 898560,
    "text": "decision uh and when that context is"
  },
  {
    "startMs": 901199,
    "text": "being used in the next session, you can"
  },
  {
    "startMs": 903120,
    "text": "also query that as well."
  },
  {
    "startMs": 906079,
    "text": "Now we want that to be small because big"
  },
  {
    "startMs": 908240,
    "text": "changes uh they are not very readable."
  },
  {
    "startMs": 911199,
    "text": "So while I said in the beginning you"
  },
  {
    "startMs": 913360,
    "text": "could optimize for agent not being"
  },
  {
    "startMs": 915440,
    "text": "conflicting. There is also another kind"
  },
  {
    "startMs": 918079,
    "text": "of thing you have to think about which"
  },
  {
    "startMs": 919760,
    "text": "is the human review. How much change can"
  },
  {
    "startMs": 922720,
    "text": "a human review but you can build like"
  },
  {
    "startMs": 925199,
    "text": "separate Pars in multiple main merge"
  },
  {
    "startMs": 928480,
    "text": "trains for people to do fast reviewing"
  },
  {
    "startMs": 930800,
    "text": "of those things."
  },
  {
    "startMs": 932959,
    "text": "Now a lot of people are focused on kind"
  },
  {
    "startMs": 935839,
    "text": "of you know when the PR and we want to"
  },
  {
    "startMs": 939040,
    "text": "reduce the number of PR reviews is that"
  },
  {
    "startMs": 941920,
    "text": "there is some kind of automated review."
  },
  {
    "startMs": 944959,
    "text": "Now the first part is typically to"
  },
  {
    "startMs": 947440,
    "text": "reduce the failures which is great right"
  },
  {
    "startMs": 950160,
    "text": "like we we want to provide better"
  },
  {
    "startMs": 952079,
    "text": "context better tools we have adversarial"
  },
  {
    "startMs": 954560,
    "text": "agents look at the code before it comes"
  },
  {
    "startMs": 956959,
    "text": "to us that is a good way of reducing"
  },
  {
    "startMs": 960399,
    "text": "kind of the risk uh by it being better"
  },
  {
    "startMs": 963440,
    "text": "quality now at the same time we're"
  },
  {
    "startMs": 966560,
    "text": "optimizing that we can actually see what"
  },
  {
    "startMs": 969040,
    "text": "it did we are asking for screen flow uh"
  },
  {
    "startMs": 972079,
    "text": "shots for videos for proof for testing"
  },
  {
    "startMs": 975759,
    "text": "all the things that could help a"
  },
  {
    "startMs": 977519,
    "text": "reviewer and then ultimately how far do"
  },
  {
    "startMs": 980639,
    "text": "you go several people tell me like hey"
  },
  {
    "startMs": 983600,
    "text": "I'm not looking at the code anymore and"
  },
  {
    "startMs": 985759,
    "text": "I asked them okay you know but what is"
  },
  {
    "startMs": 988079,
    "text": "the impact of this going to production"
  },
  {
    "startMs": 992000,
    "text": "some documentation"
  },
  {
    "startMs": 994560,
    "text": "that is limited impact maybe you know"
  },
  {
    "startMs": 997440,
    "text": "some don't have real customers which is"
  },
  {
    "startMs": 1000320,
    "text": "also great right like the impact is not"
  },
  {
    "startMs": 1002399,
    "text": "a lot but if you really start thinking"
  },
  {
    "startMs": 1004720,
    "text": "about what you're doing is you're"
  },
  {
    "startMs": 1006800,
    "text": "selecting by what risk you can take. So"
  },
  {
    "startMs": 1010800,
    "text": "some of the tests will kind of say well"
  },
  {
    "startMs": 1013519,
    "text": "if it's maybe in the documentation part"
  },
  {
    "startMs": 1015680,
    "text": "you can go ahead if it's like a a more"
  },
  {
    "startMs": 1018480,
    "text": "impact fail change like within"
  },
  {
    "startMs": 1021120,
    "text": "authentication you kind of do more kind"
  },
  {
    "startMs": 1024160,
    "text": "of review by human and sometimes there's"
  },
  {
    "startMs": 1026720,
    "text": "a middle ground hey this feature can"
  },
  {
    "startMs": 1028959,
    "text": "just roll out we'll check what the"
  },
  {
    "startMs": 1030880,
    "text": "output is whether there's any errors"
  },
  {
    "startMs": 1032880,
    "text": "like gradual releases. So instead of"
  },
  {
    "startMs": 1035520,
    "text": "only optimizing for quality and reducing"
  },
  {
    "startMs": 1038400,
    "text": "of the likelihood, you also kind of have"
  },
  {
    "startMs": 1041439,
    "text": "a way of looking at it from a risk"
  },
  {
    "startMs": 1043760,
    "text": "perspective. And when it moves out of"
  },
  {
    "startMs": 1046559,
    "text": "production, you know, you can also see"
  },
  {
    "startMs": 1049120,
    "text": "how you can mitigate the risk, right?"
  },
  {
    "startMs": 1051760,
    "text": "Because if the impact is that you uh"
  },
  {
    "startMs": 1055120,
    "text": "lose data, do you have a fast restore"
  },
  {
    "startMs": 1057760,
    "text": "strategy? uh or you can think about this"
  },
  {
    "startMs": 1060640,
    "text": "like what if one node fails or can I"
  },
  {
    "startMs": 1063120,
    "text": "fast roll back those are architectural"
  },
  {
    "startMs": 1065840,
    "text": "decisions as well. So what you want to"
  },
  {
    "startMs": 1067919,
    "text": "do is when things go wrong you want to"
  },
  {
    "startMs": 1070400,
    "text": "have it being cheap to restore or to fix"
  },
  {
    "startMs": 1074000,
    "text": "and that is important in not only"
  },
  {
    "startMs": 1076960,
    "text": "optimizing but there's multiple ways of"
  },
  {
    "startMs": 1079200,
    "text": "kind of dealing with the risk on the PR"
  },
  {
    "startMs": 1081280,
    "text": "review."
  },
  {
    "startMs": 1083280,
    "text": "Now, one of the funny things when you"
  },
  {
    "startMs": 1085120,
    "text": "work in a multiplayer factory is that um"
  },
  {
    "startMs": 1088400,
    "text": "you know before people were chatting and"
  },
  {
    "startMs": 1091200,
    "text": "I personally for example work remote"
  },
  {
    "startMs": 1093440,
    "text": "where most of the team is in a central"
  },
  {
    "startMs": 1096000,
    "text": "place in London. Now they get together"
  },
  {
    "startMs": 1098559,
    "text": "they do a lot of chats and so on and me"
  },
  {
    "startMs": 1101120,
    "text": "sometimes from remote I had a hard time"
  },
  {
    "startMs": 1103280,
    "text": "catching up what has changed. Now, when"
  },
  {
    "startMs": 1105679,
    "text": "you turn on the multiplayer factory,"
  },
  {
    "startMs": 1107919,
    "text": "everybody needs to keep up, right?"
  },
  {
    "startMs": 1109919,
    "text": "There's so much code being produced that"
  },
  {
    "startMs": 1112080,
    "text": "maybe marketing support and other places"
  },
  {
    "startMs": 1115919,
    "text": "can't keep up. They need to have a"
  },
  {
    "startMs": 1118480,
    "text": "translation in their changes that have"
  },
  {
    "startMs": 1121280,
    "text": "happened in their language. So,"
  },
  {
    "startMs": 1123600,
    "text": "communication and radiating change is"
  },
  {
    "startMs": 1126400,
    "text": "actually a very important feature in a"
  },
  {
    "startMs": 1128480,
    "text": "multiplayer factory. How do you keep up"
  },
  {
    "startMs": 1131039,
    "text": "within your domain within your"
  },
  {
    "startMs": 1132960,
    "text": "understanding for your part of the job?"
  },
  {
    "startMs": 1136880,
    "text": "Now in a nutshell you can do a lot of"
  },
  {
    "startMs": 1139520,
    "text": "automation and you will use a lot of"
  },
  {
    "startMs": 1142160,
    "text": "skills uh and that like context and"
  },
  {
    "startMs": 1144799,
    "text": "better improvement uh on those pieces"
  },
  {
    "startMs": 1147440,
    "text": "and you kind of reserve the people for"
  },
  {
    "startMs": 1149919,
    "text": "the exceptions and that's the way that I"
  },
  {
    "startMs": 1152320,
    "text": "want you to think about is automate what"
  },
  {
    "startMs": 1154400,
    "text": "you can but make sure you are able to"
  },
  {
    "startMs": 1156880,
    "text": "route to a human to make the right"
  },
  {
    "startMs": 1159039,
    "text": "decision"
  },
  {
    "startMs": 1162000,
    "text": "with all that infrastructure with all"
  },
  {
    "startMs": 1164000,
    "text": "those kind of ways of working together."
  },
  {
    "startMs": 1166160,
    "text": "Um there is kind of a new team that is"
  },
  {
    "startMs": 1169039,
    "text": "forming which is almost like the factory"
  },
  {
    "startMs": 1171600,
    "text": "team uh similar to a platform team that"
  },
  {
    "startMs": 1174799,
    "text": "was dealing with a kubernetes or with a"
  },
  {
    "startMs": 1177120,
    "text": "cluster or with the cloud but right now"
  },
  {
    "startMs": 1180160,
    "text": "this is they are dealing with the coding"
  },
  {
    "startMs": 1183039,
    "text": "agents and the coding fabric of working"
  },
  {
    "startMs": 1185760,
    "text": "all together. They make sure that who"
  },
  {
    "startMs": 1187840,
    "text": "owns the skills the context is up to"
  },
  {
    "startMs": 1190480,
    "text": "date. they make sure that things are"
  },
  {
    "startMs": 1192000,
    "text": "connected to the right pieces uh and"
  },
  {
    "startMs": 1194480,
    "text": "that the whole factory also itself is"
  },
  {
    "startMs": 1197280,
    "text": "being maintained uh and being monitored"
  },
  {
    "startMs": 1199919,
    "text": "as well."
  },
  {
    "startMs": 1202000,
    "text": "So this is a nutshell. There's a lot"
  },
  {
    "startMs": 1204080,
    "text": "more to it, but this was in a nutshell"
  },
  {
    "startMs": 1206240,
    "text": "two things like the pressure is building"
  },
  {
    "startMs": 1208400,
    "text": "up on agents working more together in"
  },
  {
    "startMs": 1210960,
    "text": "the codebase and then the humans also"
  },
  {
    "startMs": 1214000,
    "text": "kind of working with the agents more and"
  },
  {
    "startMs": 1216400,
    "text": "more together in a concurrent way and"
  },
  {
    "startMs": 1219280,
    "text": "delivering more output at the same time."
  },
  {
    "startMs": 1221600,
    "text": "And for that there needs to be a lot of"
  },
  {
    "startMs": 1224400,
    "text": "change. Now one of the things that we're"
  },
  {
    "startMs": 1226960,
    "text": "playing now with is they're not just the"
  },
  {
    "startMs": 1229520,
    "text": "coding agents. They're not just the"
  },
  {
    "startMs": 1231520,
    "text": "people that do things in the board. Now"
  },
  {
    "startMs": 1234799,
    "text": "they're being those personal agents and"
  },
  {
    "startMs": 1237039,
    "text": "they will work in the uh board. They"
  },
  {
    "startMs": 1239360,
    "text": "will make decisions for you. They will"
  },
  {
    "startMs": 1241280,
    "text": "provide answers to other agents as well."
  },
  {
    "startMs": 1244080,
    "text": "This is a new way of building. This is a"
  },
  {
    "startMs": 1247360,
    "text": "new way of kind of delegating some of"
  },
  {
    "startMs": 1250240,
    "text": "the tasks that you are doing in the"
  },
  {
    "startMs": 1252240,
    "text": "factory."
  },
  {
    "startMs": 1253760,
    "text": "So my advice is brace yourself. We're"
  },
  {
    "startMs": 1256880,
    "text": "not there yet. like the coding agent"
  },
  {
    "startMs": 1258880,
    "text": "were a good step on your solo factories."
  },
  {
    "startMs": 1261520,
    "text": "Multiplayer factories will bring new"
  },
  {
    "startMs": 1263600,
    "text": "dynamics both to the agents coding and"
  },
  {
    "startMs": 1266240,
    "text": "both to the organizational working"
  },
  {
    "startMs": 1268240,
    "text": "together. And that's it and thank you"
  },
  {
    "startMs": 1271120,
    "text": "very much for listening. You can kind of"
  },
  {
    "startMs": 1273760,
    "text": "find the slides by asking uh to me in DM"
  },
  {
    "startMs": 1277840,
    "text": "on LinkedIn. I happily send you in"
  },
  {
    "startMs": 1279919,
    "text": "exchange for some feedback. Um and you"
  },
  {
    "startMs": 1282880,
    "text": "know you can of course try the Tesla"
  },
  {
    "startMs": 1284799,
    "text": "factory where we implement and uh are"
  },
  {
    "startMs": 1287520,
    "text": "working on kind of loops factories and"
  },
  {
    "startMs": 1289840,
    "text": "skills uh for you uh being in a"
  },
  {
    "startMs": 1293039,
    "text": "multiplayer mode and I'd also uh shared"
  },
  {
    "startMs": 1296240,
    "text": "the research at a site on concurrent.cd"
  },
  {
    "startMs": 1299360,
    "text": "where I find like people and uh tools"
  },
  {
    "startMs": 1302159,
    "text": "and techniques that people are solving"
  },
  {
    "startMs": 1304799,
    "text": "uh this concurrency all together. Thank"
  },
  {
    "startMs": 1307280,
    "text": "you very very much for listening and I"
  },
  {
    "startMs": 1309760,
    "text": "hope you learned some of the new things"
  },
  {
    "startMs": 1311600,
    "text": "today and feel free to leave uh some"
  },
  {
    "startMs": 1314320,
    "text": "comments and I'll happily have a look"
  },
  {
    "startMs": 1316720,
    "text": "and respond to that. Thank you very"
  },
  {
    "startMs": 1318400,
    "text": "much."
  }
]
