[
  {
    "startMs": 1309,
    "text": "[music]"
  },
  {
    "startMs": 12480,
    "text": "So, my name is Ryan Carson. I'm the"
  },
  {
    "startMs": 14400,
    "text": "founder and CEO of Untangle. So, we're"
  },
  {
    "startMs": 18000,
    "text": "building an AI parallegal specifically"
  },
  {
    "startMs": 20080,
    "text": "for family law, uh, focusing on divorce"
  },
  {
    "startMs": 23039,
    "text": "in particular. Um, so, quick audience"
  },
  {
    "startMs": 25680,
    "text": "poll. Who has been divorced? Raise your"
  },
  {
    "startMs": 27680,
    "text": "hand. Raise it. Be don't be shy. Raise"
  },
  {
    "startMs": 29760,
    "text": "your hand. Who's been divorced? Okay,"
  },
  {
    "startMs": 30960,
    "text": "keep your hands up. Who knows somebody"
  },
  {
    "startMs": 32559,
    "text": "that's been divorced? Raise your hand."
  },
  {
    "startMs": 34800,
    "text": "Everybody. Yeah. So, for you watching"
  },
  {
    "startMs": 36480,
    "text": "the video, everyone raised their hand by"
  },
  {
    "startMs": 37840,
    "text": "the end. Divorce touches a lot of"
  },
  {
    "startMs": 39360,
    "text": "people. Um, two of my sisters got"
  },
  {
    "startMs": 41680,
    "text": "divorced. My parents got divorced. Um,"
  },
  {
    "startMs": 43760,
    "text": "and it's one of the most painful things"
  },
  {
    "startMs": 45760,
    "text": "in your whole life. And I wanted to work"
  },
  {
    "startMs": 47360,
    "text": "on that problem and just make it a"
  },
  {
    "startMs": 49120,
    "text": "little less painful. Um, started off as"
  },
  {
    "startMs": 51760,
    "text": "a consumer app. Uh, quickly pivoted to"
  },
  {
    "startMs": 53760,
    "text": "B2B and we sell to family law firms now."
  },
  {
    "startMs": 56000,
    "text": "And thankfully product market fit is"
  },
  {
    "startMs": 58320,
    "text": "there and we're growing really fast. So"
  },
  {
    "startMs": 60160,
    "text": "that's really fun. Um so I've built and"
  },
  {
    "startMs": 64239,
    "text": "sold four companies. Um my last startup"
  },
  {
    "startMs": 66640,
    "text": "we scaled to about 110 people and I"
  },
  {
    "startMs": 69360,
    "text": "learned a lot about managing people and"
  },
  {
    "startMs": 71439,
    "text": "it turns out managing people is like"
  },
  {
    "startMs": 73439,
    "text": "managing agents. And so I'm going to"
  },
  {
    "startMs": 74960,
    "text": "share with you how we manage agents at"
  },
  {
    "startMs": 77280,
    "text": "Untangle and how everything I've learned"
  },
  {
    "startMs": 79759,
    "text": "uh managing people kind of fits there."
  },
  {
    "startMs": 82159,
    "text": "So I'm hoping to teach you some of those"
  },
  {
    "startMs": 83600,
    "text": "things. Um, I'm also going to show you"
  },
  {
    "startMs": 86000,
    "text": "how we hire. I I think hiring is very"
  },
  {
    "startMs": 88560,
    "text": "different in the age of agents. Um, I've"
  },
  {
    "startMs": 90479,
    "text": "hired a lot of people over my career."
  },
  {
    "startMs": 92240,
    "text": "Um, I've made a lot of mistakes and I'm"
  },
  {
    "startMs": 94159,
    "text": "going to share how we're hiring now at"
  },
  {
    "startMs": 95759,
    "text": "Untangle and I think how it's really"
  },
  {
    "startMs": 97040,
    "text": "working. Um, and then I'm going to show"
  },
  {
    "startMs": 98799,
    "text": "you a live demo."
  },
  {
    "startMs": 101280,
    "text": "So, let's get started. This is me on X"
  },
  {
    "startMs": 105040,
    "text": "and this is Untangle. If you want to"
  },
  {
    "startMs": 106320,
    "text": "know more about us,"
  },
  {
    "startMs": 109520,
    "text": "if my little clicker works, you can do"
  },
  {
    "startMs": 111759,
    "text": "it."
  },
  {
    "startMs": 115360,
    "text": "Okay, so what does the org chart look"
  },
  {
    "startMs": 118960,
    "text": "like now in the age of agents? How do"
  },
  {
    "startMs": 121119,
    "text": "you run your agents? Um, so the way we"
  },
  {
    "startMs": 124159,
    "text": "do it is pretty straightforward. So we"
  },
  {
    "startMs": 125680,
    "text": "have humans at the top. Um, and"
  },
  {
    "startMs": 127600,
    "text": "obviously we set priorities, we talk to"
  },
  {
    "startMs": 129280,
    "text": "our customers, we're doing all the human"
  },
  {
    "startMs": 130640,
    "text": "stuff, but what we use are manager"
  },
  {
    "startMs": 133120,
    "text": "agents and these are literally just"
  },
  {
    "startMs": 134720,
    "text": "sessions. So we use Devon. Love Devon."
  },
  {
    "startMs": 137520,
    "text": "We do all our engine the cloud. Um, I've"
  },
  {
    "startMs": 140160,
    "text": "done [clears throat] everything, you"
  },
  {
    "startMs": 141440,
    "text": "know, from coding by hand to, you know,"
  },
  {
    "startMs": 144000,
    "text": "using cursor to here and we're in Devon."
  },
  {
    "startMs": 146400,
    "text": "But we have a manager session. I'm going"
  },
  {
    "startMs": 148080,
    "text": "to show you this. It's literally just a"
  },
  {
    "startMs": 149280,
    "text": "session. I I call it engineer manager."
  },
  {
    "startMs": 152080,
    "text": "Um, and it never writes code. And I"
  },
  {
    "startMs": 154560,
    "text": "mostly talk to this agent. Um, and it"
  },
  {
    "startMs": 157040,
    "text": "manages a bunch of children. So, I'll"
  },
  {
    "startMs": 158400,
    "text": "talk to you how about how we do that. We"
  },
  {
    "startMs": 160400,
    "text": "also I mostly use audio to manage this"
  },
  {
    "startMs": 163360,
    "text": "agent. Um, I don't know about you, but"
  },
  {
    "startMs": 166480,
    "text": "I'm not a fast reader. I'm definitely"
  },
  {
    "startMs": 168239,
    "text": "not an agent and I prefer audio. I can"
  },
  {
    "startMs": 170959,
    "text": "ingest audio a lot better for some"
  },
  {
    "startMs": 173599,
    "text": "reason than reading. So, I talk mostly"
  },
  {
    "startMs": 175840,
    "text": "to my manager agent over audio. I'll"
  },
  {
    "startMs": 178400,
    "text": "show you that. Um, I just find it I I"
  },
  {
    "startMs": 181440,
    "text": "can absorb it. I can understand it. I"
  },
  {
    "startMs": 183360,
    "text": "can see what's happening. It's much more"
  },
  {
    "startMs": 184959,
    "text": "natural. So, I'm going to show you that"
  },
  {
    "startMs": 186400,
    "text": "as well. Now, the manager agent uh"
  },
  {
    "startMs": 189280,
    "text": "primarily works from a ticket board. We"
  },
  {
    "startMs": 191120,
    "text": "use linear. Doesn't really matter what"
  },
  {
    "startMs": 193120,
    "text": "you use, but this is kind of the source"
  },
  {
    "startMs": 194879,
    "text": "of truth about what needs to be built."
  },
  {
    "startMs": 196959,
    "text": "every ticket should be one PR um which"
  },
  {
    "startMs": 199440,
    "text": "is how we we work and that the uh"
  },
  {
    "startMs": 201680,
    "text": "manager agent knows which tickets to"
  },
  {
    "startMs": 203599,
    "text": "pull based off dependencies. It's like"
  },
  {
    "startMs": 205519,
    "text": "pretty basic engineering manager stuff"
  },
  {
    "startMs": 207599,
    "text": "here, but this is where it gets"
  },
  {
    "startMs": 209519,
    "text": "interesting. So each manager agent uh"
  },
  {
    "startMs": 212239,
    "text": "concurrently manages up to about 20"
  },
  {
    "startMs": 215120,
    "text": "builder agents. Um this number varies"
  },
  {
    "startMs": 218319,
    "text": "like it can go anywhere from five to"
  },
  {
    "startMs": 220480,
    "text": "probably 25. Um, this is somewhat"
  },
  {
    "startMs": 223440,
    "text": "bottlenecked by your ability to talk to"
  },
  {
    "startMs": 225680,
    "text": "the manager agent and understand what's"
  },
  {
    "startMs": 227760,
    "text": "happening. Um, uh, I think if you push"
  },
  {
    "startMs": 231120,
    "text": "too hard on this, you you quickly spin"
  },
  {
    "startMs": 233280,
    "text": "out of control. Um, I find we can"
  },
  {
    "startMs": 236080,
    "text": "concurrently manage about 25 builders."
  },
  {
    "startMs": 238319,
    "text": "Um, now the key here is that the manager"
  },
  {
    "startMs": 241280,
    "text": "is talking to this these builders. You"
  },
  {
    "startMs": 242799,
    "text": "never go into these sessions. You never"
  },
  {
    "startMs": 244720,
    "text": "talk to them. You never manage them. You"
  },
  {
    "startMs": 246720,
    "text": "never do anything. Um, it's all done"
  },
  {
    "startMs": 248239,
    "text": "through the manager agent. And usually"
  },
  {
    "startMs": 250319,
    "text": "what it's doing is"
  },
  {
    "startMs": 252799,
    "text": "answering technical questions that don't"
  },
  {
    "startMs": 254400,
    "text": "I don't need to answer. Um or unblocking"
  },
  {
    "startMs": 257280,
    "text": "small things. Um I also have an"
  },
  {
    "startMs": 259519,
    "text": "automation that forces the manager agent"
  },
  {
    "startMs": 262240,
    "text": "to read all the children sessions every"
  },
  {
    "startMs": 264560,
    "text": "it's like every 15 minutes. This says"
  },
  {
    "startMs": 266240,
    "text": "10, but I've decided 15 is about the"
  },
  {
    "startMs": 268240,
    "text": "right call. You have to you have to"
  },
  {
    "startMs": 270720,
    "text": "build an automation. You can't trust"
  },
  {
    "startMs": 272639,
    "text": "your Androme your manager agent manager"
  },
  {
    "startMs": 275840,
    "text": "agent to do this right. It's not"
  },
  {
    "startMs": 278400,
    "text": "deterministic. So this is basically a"
  },
  {
    "startMs": 280240,
    "text": "script again in Devon. It has"
  },
  {
    "startMs": 282080,
    "text": "automations. You just tell it, hey,"
  },
  {
    "startMs": 284560,
    "text": "every 15 minutes go read every single"
  },
  {
    "startMs": 286400,
    "text": "child, push things along, keep things"
  },
  {
    "startMs": 289440,
    "text": "moving, right? Um, and then any"
  },
  {
    "startMs": 291759,
    "text": "questions go back to the manager agent."
  },
  {
    "startMs": 293360,
    "text": "So, who's tracking so far? Do you"
  },
  {
    "startMs": 295919,
    "text": "understand what I'm saying? Okay, good."
  },
  {
    "startMs": 297919,
    "text": "And probably a lot of you are doing"
  },
  {
    "startMs": 299040,
    "text": "this. I'm not claiming this is rocket"
  },
  {
    "startMs": 300560,
    "text": "science, but this is what we're doing"
  },
  {
    "startMs": 302400,
    "text": "right now in prod and it's working,"
  },
  {
    "startMs": 304240,
    "text": "right? Um, each of these builder agents"
  },
  {
    "startMs": 307360,
    "text": "uh has a a a review agent that it calls"
  },
  {
    "startMs": 310000,
    "text": "upon. Um, Devon has built-in reviews."
  },
  {
    "startMs": 312160,
    "text": "Probably every code harness you have has"
  },
  {
    "startMs": 314400,
    "text": "built-in reviewers. Um, we typically"
  },
  {
    "startMs": 317280,
    "text": "stick to a three uh review max where uh"
  },
  {
    "startMs": 321759,
    "text": "we allow the builders to loop about"
  },
  {
    "startMs": 323759,
    "text": "three times with reviews. If they still"
  },
  {
    "startMs": 326000,
    "text": "have any important bugs that have been"
  },
  {
    "startMs": 327840,
    "text": "fixed, after three, then they bubble"
  },
  {
    "startMs": 329759,
    "text": "that back up to the manager agent. And"
  },
  {
    "startMs": 331280,
    "text": "if the manager agent needs to, it"
  },
  {
    "startMs": 332800,
    "text": "bubbles it back up to me, right? Um,"
  },
  {
    "startMs": 335280,
    "text": "that seems to work pretty well."
  },
  {
    "startMs": 338560,
    "text": "Okay, so what's happening under the code"
  },
  {
    "startMs": 340320,
    "text": "under under the hood here? Like all the"
  },
  {
    "startMs": 341680,
    "text": "normal stuff, right? You've got code"
  },
  {
    "startMs": 342960,
    "text": "plus tests. You've got a QA agent. This"
  },
  {
    "startMs": 345520,
    "text": "is actually an additional uh process"
  },
  {
    "startMs": 348000,
    "text": "that we run. Um, it actually spins up a"
  },
  {
    "startMs": 350320,
    "text": "child of the builder to run QA. Um,"
  },
  {
    "startMs": 354800,
    "text": "y'all, this is cheap. like you should be"
  },
  {
    "startMs": 357440,
    "text": "spinning up as many agents as you can as"
  },
  {
    "startMs": 359600,
    "text": "long as you're not holding up your merge"
  },
  {
    "startMs": 361360,
    "text": "queue, right? So I this works well for"
  },
  {
    "startMs": 364000,
    "text": "us now. Um a a wonderful engineer named"
  },
  {
    "startMs": 367280,
    "text": "Dale recently joined. He helped install"
  },
  {
    "startMs": 369199,
    "text": "this QA process. I think it's working"
  },
  {
    "startMs": 371120,
    "text": "pretty well so far. The thing that"
  },
  {
    "startMs": 372720,
    "text": "you're all going to encounter is just"
  },
  {
    "startMs": 374080,
    "text": "merge Q slowdown. Um there's this fine"
  },
  {
    "startMs": 376720,
    "text": "balance of just, you know, pecking your"
  },
  {
    "startMs": 379840,
    "text": "PRs to death um versus just getting them"
  },
  {
    "startMs": 382400,
    "text": "merged, right? Um, the other thing I"
  },
  {
    "startMs": 385360,
    "text": "love, love, love, love is videos. So,"
  },
  {
    "startMs": 388560,
    "text": "Devon has this built in. Um, if not, you"
  },
  {
    "startMs": 391600,
    "text": "should build this. Um, it's hard. Um,"
  },
  {
    "startMs": 394400,
    "text": "every builder records a video of the"
  },
  {
    "startMs": 396880,
    "text": "feature being used and passing tests."
  },
  {
    "startMs": 399680,
    "text": "So, if it's a UI facing feature, you've"
  },
  {
    "startMs": 402639,
    "text": "got to look at it, right? Um, this is"
  },
  {
    "startMs": 405840,
    "text": "how we know that what we've built looks"
  },
  {
    "startMs": 407680,
    "text": "good, how it works, right? So, in Devon,"
  },
  {
    "startMs": 410319,
    "text": "it's a built-in feature. It's called"
  },
  {
    "startMs": 411440,
    "text": "test. And basically it it builds test"
  },
  {
    "startMs": 413520,
    "text": "cases and then it records a video and it"
  },
  {
    "startMs": 415919,
    "text": "gives you green or or red on those on"
  },
  {
    "startMs": 417919,
    "text": "those tests. And if you get a video"
  },
  {
    "startMs": 419360,
    "text": "that's all green, you can watch it and"
  },
  {
    "startMs": 421280,
    "text": "know what we think is happening is"
  },
  {
    "startMs": 423199,
    "text": "happening and visually it looks good."
  },
  {
    "startMs": 425039,
    "text": "Right? So this is the human in the loop"
  },
  {
    "startMs": 427360,
    "text": "where a human has to say ship it. So the"
  },
  {
    "startMs": 431039,
    "text": "manager session will will let me know"
  },
  {
    "startMs": 433599,
    "text": "there's a video ready for you. Watch it."
  },
  {
    "startMs": 435919,
    "text": "Right? So I watched the video and this"
  },
  {
    "startMs": 437919,
    "text": "is the hard part. you've got to zoom in"
  },
  {
    "startMs": 439280,
    "text": "and understand like what is this PR"
  },
  {
    "startMs": 440960,
    "text": "doing? Um what am I watching? Um so I"
  },
  {
    "startMs": 444639,
    "text": "usually read a summary of like what is"
  },
  {
    "startMs": 446240,
    "text": "this thing? What is it supposed to do? I"
  },
  {
    "startMs": 448319,
    "text": "watch it and I ga engage. And I would"
  },
  {
    "startMs": 450240,
    "text": "encourage you this is the part where you"
  },
  {
    "startMs": 451759,
    "text": "want to cut corners. You got to watch"
  },
  {
    "startMs": 453840,
    "text": "the video. Like there is no this is the"
  },
  {
    "startMs": 456800,
    "text": "part of the bottleneck you have to"
  },
  {
    "startMs": 458080,
    "text": "engage in as a product owner. Um got to"
  },
  {
    "startMs": 460880,
    "text": "watch the video, got to pay attention."
  },
  {
    "startMs": 462160,
    "text": "Usually it has to be on your laptop. Um"
  },
  {
    "startMs": 465440,
    "text": "I I I this literally before this talk I"
  },
  {
    "startMs": 467680,
    "text": "was on my phone you know talking to my"
  },
  {
    "startMs": 469440,
    "text": "manager my manager agent and it said"
  },
  {
    "startMs": 471680,
    "text": "there's a video for you. I watch it and"
  },
  {
    "startMs": 473599,
    "text": "I just couldn't see it well enough and I"
  },
  {
    "startMs": 475440,
    "text": "was so [snorts] tempted to be like it's"
  },
  {
    "startMs": 476720,
    "text": "okay ship [laughter] it like no get back"
  },
  {
    "startMs": 480080,
    "text": "to my machine watch the watch the video."
  },
  {
    "startMs": 482479,
    "text": "Um this is working like you know we we"
  },
  {
    "startMs": 486000,
    "text": "ship a lot of PRs uh at high quality"
  },
  {
    "startMs": 489280,
    "text": "this way. We've iterated, you know,"
  },
  {
    "startMs": 491520,
    "text": "hundreds of times on this process and I"
  },
  {
    "startMs": 493199,
    "text": "I feel pretty good about this. Now, this"
  },
  {
    "startMs": 494960,
    "text": "will change tomorrow [laughter] and"
  },
  {
    "startMs": 497280,
    "text": "probably will be useless a week from"
  },
  {
    "startMs": 498639,
    "text": "now. Uh, but it works well today. Um,"
  },
  {
    "startMs": 501919,
    "text": "uh, the thing I will say is like if"
  },
  {
    "startMs": 503360,
    "text": "you're coding locally, stop. Like, you"
  },
  {
    "startMs": 505440,
    "text": "really need to be coding with a a cloud"
  },
  {
    "startMs": 507599,
    "text": "agent. I don't care if it's Devon or"
  },
  {
    "startMs": 509440,
    "text": "whatever it is, but if you're running"
  },
  {
    "startMs": 511840,
    "text": "local dev, you are screwing up. You're"
  },
  {
    "startMs": 514240,
    "text": "holding yourself back. You're holding"
  },
  {
    "startMs": 515519,
    "text": "your team back. You're holding"
  },
  {
    "startMs": 516719,
    "text": "everything back because you can't do"
  },
  {
    "startMs": 518560,
    "text": "this. Um so that's where we're going and"
  },
  {
    "startMs": 521279,
    "text": "I feel strongly about that."
  },
  {
    "startMs": 523599,
    "text": "So how does this work at scale? Well,"
  },
  {
    "startMs": 525600,
    "text": "you know, say you have 10 folks um uh in"
  },
  {
    "startMs": 529519,
    "text": "the who are working on things. Typically"
  },
  {
    "startMs": 531600,
    "text": "they'll have an engineering manager uh"
  },
  {
    "startMs": 534800,
    "text": "session each. Sometimes they'll have two"
  },
  {
    "startMs": 536800,
    "text": "like right now I have two running. Um"
  },
  {
    "startMs": 539440,
    "text": "and what's beautiful is that these"
  },
  {
    "startMs": 541440,
    "text": "things talk to each other. And so uh"
  },
  {
    "startMs": 544640,
    "text": "again in Devon this is built in. It's"
  },
  {
    "startMs": 546480,
    "text": "probably built into whatever harness you"
  },
  {
    "startMs": 548160,
    "text": "use. the sessions all need to be able to"
  },
  {
    "startMs": 550000,
    "text": "talk to each other and they all need to"
  },
  {
    "startMs": 551360,
    "text": "know who each other is, right? And"
  },
  {
    "startMs": 554480,
    "text": "they're really good at this. Like this"
  },
  {
    "startMs": 556399,
    "text": "is such a delight. So what you'll see if"
  },
  {
    "startMs": 559279,
    "text": "if you if you zoom into any sessions,"
  },
  {
    "startMs": 561920,
    "text": "they're messaging each other. It's"
  },
  {
    "startMs": 563760,
    "text": "clear, it's straightforward, it's fast,"
  },
  {
    "startMs": 566160,
    "text": "it's good. Like you should be allowing"
  },
  {
    "startMs": 569040,
    "text": "your sessions to talk to each other. Um"
  },
  {
    "startMs": 571760,
    "text": "and again, if you're not, you are"
  },
  {
    "startMs": 573120,
    "text": "holding yourself back and you're"
  },
  {
    "startMs": 574399,
    "text": "probably shipping worse software. Um so"
  },
  {
    "startMs": 576640,
    "text": "they all talk a lot. Um, and it's not"
  },
  {
    "startMs": 578880,
    "text": "chitchat or stupid stuff like this is"
  },
  {
    "startMs": 581120,
    "text": "important stuff that they need to know"
  },
  {
    "startMs": 582800,
    "text": "to unblock each other. Um, which is very"
  },
  {
    "startMs": 585760,
    "text": "useful. However, you still need what we"
  },
  {
    "startMs": 588640,
    "text": "call a merge Q manager. Um,"
  },
  {
    "startMs": 591920,
    "text": "so this is how we coordinate this just"
  },
  {
    "startMs": 595600,
    "text": "wave of PRs that come in. You know, you"
  },
  {
    "startMs": 599040,
    "text": "have things like database migration"
  },
  {
    "startMs": 601440,
    "text": "numbers. These need to be coordinated."
  },
  {
    "startMs": 603200,
    "text": "Like if all the agents are trying to"
  },
  {
    "startMs": 604720,
    "text": "grab these things, you constantly"
  },
  {
    "startMs": 606160,
    "text": "collide, right? So the merge manager"
  },
  {
    "startMs": 608959,
    "text": "just helps all that go away. It also is"
  },
  {
    "startMs": 611600,
    "text": "a little more intelligent about how the"
  },
  {
    "startMs": 613040,
    "text": "merge Q is happening. So this is really"
  },
  {
    "startMs": 615839,
    "text": "nice. Um it's working well for us. And"
  },
  {
    "startMs": 618560,
    "text": "again, these are just sessions. This is"
  },
  {
    "startMs": 620079,
    "text": "not like something special. These are"
  },
  {
    "startMs": 622320,
    "text": "just sessions in Devon and I and I name"
  },
  {
    "startMs": 625279,
    "text": "them so I understand what's happening."
  },
  {
    "startMs": 627200,
    "text": "Um and it's pretty straightforward. You"
  },
  {
    "startMs": 630000,
    "text": "know, the talk from the gentleman from"
  },
  {
    "startMs": 631760,
    "text": "OpenAI, you know, said basically you got"
  },
  {
    "startMs": 633440,
    "text": "to unhobble. Just unhobble the thing,"
  },
  {
    "startMs": 635519,
    "text": "right? So set up the roles and then"
  },
  {
    "startMs": 639120,
    "text": "unhobble the model, right? Um, and I"
  },
  {
    "startMs": 641920,
    "text": "think just having a merge manager say,"
  },
  {
    "startMs": 643760,
    "text": "\"Hey, make all this better.\" Uh, really"
  },
  {
    "startMs": 645600,
    "text": "works well. All right. Who's tracking so"
  },
  {
    "startMs": 647920,
    "text": "far? Good. Who thinks this is [&nbsp;__&nbsp;]"
  },
  {
    "startMs": 652160,
    "text": "Raise your hand. Oh, one guy. Two. Wait."
  },
  {
    "startMs": 654880,
    "text": "One. Come on. Be be more brave. We have"
  },
  {
    "startMs": 658480,
    "text": "to talk afterwards. Where Where are you?"
  },
  {
    "startMs": 660079,
    "text": "Um, okay. And then we use GitHub merge"
  },
  {
    "startMs": 662720,
    "text": "cues. It's fine. It's not rocket"
  },
  {
    "startMs": 664800,
    "text": "science. It works pretty well. So,"
  },
  {
    "startMs": 667839,
    "text": "all right. Next up, how we hire. Um, so"
  },
  {
    "startMs": 670880,
    "text": "who's hiring engineers or employees"
  },
  {
    "startMs": 672800,
    "text": "right now? Raise your hand. Yeah, decent"
  },
  {
    "startMs": 675200,
    "text": "number of you. Um, I think everything"
  },
  {
    "startMs": 677600,
    "text": "has changed. Every everything you used"
  },
  {
    "startMs": 679680,
    "text": "to do about hiring employees is over and"
  },
  {
    "startMs": 682240,
    "text": "none of it makes sense. Um, it's all"
  },
  {
    "startMs": 684240,
    "text": "outdated and I would encourage you to do"
  },
  {
    "startMs": 686160,
    "text": "something like this. So, we don't do"
  },
  {
    "startMs": 690399,
    "text": "number one any sort of pre-screens. We"
  },
  {
    "startMs": 692399,
    "text": "don't do any video chats. We don't do"
  },
  {
    "startMs": 694640,
    "text": "anything with people um it for most of"
  },
  {
    "startMs": 697760,
    "text": "this process because it will bias you."
  },
  {
    "startMs": 700399,
    "text": "You'll like their hobbies. You'll like"
  },
  {
    "startMs": 702079,
    "text": "the way they talk to you. You'll think"
  },
  {
    "startMs": 704000,
    "text": "they're interesting. And it's all noise."
  },
  {
    "startMs": 706240,
    "text": "None of it is signal, right? All that"
  },
  {
    "startMs": 708320,
    "text": "matters is can they operate an agent,"
  },
  {
    "startMs": 711839,
    "text": "right? Can they do that? So, the way we"
  },
  {
    "startMs": 714240,
    "text": "do that is we ask candidates to submit a"
  },
  {
    "startMs": 717360,
    "text": "45ish minute video, whole screen"
  },
  {
    "startMs": 720560,
    "text": "recording. Um, and we ask them to ship a"
  },
  {
    "startMs": 723760,
    "text": "feature PR typically on a app that they"
  },
  {
    "startMs": 726800,
    "text": "already maintain and we just we just ask"
  },
  {
    "startMs": 729760,
    "text": "them to record that. No instruction, no"
  },
  {
    "startMs": 732560,
    "text": "guidance, no nothing. And we just want"
  },
  {
    "startMs": 734720,
    "text": "to see like how good of an agent"
  },
  {
    "startMs": 736079,
    "text": "operator is this person, right? So, um,"
  },
  {
    "startMs": 740240,
    "text": "that is free. We don't pay for that."
  },
  {
    "startMs": 741920,
    "text": "That's basically how you get in the"
  },
  {
    "startMs": 743200,
    "text": "door. Um, and what we then do is we feed"
  },
  {
    "startMs": 746160,
    "text": "these videos into a ranking agent and"
  },
  {
    "startMs": 748560,
    "text": "basically say watch the video, watch the"
  },
  {
    "startMs": 750160,
    "text": "transcript, stack rank these people. Um,"
  },
  {
    "startMs": 753519,
    "text": "now this what's interesting is I did"
  },
  {
    "startMs": 755440,
    "text": "this and I didn't trust it the first"
  },
  {
    "startMs": 757680,
    "text": "time. I didn't like what it said. Um,"
  },
  {
    "startMs": 761600,
    "text": "and what's ironic is it actually was"
  },
  {
    "startMs": 763600,
    "text": "correct. Like the person that was number"
  },
  {
    "startMs": 765680,
    "text": "one, I I should have hired them. Um, uh,"
  },
  {
    "startMs": 768480,
    "text": "but I didn't trust it because I was I"
  },
  {
    "startMs": 770560,
    "text": "was biased. So you stack rank them. Now,"
  },
  {
    "startMs": 773200,
    "text": "this is just a lot of video to watch."
  },
  {
    "startMs": 774560,
    "text": "You could watch all these videos if you"
  },
  {
    "startMs": 776000,
    "text": "want. If you have time, do it. But I"
  },
  {
    "startMs": 778240,
    "text": "think you'll find actually a very"
  },
  {
    "startMs": 780079,
    "text": "intelligent model is pretty good at"
  },
  {
    "startMs": 781360,
    "text": "understanding like how how good is this"
  },
  {
    "startMs": 783839,
    "text": "person. Um, what's interesting though is"
  },
  {
    "startMs": 786399,
    "text": "uh candidates will mumble um or uh"
  },
  {
    "startMs": 790079,
    "text": "sometimes or they won't think out loud,"
  },
  {
    "startMs": 791920,
    "text": "which is kind of fascinating. So, you"
  },
  {
    "startMs": 793120,
    "text": "can't really tell what they're thinking"
  },
  {
    "startMs": 794240,
    "text": "or doing. Um, which is interesting. So,"
  },
  {
    "startMs": 796800,
    "text": "that's uh something to sort of note. Um,"
  },
  {
    "startMs": 799920,
    "text": "and some talk a lot. [laughter] So, you"
  },
  {
    "startMs": 803360,
    "text": "never know. Uh, then we basically pick"
  },
  {
    "startMs": 805360,
    "text": "the top five and we invite them to a"
  },
  {
    "startMs": 807279,
    "text": "paid project. So, we pay them a fixed"
  },
  {
    "startMs": 808880,
    "text": "fee for 16 hours of their time. We"
  },
  {
    "startMs": 811440,
    "text": "actually give them a seat on Devon and"
  },
  {
    "startMs": 813279,
    "text": "we ask them to uh to get a real PR ready"
  },
  {
    "startMs": 817839,
    "text": "for merge. Um, we have them sign an NDA."
  },
  {
    "startMs": 820800,
    "text": "Um, and we record all the video. This is"
  },
  {
    "startMs": 824079,
    "text": "16 hours of video. Um, we basically use"
  },
  {
    "startMs": 826880,
    "text": "Loom and then uh we feed all the videos"
  },
  {
    "startMs": 829519,
    "text": "into uh our our agent basically Devon"
  },
  {
    "startMs": 832720,
    "text": "and we say hey who you know which one"
  },
  {
    "startMs": 834639,
    "text": "should we pick? I actually watched all"
  },
  {
    "startMs": 837360,
    "text": "16 hours of these videos for the last"
  },
  {
    "startMs": 839279,
    "text": "round. Uh it was brutal but it did give"
  },
  {
    "startMs": 841360,
    "text": "me a good read on the people. Um and"
  },
  {
    "startMs": 844320,
    "text": "then you basically pick one. You pick"
  },
  {
    "startMs": 846079,
    "text": "your finalists and then what's important"
  },
  {
    "startMs": 849279,
    "text": "is that you don't do calls before this."
  },
  {
    "startMs": 852639,
    "text": "Um you will get biased. you'll get"
  },
  {
    "startMs": 854639,
    "text": "confused. You'll try to pick somebody"
  },
  {
    "startMs": 856800,
    "text": "you shouldn't. And I would just call the"
  },
  {
    "startMs": 859279,
    "text": "finalists and say, \"Hey, you know, we"
  },
  {
    "startMs": 862079,
    "text": "think we'd like to hire you. Let's talk"
  },
  {
    "startMs": 863360,
    "text": "a little bit.\" Um, and that gives you"
  },
  {
    "startMs": 866240,
    "text": "the final sort of human read, but you're"
  },
  {
    "startMs": 867680,
    "text": "going to watch videos of these people"
  },
  {
    "startMs": 868800,
    "text": "for hours. Like, you're not really going"
  },
  {
    "startMs": 870240,
    "text": "to need that call. Um, but I think"
  },
  {
    "startMs": 872240,
    "text": "there's a little bit of of of human"
  },
  {
    "startMs": 873839,
    "text": "connection there that's important."
  },
  {
    "startMs": 876399,
    "text": "I think this is how everyone's going to"
  },
  {
    "startMs": 877680,
    "text": "hire. Like, this works. Um, you know,"
  },
  {
    "startMs": 880560,
    "text": "I've hired hundreds and hundreds and"
  },
  {
    "startMs": 882320,
    "text": "hundreds of people in my career."
  },
  {
    "startMs": 884800,
    "text": "This is just way easier and way better."
  },
  {
    "startMs": 886720,
    "text": "Um, and I think it's where we're all"
  },
  {
    "startMs": 888399,
    "text": "moving to. So,"
  },
  {
    "startMs": 892399,
    "text": "I'm actually going to finish 3 minutes"
  },
  {
    "startMs": 893839,
    "text": "early. Um, if you want to know more"
  },
  {
    "startMs": 896320,
    "text": "about Untangle, just go to Untangle. Um,"
  },
  {
    "startMs": 898800,
    "text": "I'm on X like just all the time. I"
  },
  {
    "startMs": 900959,
    "text": "literally been on X for 20 years. Um,"
  },
  {
    "startMs": 903360,
    "text": "and so, uh, that's where I live and"
  },
  {
    "startMs": 905120,
    "text": "breathe. So, if you want to know more"
  },
  {
    "startMs": 906639,
    "text": "about uh leading companies, managing"
  },
  {
    "startMs": 909760,
    "text": "agents, um that's where I am. If you're"
  },
  {
    "startMs": 912320,
    "text": "interested in family law and you're"
  },
  {
    "startMs": 914639,
    "text": "passionate about making divorce less"
  },
  {
    "startMs": 916160,
    "text": "painful, um get in touch. Um and that is"
  },
  {
    "startMs": 919920,
    "text": "all I have to say. Thanks everybody."
  },
  {
    "startMs": 921519,
    "text": "Appreciate it. [applause]"
  }
]
