[
  {
    "startMs": 640,
    "text": "Let me start with one number from last"
  },
  {
    "startMs": 2480,
    "text": "month. On average, more than one agent"
  },
  {
    "startMs": 5759,
    "text": "has started on our platform every single"
  },
  {
    "startMs": 8160,
    "text": "minute, day and night."
  },
  {
    "startMs": 11360,
    "text": "And honestly, the agents were the easy"
  },
  {
    "startMs": 13920,
    "text": "part."
  },
  {
    "startMs": 15920,
    "text": "Hi, I'm Joey. I bu the cloud agent"
  },
  {
    "startMs": 19279,
    "text": "platform we built inside Harvey."
  },
  {
    "startMs": 21920,
    "text": "After 10,000 PRs, the biggest lesson I"
  },
  {
    "startMs": 25359,
    "text": "can share is this. The thing that broke"
  },
  {
    "startMs": 28000,
    "text": "was an agent. It was everything around"
  },
  {
    "startMs": 31039,
    "text": "them."
  },
  {
    "startMs": 33120,
    "text": "So, what does one submit add up to?"
  },
  {
    "startMs": 36239,
    "text": "10,000 PRs that an agent wrote. And it"
  },
  {
    "startMs": 40640,
    "text": "isn't just Tavac team playing with a"
  },
  {
    "startMs": 43200,
    "text": "toy. Last month, about 460 different"
  },
  {
    "startMs": 47440,
    "text": "people at Harvey use it. And over the"
  },
  {
    "startMs": 51440,
    "text": "summer, it stopped being only about"
  },
  {
    "startMs": 53440,
    "text": "code. People started asking a data"
  },
  {
    "startMs": 56320,
    "text": "question in Slack and getting answers"
  },
  {
    "startMs": 58640,
    "text": "back. My favorite recently someone on"
  },
  {
    "startMs": 62480,
    "text": "our marketing team dropped a prototype"
  },
  {
    "startMs": 64239,
    "text": "and a talk track into Slack and ask for"
  },
  {
    "startMs": 67439,
    "text": "a story book for a product video."
  },
  {
    "startMs": 70400,
    "text": "Once the harness exists, people bring"
  },
  {
    "startMs": 72799,
    "text": "the work that you never planned for."
  },
  {
    "startMs": 76640,
    "text": "So a promise up front. This is not a"
  },
  {
    "startMs": 79439,
    "text": "talk about models, evos or leaderboard."
  },
  {
    "startMs": 82320,
    "text": "This is talk about hardness,"
  },
  {
    "startMs": 85759,
    "text": "odd things around the model,"
  },
  {
    "startMs": 89040,
    "text": "checking out the ripple, holding the"
  },
  {
    "startMs": 90880,
    "text": "key, opening the PR, getting the merged."
  },
  {
    "startMs": 94320,
    "text": "When we first wrote about Spectre back"
  },
  {
    "startMs": 96240,
    "text": "in April, we put it like this. At some"
  },
  {
    "startMs": 100079,
    "text": "point, a harness become the product."
  },
  {
    "startMs": 103759,
    "text": "Now, whenever I tell people this, I get"
  },
  {
    "startMs": 106079,
    "text": "the same question. Why on earth would"
  },
  {
    "startMs": 108399,
    "text": "you build this when clock or cursor"
  },
  {
    "startMs": 111119,
    "text": "already exist?"
  },
  {
    "startMs": 113439,
    "text": "My answer, we don't compete with them."
  },
  {
    "startMs": 116240,
    "text": "We run them. And here's how I see it as"
  },
  {
    "startMs": 119520,
    "text": "my own view. Agents on your laptop are"
  },
  {
    "startMs": 122640,
    "text": "powerful, but they don't scale. You can"
  },
  {
    "startMs": 125439,
    "text": "realistically run five to 10 of them."
  },
  {
    "startMs": 128399,
    "text": "Pass that you need a cloud. And cloud"
  },
  {
    "startMs": 131120,
    "text": "needs our secrets, our real stack, our"
  },
  {
    "startMs": 134720,
    "text": "alerts and tickets, one set of rules and"
  },
  {
    "startMs": 138160,
    "text": "enough capacity that nobody gets"
  },
  {
    "startMs": 140480,
    "text": "starved. Those single two owns that for"
  },
  {
    "startMs": 143360,
    "text": "us. So we build layer and that layer"
  },
  {
    "startMs": 146400,
    "text": "exactly what broke. So I want to tell"
  },
  {
    "startMs": 149280,
    "text": "three stories today. How we stopped"
  },
  {
    "startMs": 152160,
    "text": "competing on writing code. how we let"
  },
  {
    "startMs": 154800,
    "text": "any agent drive and were broke once they"
  },
  {
    "startMs": 158640,
    "text": "did. The first story start with the"
  },
  {
    "startMs": 161599,
    "text": "question we keep hearing."
  },
  {
    "startMs": 164480,
    "text": "More of our engineers were using cursor"
  },
  {
    "startMs": 167440,
    "text": "and they ask how do I get our secret"
  },
  {
    "startMs": 170720,
    "text": "there? How do I test against our real"
  },
  {
    "startMs": 172959,
    "text": "stack? We could have rebuilt all that"
  },
  {
    "startMs": 176000,
    "text": "inside cursor and then again for next to"
  },
  {
    "startMs": 179280,
    "text": "and the one after that."
  },
  {
    "startMs": 181920,
    "text": "Instead, the answer became one sentence."
  },
  {
    "startMs": 184879,
    "text": "Just ask cursor to use vector."
  },
  {
    "startMs": 188239,
    "text": "And that's really the whole idea. People"
  },
  {
    "startMs": 190640,
    "text": "will always have a favorite agent and"
  },
  {
    "startMs": 193120,
    "text": "the favorite keeps changing. So pick"
  },
  {
    "startMs": 195519,
    "text": "yours. Cloud code, codeex, cursor, trag"
  },
  {
    "startMs": 199440,
    "text": "your own hands."
  },
  {
    "startMs": 201519,
    "text": "Start on your laptop, push the session"
  },
  {
    "startMs": 203840,
    "text": "to the cloud, put it back. That's how"
  },
  {
    "startMs": 207040,
    "text": "Spectre sits underneath all of that."
  },
  {
    "startMs": 210080,
    "text": "Because once the code was written, the"
  },
  {
    "startMs": 212239,
    "text": "real group starts"
  },
  {
    "startMs": 214319,
    "text": "picture appears day. Alert files in"
  },
  {
    "startMs": 217680,
    "text": "Slack at 2 in the morning. An agent"
  },
  {
    "startMs": 220640,
    "text": "picks up nobody typing. It writes a fix,"
  },
  {
    "startMs": 224879,
    "text": "spins up real copy of our stack and post"
  },
  {
    "startMs": 228080,
    "text": "the proof on the PR. When CI fails, the"
  },
  {
    "startMs": 232000,
    "text": "follow-up loop reads the failure and"
  },
  {
    "startMs": 234000,
    "text": "pushes another fix while everyone still"
  },
  {
    "startMs": 236799,
    "text": "sleep. By morning, the PR sits in one"
  },
  {
    "startMs": 240480,
    "text": "review queue under the same rule as"
  },
  {
    "startMs": 242879,
    "text": "other PR whichever agents wrote it. The"
  },
  {
    "startMs": 247439,
    "text": "owner gets a notch and only once your"
  },
  {
    "startMs": 250239,
    "text": "working day starts and once approved a"
  },
  {
    "startMs": 253840,
    "text": "agent can automerge it."
  },
  {
    "startMs": 257759,
    "text": "If you only build one of those stages"
  },
  {
    "startMs": 260320,
    "text": "that I described, build a follow-up"
  },
  {
    "startMs": 262560,
    "text": "loop. We switched on for everyone in"
  },
  {
    "startMs": 265520,
    "text": "early October and that months. Four out"
  },
  {
    "startMs": 268320,
    "text": "of five agent PRs merged into our"
  },
  {
    "startMs": 270720,
    "text": "backend PR had been through it."
  },
  {
    "startMs": 275040,
    "text": "That's the difference between agent that"
  },
  {
    "startMs": 276720,
    "text": "write code and an agent that finished"
  },
  {
    "startMs": 279520,
    "text": "the job."
  },
  {
    "startMs": 281520,
    "text": "And then there's the knowledge. Every"
  },
  {
    "startMs": 283680,
    "text": "team has that one person who knows"
  },
  {
    "startMs": 285680,
    "text": "exactly how to test the tricky service."
  },
  {
    "startMs": 288080,
    "text": "Uh which flag you never touch. And that"
  },
  {
    "startMs": 291280,
    "text": "knowledge leaves in their head. of their"
  },
  {
    "startMs": 294000,
    "text": "laptop."
  },
  {
    "startMs": 295759,
    "text": "So we gave it a hope projects"
  },
  {
    "startMs": 299360,
    "text": "people write down what matters. Adrian"
  },
  {
    "startMs": 301919,
    "text": "write down what they learn. Team pings"
  },
  {
    "startMs": 304560,
    "text": "the skills you trust and there's a"
  },
  {
    "startMs": 306320,
    "text": "record of who rent what."
  },
  {
    "startMs": 309280,
    "text": "Any agent working in the project with"
  },
  {
    "startMs": 311039,
    "text": "the same page. My personal view"
  },
  {
    "startMs": 314160,
    "text": "whichever agent you pick the audit trail"
  },
  {
    "startMs": 316560,
    "text": "and the checks should be the same."
  },
  {
    "startMs": 319919,
    "text": "The second story is about rule. Back in"
  },
  {
    "startMs": 323600,
    "text": "May, if you want a spectctor to do"
  },
  {
    "startMs": 325600,
    "text": "something, you open a browser tab or"
  },
  {
    "startMs": 328720,
    "text": "tacking Slack. The whole month, exactly"
  },
  {
    "startMs": 332320,
    "text": "one task came out from terminal."
  },
  {
    "startMs": 335120,
    "text": "So, we made a rule. If a person can"
  },
  {
    "startMs": 337120,
    "text": "click it, an agent can call it."
  },
  {
    "startMs": 341039,
    "text": "Start a task. Turn on the follow-up loop"
  },
  {
    "startMs": 344240,
    "text": "on automerge, publish a page, all from"
  },
  {
    "startMs": 347600,
    "text": "CLI,"
  },
  {
    "startMs": 349120,
    "text": "which means your laptop agent can call"
  },
  {
    "startMs": 351199,
    "text": "it. A agent inside the sandbox can also"
  },
  {
    "startMs": 354400,
    "text": "call it. Even CI can call it too. And"
  },
  {
    "startMs": 357759,
    "text": "then people ran with it. By October, the"
  },
  {
    "startMs": 361280,
    "text": "command line was starting about 6,500 ts"
  },
  {
    "startMs": 364800,
    "text": "a month. The web app didn't shrink."
  },
  {
    "startMs": 368240,
    "text": "Everyone else just grew around it."
  },
  {
    "startMs": 371520,
    "text": "Task started from the terminal were"
  },
  {
    "startMs": 373520,
    "text": "merging mops and task started in browser"
  },
  {
    "startMs": 376400,
    "text": "and the new kind of users showed up."
  },
  {
    "startMs": 379120,
    "text": "People who start hundreds of tasks a"
  },
  {
    "startMs": 381600,
    "text": "month and never open the app at all."
  },
  {
    "startMs": 385039,
    "text": "And this is where it gets fun. In"
  },
  {
    "startMs": 387600,
    "text": "October, I had a big task. So I bought"
  },
  {
    "startMs": 391199,
    "text": "code session and asked to be the"
  },
  {
    "startMs": 392880,
    "text": "coordinator."
  },
  {
    "startMs": 394720,
    "text": "It split the tickets into 10 different"
  },
  {
    "startMs": 397039,
    "text": "milestones. K one for me and the rest to"
  },
  {
    "startMs": 401120,
    "text": "Spectre with hundreds of tasks. Each has"
  },
  {
    "startMs": 404639,
    "text": "its own sandbox to validate end to end."
  },
  {
    "startMs": 408240,
    "text": "Then at the end of the October, our it"
  },
  {
    "startMs": 410800,
    "text": "give everyone trag"
  },
  {
    "startMs": 413520,
    "text": "now watch Spectre for me. It list the"
  },
  {
    "startMs": 416240,
    "text": "question Spectre is waiting on draft my"
  },
  {
    "startMs": 418560,
    "text": "answers and once I say yes, send them"
  },
  {
    "startMs": 421360,
    "text": "back."
  },
  {
    "startMs": 423199,
    "text": "I actually DM to my friend like that. I"
  },
  {
    "startMs": 426560,
    "text": "just use cursor clock code or whatever"
  },
  {
    "startMs": 428880,
    "text": "to spam spectre. Now,"
  },
  {
    "startMs": 431599,
    "text": "well, that's the dream, but it's also"
  },
  {
    "startMs": 433440,
    "text": "the problem."
  },
  {
    "startMs": 435120,
    "text": "A quick detour. When we look at where"
  },
  {
    "startMs": 438160,
    "text": "our task time actually went, the slowest"
  },
  {
    "startMs": 440880,
    "text": "step wasn't model syncing. It was get"
  },
  {
    "startMs": 444240,
    "text": "just checking out every ripple we own"
  },
  {
    "startMs": 446319,
    "text": "took over a minute on average."
  },
  {
    "startMs": 450560,
    "text": "The fix keep a copy of every ripple on"
  },
  {
    "startMs": 453039,
    "text": "every machine and let each task borrow"
  },
  {
    "startMs": 456240,
    "text": "it."
  },
  {
    "startMs": 458000,
    "text": "The third story is the one where it"
  },
  {
    "startMs": 460319,
    "text": "broke in mid August. A release goes out"
  },
  {
    "startMs": 464479,
    "text": "with a bug. That bug triggers alert that"
  },
  {
    "startMs": 467520,
    "text": "fires once per workspace. So one bug"
  },
  {
    "startMs": 470400,
    "text": "become hundreds of alerts all landing in"
  },
  {
    "startMs": 473360,
    "text": "one single S channel."
  },
  {
    "startMs": 475680,
    "text": "Someone has set up workflow that tag our"
  },
  {
    "startMs": 478000,
    "text": "agent on every alert and every tag"
  },
  {
    "startMs": 481039,
    "text": "started task. On normal day those task"
  },
  {
    "startMs": 484400,
    "text": "started about 50 task. That day in about"
  },
  {
    "startMs": 488240,
    "text": "four hours they started around 900."
  },
  {
    "startMs": 492080,
    "text": "900 agents are chasing the same bug"
  },
  {
    "startMs": 494319,
    "text": "until that wasn't room left for a single"
  },
  {
    "startMs": 497039,
    "text": "note."
  },
  {
    "startMs": 498560,
    "text": "The fix was almost boring. A repeat"
  },
  {
    "startMs": 501199,
    "text": "alert now joins the investigation that's"
  },
  {
    "startMs": 503360,
    "text": "already open."
  },
  {
    "startMs": 505759,
    "text": "Two months later, it happened again. And"
  },
  {
    "startMs": 508639,
    "text": "this time, it wasn't a bot. On October,"
  },
  {
    "startMs": 512959,
    "text": "the engineer did exactly what we've been"
  },
  {
    "startMs": 515680,
    "text": "asking everyone to do. Hand work to"
  },
  {
    "startMs": 518320,
    "text": "Spectre."
  },
  {
    "startMs": 520159,
    "text": "About 950 tasks from the command line."
  },
  {
    "startMs": 523839,
    "text": "In about 3 hours, nothing in our"
  },
  {
    "startMs": 526240,
    "text": "platform can work. The cluster filled up"
  },
  {
    "startMs": 530160,
    "text": "and everyone else work sat in line"
  },
  {
    "startMs": 533040,
    "text": "behind one laptop. That's not a user"
  },
  {
    "startMs": 535839,
    "text": "problem. That's our problem."
  },
  {
    "startMs": 539920,
    "text": "4 days later, we had a real fix. A fair"
  },
  {
    "startMs": 543120,
    "text": "launch queue. Now starting a task gives"
  },
  {
    "startMs": 546560,
    "text": "you a place in line and the dispatcher"
  },
  {
    "startMs": 549360,
    "text": "started when there's room. People"
  },
  {
    "startMs": 552000,
    "text": "sitting at keyboard goes first. Everyone"
  },
  {
    "startMs": 555200,
    "text": "gets a fair share and can borrow more"
  },
  {
    "startMs": 557279,
    "text": "than the cluster is quite."
  },
  {
    "startMs": 560000,
    "text": "And whenever you start a task, you can"
  },
  {
    "startMs": 562399,
    "text": "see a placing line. When we hit it with"
  },
  {
    "startMs": 564959,
    "text": "a 300 task burst in low test, the task"
  },
  {
    "startMs": 568640,
    "text": "lit went from almost 2 seconds to 70"
  },
  {
    "startMs": 570959,
    "text": "milliseconds."
  },
  {
    "startMs": 572800,
    "text": "So did it work?"
  },
  {
    "startMs": 575279,
    "text": "When it's the busiest day of every week"
  },
  {
    "startMs": 578800,
    "text": "back in August, two certain task and"
  },
  {
    "startMs": 581760,
    "text": "about one in 10 didn't finish."
  },
  {
    "startMs": 585040,
    "text": "Then in November 4th, more than twice"
  },
  {
    "startMs": 587440,
    "text": "that and much better in the finish line,"
  },
  {
    "startMs": 591760,
    "text": "but we still have some room to grow."
  },
  {
    "startMs": 595040,
    "text": "I will be modest, we change several"
  },
  {
    "startMs": 596880,
    "text": "things at once, so I cannot tell you"
  },
  {
    "startMs": 599120,
    "text": "which fix mattered the most, but the"
  },
  {
    "startMs": 601279,
    "text": "birds kept getting bigger and the"
  },
  {
    "startMs": 603440,
    "text": "platform kept up."
  },
  {
    "startMs": 606399,
    "text": "And just when that was on the crunch"
  },
  {
    "startMs": 608320,
    "text": "show, the model neck moves."
  },
  {
    "startMs": 610880,
    "text": "At the end of the October, our dev"
  },
  {
    "startMs": 613519,
    "text": "platform team raised an alarm. PRS"
  },
  {
    "startMs": 616720,
    "text": "across the company had jumped around 60%"
  },
  {
    "startMs": 620240,
    "text": "in a single month. A merge that used to"
  },
  {
    "startMs": 623440,
    "text": "take 15 to 30 minutes was taking over an"
  },
  {
    "startMs": 626240,
    "text": "hour now. And merge Q kept having to be"
  },
  {
    "startMs": 629120,
    "text": "switched off. So now a PR rebase onto"
  },
  {
    "startMs": 632959,
    "text": "main rerun CI and merge if it's green."
  },
  {
    "startMs": 637120,
    "text": "If main breaks everyone CI breaks with"
  },
  {
    "startMs": 639839,
    "text": "it. Alterately"
  },
  {
    "startMs": 642560,
    "text": "we haven't cracked this one yet."
  },
  {
    "startMs": 645279,
    "text": "But before I go there's one more thing."
  },
  {
    "startMs": 649040,
    "text": "While we were busy fixing all it"
  },
  {
    "startMs": 652160,
    "text": "something else was quite growing. Most"
  },
  {
    "startMs": 655200,
    "text": "of what I've been showing you start with"
  },
  {
    "startMs": 657360,
    "text": "a person asking."
  },
  {
    "startMs": 659279,
    "text": "The fastest growing source of the work"
  },
  {
    "startMs": 662640,
    "text": "on Spectre doesn't these are automations"
  },
  {
    "startMs": 666320,
    "text": "agent that wake up on schedule on an"
  },
  {
    "startMs": 668959,
    "text": "event and just do the work tri alert"
  },
  {
    "startMs": 673040,
    "text": "read the PR write the post."
  },
  {
    "startMs": 676560,
    "text": "Last month about 110 people had"
  },
  {
    "startMs": 679279,
    "text": "automation running and we learned to"
  },
  {
    "startMs": 681440,
    "text": "give them a guardrail on day one."
  },
  {
    "startMs": 684480,
    "text": "If one fails five times in a row, it"
  },
  {
    "startMs": 686959,
    "text": "switch itself off and it can carry a"
  },
  {
    "startMs": 690160,
    "text": "budget or expiry date because when no"
  },
  {
    "startMs": 693680,
    "text": "one's watching, an agent can start"
  },
  {
    "startMs": 695839,
    "text": "thousands of tasks, too."
  },
  {
    "startMs": 698399,
    "text": "So, here's what I'm chasing next, and I"
  },
  {
    "startMs": 701440,
    "text": "don't have an answer yet, honestly."
  },
  {
    "startMs": 704480,
    "text": "What if every Slack channel had its own"
  },
  {
    "startMs": 706640,
    "text": "agent that never locks off? One that"
  },
  {
    "startMs": 709920,
    "text": "follows competition and start work on"
  },
  {
    "startMs": 711680,
    "text": "its own. What if every pure prove it"
  },
  {
    "startMs": 714800,
    "text": "works before a human even look at it?"
  },
  {
    "startMs": 718399,
    "text": "Today only one merge in 20 carries that"
  },
  {
    "startMs": 721360,
    "text": "kind of proof."
  },
  {
    "startMs": 723839,
    "text": "And how do you merge when agents never"
  },
  {
    "startMs": 726240,
    "text": "stop opening PRs?"
  },
  {
    "startMs": 728880,
    "text": "Ask me again 6 months. I will tell you"
  },
  {
    "startMs": 731600,
    "text": "what broke. If you're building something"
  },
  {
    "startMs": 734160,
    "text": "like this when you work, here's three"
  },
  {
    "startMs": 736399,
    "text": "things I do again. Oh, what happens"
  },
  {
    "startMs": 739279,
    "text": "after code is written. Make Eric action"
  },
  {
    "startMs": 743040,
    "text": "something an agent can call and cap what"
  },
  {
    "startMs": 746240,
    "text": "an agent, human or alert can start"
  },
  {
    "startMs": 749360,
    "text": "before they find out what they can do"
  },
  {
    "startMs": 751519,
    "text": "with it."
  },
  {
    "startMs": 753440,
    "text": "And one last thought, that's my own"
  },
  {
    "startMs": 756000,
    "text": "view. Engineers can write code with"
  },
  {
    "startMs": 759120,
    "text": "whichever agent they like. The work"
  },
  {
    "startMs": 762079,
    "text": "that's lost is the harness that runs it,"
  },
  {
    "startMs": 764800,
    "text": "checks it, and get it merged."
  },
  {
    "startMs": 768959,
    "text": "Thank you so much for watching."
  },
  {
    "startMs": 771600,
    "text": "Come find me on linking if you are"
  },
  {
    "startMs": 773440,
    "text": "building similar things."
  }
]
