[
  {
    "startMs": 13160,
    "text": "Good to meet you folks. Thanks for everyone who's here. Um, today we're gonna talk about sharing context, right? Everything in AI is about the data you give it. Bad data, bad outputs, right? Agent memory is a solved problem, but agent learning is not. And we're gonna talk about not just like, you know, w-what we're building, et cetera, it's about how, why we built it and how we're using it for ourselves. Okay. So as we said, agent memory works, you know. There's a bunch of stuff you feed"
  },
  {
    "startMs": 43120,
    "text": "it, conversations, et cetera, and you're able to extract memories from the conversation, and agents are able to reuse them. It's per agent. However, learning is never done in isolation. It's when a group of agents come together and need to work with each other, they have to now start learning and sharing, right? And that is an unsolved problem because we're infrastructure people and infrastructure built for a single agent to do memory is often not the"
  },
  {
    "startMs": 72920,
    "text": "same infrastructure that is needed in order to learn, right? We're gonna talk a little bit more about that. Okay. So by way of background, I'm Karthik, one of the co-founders and the CEO of a database company, YugabyteDB, right? So what the hell are we doing here? Why are we building a agentic data infrastructure? What are we doing, doing that, right? We actually found this the hard way. We run agents for ourselves. We run two agents internal to the company, Hagen for customer support and"
  },
  {
    "startMs": 102900,
    "text": "Growth Vector for a coordinated go-to-market between sales and marketing. And we run two agents externally for our customers and users. The first one is PerfAdvisor, which is an agentic database admin, right? So it runs databases for our customers. As a database company, pretty useful. And Voyager, which helps them migrate and modernize from other databases to a cloud-native one, right? So four agents. We failed to ship anything and make it work at all. It was really hard. We've been trying for almost a"
  },
  {
    "startMs": 132580,
    "text": "year before we realized we were failing at the data problem, right? And if a database company is failing at a data problem, be it for agentic, it becomes personal, right? So yes, it became personal. We're like, \"What the hell is going on?\" And when we then realized that a lot of people were asking us like, \"Yes, we can do scalable vectors, we can do scalable graph, we can do scalable relational.\" Or people came to us and said, \"More scale, more performance, less cost.\" We're like, \"Wait a minute. At some point this is ridiculous, right? It's breaking the laws of physics.\" So"
  },
  {
    "startMs": 162820,
    "text": "what is the real failure, right? When you cut everything a-apart and just go to the core, it's because Agent A, my agent, is doing some work and I need to work with, say, one of you guys. Say maybe Heather, right? My other-- Who's gonna be showing a demo, and I am not able to give that context. I'm only able to give the output. The output being an MD file, a PDF, a document, a something, but I'm not able to give the reasoning behind it, right? So what does this"
  },
  {
    "startMs": 192560,
    "text": "lose? This loses reasoning. This loses the dead ends, the number of failures you've had before you actually succeeded, and it loses the whole context, right? That means Heather's agent is going to be rederiving all of this stuff, and it's not for free. You're burning tokens and paying somebody else for it. This is the same as a group of humans working together. When a new person joins the team, they're going to be told, \"We're going to do X.\" And they come up with fifty reasons why we should do something else,"
  },
  {
    "startMs": 222520,
    "text": "and each time, \"Yes. We considered that two weeks ago, two months ago.\" That's not how humans operate. We actually bring the person in and says, \"Okay, look, this is the context. This is the history of the project. This is how it's done. Now let's go from here.\" That context is missing for agents. So five things, misconceptions, okay? Really quick. More memory, agentic memory, is not learning. It's just more memory, right? Like, it's more expensive. Shared state is not shared knowledge. Just because you can"
  },
  {
    "startMs": 252580,
    "text": "share something with somebody else, like an MD file or something, doesn't mean you have shared knowledge. RAG transcripts, let me RAG everything, is not equal to learning and quality. It just means there's a whole bunch of garbage there and now LLMs get to burn even more tokens to give you even worse results. Fine-tuning is not scalable. You cannot, you know, save and persist lessons that agents have come up with through fine-tuning and building custom infrastructure. And a bigger context window is the surest way to"
  },
  {
    "startMs": 282380,
    "text": "quickest failure in an expensive manner, right? 'Cause it doesn't do anything. Your context rots. Every single one of these is a architecture gap, right? So this is what we realized we needed to plug for ourselves, right? And we've been finding a lot of users are, are really enjoying and really liking this approach of thinking about context. Firstly, if there's a context that Agent A can share with Agent B, it closes the lost context problem. They're working on the same context."
  },
  {
    "startMs": 312540,
    "text": "Second thing is this context can degrade. That means not everybody can contribute to that context. It's just like code. Not anyone can contribute. You need to go through a process of supervised promotion, and only then does it make it durable. And lastly, you need to be able to ask your-- the question, where the hell did this piece of information come from? It makes no sense at all. And be tr-able to trace it back to something, a data source, a person, a conversation from which it was extracted, and that's the first step to improving your context."
  },
  {
    "startMs": 342900,
    "text": "So"
  },
  {
    "startMs": 345460,
    "text": "we started building this by assuming, how hard can it be? So the first thing we did was, it's just a knowledge base. We throw everything in the knowledge base, it's gonna be great, right? And how wrong we were. We built a whole distributed RAG pipeline, extremely scalable, very elastic, amazing. It was just amazing, right? And it didn't do anything good for us. And then we said, \"You know what? This whole shared stuff doesn't work. We'll let every agent spin up a tiny database. We're a database company. How hard can it be? Tiny Postgres, make it efficient.\" Well, we realized that every"
  },
  {
    "startMs": 375320,
    "text": "repeatable workflow was being reinvented on the fly. Didn't work at all. And then we said, \"Okay, fine. We'll just have some back end that does a whole bunch of processing and, you know, we'll just, you know, not even bother with a UI 'cause agents don't need UI.\" And then we realized we couldn't tell what was going on. No human in the loop equals really bad results. Okay. And then we thought, \"Okay, at least we have the RAG pipeline.\" Well, it turned out even that was shitty 'cause, you know, we took all the best components from the, you know, whatever the academia,"
  },
  {
    "startMs": 405384,
    "text": "academia says, and we put it all in there, and we got poor numbers. 14% faithfulness using an MD benchmark, public benchmark. 20% on a PDF. 57% context precision using all of this other stuff. And when we actually started looking and tracing and doing our traces and tuning and experimenting, we realized a lot of things were off. And as we improved them one variable at a time, we were able to jump to 65, 74, 82, right? And here's the kicker. Our"
  },
  {
    "startMs": 435324,
    "text": "context chunks, which is the context size, went down from over 7,000 chunks to about 1,000 chunks. So one-seventh the context size, a lot higher precision, and a lot less money burned on tokens, right? So that's where Meko comes in. What is Meko? It's a agent-native persistence layer that takes all the mistakes we made and all the things we got right and puts it into one box, right? And the way Meko works, it exposes a"
  },
  {
    "startMs": 465264,
    "text": "data pack, right? As a database company, we don't call it a database 'cause it has multiple types of databases: vector, graph, relational, NoSQL, whatever, right? And what it does is stores aspects of the context, knowledge base, memory, conversations, observability, a lot more, right? And what it enables is it enables agents to come in and push pieces of their context into a private space and promote that to a shared space, right? And then"
  },
  {
    "startMs": 495524,
    "text": "other agents or humans that come in can now go against that promoted high-quality context and quickly retrieve stuff, and you can now continue to add more people and more agents and do the handoff efficiently, right? Hopefully that makes sense. Um, the idea is take the durable, repeatable workflows and make it infrastructure. Okay. Before we go into a demo, right? A confession. This slide deck that you're looking at was built"
  },
  {
    "startMs": 525624,
    "text": "using Meko as the context persistence layer, right? The way it worked was Heather, who's gonna give you, show you the demo, actually wrote up an outline and created a data pack in Meko and simply sh- sent me a share request, right? And she said, \"I'm doing the demo. Here's the outline of my demo. Here's the rough talk track that needs to lead up to it 'cause that's what makes sense.\" I took it, and I'm, I'm sure she used some agent harness. I don't know what it is. I really don't know. I didn't ask her. I didn't even have a meeting with her. She just sent me"
  },
  {
    "startMs": 555484,
    "text": "this. I plugged it into my Claude Desktop and said, \"Take this outline and break it down for me,\" and it gave me a few bullet points. This is what you're talking about. I'm like, \"Okay, great. I wanna change a couple of things.\" Changed a couple of things and said, \"Here's the new outline. Can you build me my slide deck based on this?\" And it did. And that diagram on the left, it built a really crappy diagram, right? It didn't look good at all. So I said, like, \"You know what? Everyone's saying this, uh, Claude Design is the rage, so why don't I give that thing a go?\" And it actually did a better job. So, you know, there you"
  },
  {
    "startMs": 585544,
    "text": "go. That image came from Claude Design. Everything else came from Claude Desktop. Shot it back to Heather, and, you know, Heather took the final pass over it to get, hook it up with the demo, and here we are. So we barely talked, right? We didn't need to. We just shared context, and our agents did the work. And, uh, you know, you can go, you can watch it. I think maybe I'll invite Heather to talk to this slide and, and the thing after. I hope the demo's good 'cause I haven't seen it myself, so yeah."
  },
  {
    "startMs": 620724,
    "text": "The idea is to watch collective knowledge grow over time, right? What Meko provides, uh, that I was able to use for this is the resumability. So resumability, I'm going to show you, is being able to start a session and then kill it and then start it again with the same agent. Right now, if you do it with something like Claude Desktop, they have projects for this, right? So if you do a Claude project, everything's together, or if you turn on memory. But in this case, I guess like two months ago, I turned off all the memory on all of my"
  },
  {
    "startMs": 650664,
    "text": "IDEs because it doesn't matter. What if I use something while I'm on the go, like a mobile app? Maybe I use ChatGPT that isn't as sophisticated, right, as some of my coding IDEs. And so maybe I wanna continue working on that topic. I can do that because all of the context is shared in our cloud now. And by sharing, I mean that obviously ChatGPT is a different, um, agent, but it's still my account, so I should be able to get to it, right? But because we're security-focused and security-minded, we don't want like just any"
  },
  {
    "startMs": 680524,
    "text": "agent to get to it. So I have to promote the kind of memory that that agent can also retrieve in like a collective pool. And because you do this, the cost itself goes down tremendously. 'Cause the first time I figure stuff out, I'm going back and forth with my LLM. I'm burning lots of tokens to get to an end goal, whether that is code or it's just a knowledge work. But the next time that I want to retrieve it from another agent or another session, it doesn't need to burn through that. It just calls to the Meko"
  },
  {
    "startMs": 710384,
    "text": "memory, and then it brings it right back with far less tokens. So we're already saving a lot of token spend. The alternative to this would be to just, again, keep things in empty files or keep things where you have to constantly traverse with every single agent's LLM and burn through tokens again and again in order to retrieve. Does that make sense? The difference here is just an MCP tool call. So to kind of prove that out, because we have sensational internet here, I have recorded  this for you at a"
  },
  {
    "startMs": 740364,
    "text": "little bit of a faster speed, hopefully. All right, see this is resumability. So here I'm saying that I wanna store, um, the conversation in a certain data pack, right? Uh, let's call it the early access launch, and I wanna put a piece of information in it. In this case, um, our sign-up emails failed, true story, because we actually only use the SCS's sandbox instead of the prod. So, uh, we kind of went over the limit there  when we were testing things, and that's a good piece of information for"
  },
  {
    "startMs": 770248,
    "text": "maybe our, our ops team, right? So in this process, it's calling data pack create, uh, because I've connected the MCP server to Claude here, and I've created a skill that will tell it what to do. You can decide how often you want it to call or if you just wanna do it judiciously here. And so now it's storing the incident fact as a searchable memory with memory add, and then it's done now. So the data pack has been created. There's a conversation in there,"
  },
  {
    "startMs": 800548,
    "text": "and it'll be retrievable in the f- in the future sessions. That sounds great. Awesome. Now I've killed that session, and notice I'm not in projects. This is just a new chat window. Now I'm going to ask the same question so I can resume. Before I had to, again, have to make sure I turn on Claude Memory or turn... or put it inside of a project, but it's not in either one of these. I could be logged in with the same account in like claude.ai, which would be technically a different agent. So I'm trying to prove that you can at least resume your"
  },
  {
    "startMs": 830468,
    "text": "sessions after maybe days with the same agent. So the failure result there was actually that it tried to search first instead of creating, uh, a conversation, a new conversation here. We wanna save every one that we do, so it's the MCP server instructing to create like a new conversation for it so we can store this. And see now they searched Meko and it found that, hey, this is what happened back in May, and it was able to pull things back out."
  },
  {
    "startMs": 862088,
    "text": "All right. For shareability, let's go ahead and get this done. If you notice, this is a completely different IDE. In this case, it's Codex. Um, so I've asked it questions like, \"Okay, um, do you have any known cause for the sign-up emails that are failing?\" And so it's gonna look, and it's gonna look, and it says, \"No, I don't see anything. I don't see anything. I'm looking.\" Um, it did say that it saw that there was a brand-new, uh, data pack that it's connected to,"
  },
  {
    "startMs": 892428,
    "text": "but it can't actually see anything. And why is that? Because I actually haven't shared that private memory from my Claude Desktop yet, uh, into a shared space. So right now, those memories are still private. If you notice, the early access data pack is seen because I have connected it, but I just haven't promoted it yet. So in that case, I'm gonna go to sign out, and I'm gonna sign in with my other account here to show you that, yes, I do have access to this data pack, and I need to"
  },
  {
    "startMs": 922208,
    "text": "promote that piece of memory into a shared knowledge space. Allow it to go ahead and, and go through, and then I... it says it doesn't see it. But I said, \"Well, same question. Let's try it again.\""
  },
  {
    "startMs": 938068,
    "text": "So now that I've promoted it into that space, sped up for your pleasure here,  because we all know how long-winded our LLMs can get, um, now it can find that piece of memory. It can find the piece of memory because I have allowed that one piece to go. It's very fine-grained. It doesn't have to be. You can open the whole data pack if you want as a maintainer to it, but this is much more ideal if you're just trying to give bespoke pieces of information, maybe best practices, maybe something that"
  },
  {
    "startMs": 967868,
    "text": "is the ongoing process that you want to keep going."
  },
  {
    "startMs": 974228,
    "text": "And then, like the last part of this is the cost. How do you even know that it saves you tokens? If you go into your data pack, you can look at the conversations that are stored in there and how they were done, because we give you embedded Langfuse traces for free in this, and you can actually look at the decision trace all the way down to the tool call and prove whether or not it called as much and burned as many tokens."
  },
  {
    "startMs": 1003928,
    "text": "Right."
  },
  {
    "startMs": 1009008,
    "text": "So human promotions today kind of equal the training signal for self-improving orchestration tomorrow. Every human that says this is worth keeping is kind of a labeled example of what good promotion looks like. So you can actually start training maybe in the future an agent that's trained on your taste and your preferences long term. But right now, we're keeping the human in the loop. Those calls are just a signal, but this is actually how it starts to learn. The biggest lift that I saw is that when something goes wrong, maybe in a"
  },
  {
    "startMs": 1039028,
    "text": "support situation, it's hard to constantly have calls call the same server that's down all the time, and then it's... tells all this time, \"Hey, do you know if this is down? Is that down?\" Slack starts blowing up. How do your agents handle that? They're all also wasting tokens calling the same thing. If they had access to the data pack, the first agent would hit it and then tell everybody that it happened, and all the other agents would know that it already happened."
  },
  {
    "startMs": 1070308,
    "text": "Hmm?"
  },
  {
    "startMs": 1072728,
    "text": "Hmm?"
  },
  {
    "startMs": 1072788,
    "text": "Yeah, so-"
  },
  {
    "startMs": 1074552,
    "text": "Yeah. So thank you, Heather. Like, I think, you know, pretty awesome demo. I think, uh, if you folks were following along what happened, Heather was, was in charge of the early access and launch of Meko, right? And obviously used a data pack, which is Meko, to launch Meko, right? Recursively.  And, uh, you know, the first few people had a lot of trouble accessing their data packs on Meko and, you know, we-- you know, she created a data pack for troubleshooting issues with Meko, a different data pack, and so that's the thing that she was talking about."
  },
  {
    "startMs": 1105012,
    "text": "Uh, a lot of us in the company, you know, it's shared with us, so we're all able to look at it, load it into our agents, and able to iterate with it. The folks that are in, in, in engineering, they load it straight into their, you know, Claude Code or Codex or, like, you know, whatever the coding agents are. Like, I, I myself am more of a Claude Desktop kinda user. I use it for other things like, you know, some... A user that wanted to get access, couldn't get access, apology email, like, go to Claude, help me design it, have a da- I have a data pack actually that is my voice of"
  },
  {
    "startMs": 1134972,
    "text": "how I speak, and same thing for posting on LinkedIn. I think it can get tiresome if you wanna keep writing it in your voice. You know, sometimes training a data pack for the context to do so will help. So a lot of these things get automated away, and it gets, you know, makes it much, much quicker to assemble, right? And obviously, if a new person comes into the team, very easy to share this context with them, have them get up to speed, have them contribute to it, either willingly or unwillingly, right? Sometimes they're just doing things they don't even know, and you extract patterns out of it. \"Oh, this is really great. We should make this a thing,\" right? So,"
  },
  {
    "startMs": 1165312,
    "text": "so, like, um, yeah. So I think these are some of the things. Anyways, I think the bottom line is we're trying to get it closer and closer to how humans work, which is how can you capture tribal knowledge? How can you share that? How can you give controls over sharing? And how can you actually tell what's going on, right?"
  },
  {
    "startMs": 1180052,
    "text": "Yep."
  },
  {
    "startMs": 1180432,
    "text": "Um, yeah. So I think-"
  },
  {
    "startMs": 1181392,
    "text": "You should, you should try it for free."
  },
  {
    "startMs": 1183152,
    "text": "Yeah."
  },
  {
    "startMs": 1183672,
    "text": "If you want."
  },
  {
    "startMs": 1184312,
    "text": "Yeah. Try it for free. Yeah. I think the left side is, you know, uh, the website, mekodata.ai, which will take you to a login. There's a free tier. You can sign up and just hook it up to one of your agents and, you know, get your agents to start learning, right? Right away. And the right side is Discord. We'd love to hear from you. If you do try it out, you know, do drop us a note. We're working on improvements. That's how we communicate what we're building. So do join us on Discord, right? We'd love to see you guys there. So I think that brings us... Yeah. Thank you. Thanks. Yeah. If we have-- Yeah. We're right on time, actually. Yeah. So..."
  },
  {
    "startMs": 1214312,
    "text": "Yeah. Thank you. If you guys have questions, please feel free to connect with us on the site. Thank you."
  }
]
