Leaf Logistics CEO Anshu Prasad on Applying AI to Freight and Transportation

In this episode of Founded & Funded, partner Aseem Datar talks with Leaf Logistics Co-founder and CEO Anshu Prasad. Leaf is applying AI to the complexities of the freight and transportation industry, connecting shippers, carriers, and partners to better plan, coordinate, and schedule transportation logistics. This enables network efficiencies and unlocks a forward view of tomorrow’s transportation market while simultaneously reducing carbon emissions.

Leaf Logistics was founded in 2017, and Madrona joined Leaf’s $37 million series B in early 2022. From the beginning, Leaf has been fighting the one-load-at-a-time way that trucking has historically been conducted. The company analyzes shipping patterns to make sure that when a truck is unloaded at its destination, another load is located to return to the city of origin. Identifying these patterns allows Leaf to coordinate shipments across shippers at 1000x the efficiency and effectiveness typical in the industry.

Aseem and Anshu dive into the story behind Leaf, what makes logistics so complex, and how AI can continue to improve it. And Anshu offers up great advice for founders that he’s learned on his own journey.

So, I’ll go ahead and hand it over to Aeem to take it away.

This transcript was automatically generated and edited for clarity.

Aseem: Hi, everybody. My name is Aseem Datar, and I’m a partner at Madrona Ventures. And today, I’m really excited because I have here with me Anshu Prasad, who’s the CEO of Leaf Logistics and also the founder. Anshu, welcome, and glad that you’re spending time with us today.

Anshu: Thank you, Aseem. This is great to chat with you.

Aseem: So, you know, Anshu as they it all starts with the customer. Tell us a little bit about your journey and the problem space and what you observed talking to customers in this space, and how you narrow down the problem that you’re solving.

Anshu: I’ve had the benefit of working in the space for some time before starting Leaf. And in that journey, what I got to observe was what, when I started in the space, seemed like a winnable game slowly and undeniably became an unwinnable game. It was hurting both the buyers of transportation and the providers of transportation. And being able to sustainably do something for their business to make sure that they had healthy returns and they had some reliability on a day-to-day basis. It’s a big part of our economy, as we all appreciate, and if anything, the pandemic shown a nice bright light on the essential nature of a well-functioning supply chain — and what happens when it doesn’t function all that well. But in the in-between times, in between crises, transportation and logistics is something that we’d all just, frankly, wish we could ignore because it would just work in the background. But if it doesn’t work for the participants, the customers who are invested in the supply chain, it doesn’t really work.

And over the last couple of decades, it’s become clear that even big sophisticated companies for whom transportation is a big deal are finding it to be less reliable and less planable than they’d like it to be. So, that was really the core problem, seeing some very smart, very hardworking people that I had a chance to work alongside and serve struggling with a critical part of their business. And it became clear that it was a time for us, and many of the folks working at Leaf Logistics now who’ve also spent similar amounts of time poking at this problem, to do something differently rather than just wade into the same fight and try to do more of the same and hope for a different outcome.

Aseem: Anshu, maybe just double-click into this a little bit and give us a sense of the kind of problems both the shippers and the carriers face on a day-to-day basis.

Anshu: At the fundamental level, this is a very transactional industry. A truckload from point A to B is seen as a snowflake. And for anyone outside the industry, it seems really alarming that it would be that way. Because we have all had the experience of driving down the highway and seeing every color of truck you can imagine on the road — how is this being done one load at a time? But that’s really, for a host of reasons, the way that this industry has evolved. So, the core problem as it gets felt by shippers is transportation becomes a one-load-at-a-time execution challenge. And if you’re a big shipper, you might have 500,000 or 600,000 loads a year that you need moved, and you’re treating each of them as an individual OpEX transaction.

And on the flip side, the carriers are responding to a demand signal that is very fleeting. It is, again, just one load at a time. I’m getting a request 48 hours in advance to go pick up a load in LA and then drop it off the next day in Phoenix. But I don’t know anything else beyond that. I don’t know what I’m supposed to do once I unload in Phoenix. Where is that next load going to come from? And I’m supposed to get up and start to play this game again, one load at a time, tomorrow. So, the ability to keep my truck utilized or my driver paid, maybe even return the driver back home, which is very important for the driver, becomes really hard for me to manage. So it becomes a constant challenge of trying to catch up with the transactional intensity but not really solving the traveling salesman problem. We think that should be solvable, but it’s not really what the data on the table allow us to do.

Aseem: Yeah, I mean, it’s, it’s just fascinating to understand and learn and, you know, as we’ve sort of worked together, just get educated every day on the complexity of this industry. I have been curious about this for quite some time — how did your background, your consulting mindset, set you up for tackling this huge problem and for ultimately achieving success in this industry?

Anshu: When I entered the startup world in the late ’90s, the flavor of the month was to apply technology to old problems. And we lucked upon an area where freight buying is a big deal for many companies in CPG, for example. We helped them buy their freight using basic technology that allowed them to automate a process that they’d been running for decades, using floppy disks and in web 1.0 kind of ways. And that helped to streamline some of the basic procurement processes. But it gave us an appreciation for the centricity of this purchasing decision to their core business operations. At the end of the day, everyone obsesses over their customer, and transportation is often the last point of interface with your customer, and yet we’re buying it as if it was just this free for all transactional auction. And so, what was getting lost was that sort of customer engagement, the customer entanglement from a well-serviced, well-structured supply chain to something that is very much ephemeral.

And the way that I kind of landed up in the space was a little bit by circumstance and by happenstance. We ended up helping companies like a Unilever or Bristol Myers negotiate their transportation rates. But what really drew me in was working with the people who had to do this work on a day-in and day-out basis and just empathize with them for a moment. You come to your desk at a Coca-Cola every day, and you’ve got a stack of shipments that need to get covered off, and you work your way through that stack as much as you can, and you get home and come back again tomorrow, and again, you have exactly the same Groundhogs Day problem. The only thing that shifts is outside of your control, ie. what is the market doing? I mean, if you’re a company like Coca-Cola, you’ve hedged your exposure to things like aluminum prices or sugar or high fructose corn syrup, and yet the second or third largest cost in your business, which is your transportation and logistics, is a bit of a guess and a gamble, and it shouldn’t be. And so as we, over and over again, and as I got into consulting, I saw this problem around the world, as we confront sort of the unreliability, not just of service, but of just the exposure that we have in our core businesses to this big cost item getting out of control. And last year was a good example. There were several top-fold of the Wall Street Journal shippers who all do a great job managing their transportation, just being subject to the whims of the market and being tens of millions of dollars over budget to the point where their earnings were depressed.

That is something that needs to get solved better with today’s data. And why I and many of the folks working at Leaf Logistics focused our energies on solving for something different was this is a remaining sort of big risk that looms in people’s business operations. And I’ve talked a lot about the shippers. If you think about the million or so trucking companies that are registered in the country operating at razor-thin margins, the roller coaster of the freight industry hurts them just as badly. And so the idea that no one is really winning and people are paying, and people in specific terms, layoffs, and bankruptcies are impacting this industry adversely. And it’s happening with increasing frequency over the last several years. Something should be done differently. As opposed to more of the same.

Aseem: I think the meta takeaway for me is that you have an asymmetric advantage, having spent so much time in this industry and really understanding the business processes like you described. And it’s amazing to me that the biggest spend has kind of often gone ignored, and you guys are doing a killer job in trying to build, I would say smart systems and intelligent applications around it. You know, one question that comes to my mind, Anshu, is that you’ve been steeped in this industry for quite a bit. You’ve been on the consulting side, you’ve been on the advising side. And starting a business is no small task. Especially in an age-old industry like this, where things are often done the way they’re done. And that’s the same way has been going on for many years. What headwinds did you face in, you know, tackling this problem in this industry, like landing your first big customers, can you just tell us a little bit about that journey?

Anshu: So there were three areas that I really focused on. One was customers. If we built something fundamentally different, would they be willing to take a risk and try something different? And let’s face it, you know, trucks are moving around the country, and they have been, somehow, people are muscling it through. So would there be a case for change? One test was talking to 50 perspective customers and saying if we built something, would they be willing to test it? Second was what is that earned insight that we had for so many years poking at this problem? What are we seeing that other people are not seeing because they’re caught up in the day-to-day fray? And that was fundamentally that much of this problem is planable. And if you apply a different sort of analytical approach to this, you could understand and uncover the planable bits and, at minimum, take the planable bits off the table to allow people to focus their creative energies on the stuff that just needs to be triaged through brute force.

And then the third was that you had to put the pieces together. And for me personally, the third piece was the most important. Finding other people who had worked with, who had seen this problem from different perspectives and angles, who are all kind of seeing the possibility of solving the problem differently enough that they would drop their current work and come do this. And the personal conviction from individuals that I had a ton of respect for, and I knew that they brought special skills to the table, come and jump into the boat and start rowing, gave me the most momentum of anything.

And so getting that first customer was as much about having built something off of a particular understanding with a set of folks who had special skill sets as it was about convincing that customer. To be honest, I think some of the early customers said, I understand what you’re describing. I think you guys will figure it out. They were betting on us as much as anything, and it was as much a partnership around sniffing through the common problem that we saw and working and iterating on that to solve for a different outcome. We were as invested as the customers were. Those early customers saw as much in the promise of what we were trying to build as we did. They just didn’t have necessarily the same sleepless nights as we did.

Aseem: I had the privilege of talking to a few of your customers, and I could say that they were not just fans, but they were raving fans. And I remember one comment where one of them said to us that I think Anshu understands and the team understands the problem more than we do. Which is a testament to your empathy and your, you putting yourself out in your customer’s shoes. Anshu, was there a moment when you started talking to these 50 and going deeper into the problem where you thought that I’m onto something, right? Was there a turning moment, or did it just happen at a consistent pace that built your conviction?

Anshu: I think what started to build conviction the most was how quickly we could arrive at a common understanding of the problem. It became very crisp and clear. So, if we just basically said, you know, and this past year is a good example. This past year can never be allowed to happen again, says the budget holder at a big shipper. That acknowledgment that something is fundamentally broken. It may be incredibly complex to solve, but just the common understanding that there’s a problem here versus the things are happening. Things are getting done. There isn’t a compelling case for change — that would’ve been a warning sign.

So, there were a couple of ideas that I’d been chatting to folks about, and they all agreed that there was some value to be delivered, but it wasn’t clear that it was a problem compelling enough to go take a risk. And in this particular case, the risk was give us data that you’ve never given to anybody else. A brand-new startup that’s starting out building the technology. Give us data you’ve never given to anybody else and trust us to be good stewards of those data is a big ask. And I was surprised and really encouraged by how many people were willing to part with these data in such a transparent way. Because, you know, it signaled to me that they appreciated the importance of a potential solution. They didn’t know what the potential solution was quite yet, but they were invested in trying to work toward one.

Aseem: Great point. I think often, people look at their data and say, hey, this is data that I’ve collected. It’s sort of my crown jewel. And it’s a huge testament to you and the team where, you know, customers came to you and said, look, I’ve got all this historics, but in some senses, I don’t know what to do with it. And if we can find a meaningful way to mine that data, not just look at it as mere flat files, but derive insights and then take action and complete the loop, like that’s the holy grail, which I think Leaf Logistics is doing so beautifully.

How are you thinking about building intelligence into your solutions? Tell us a little bit about your vision around the smart applications, the ML/AI-infused things. How are you thinking about next-generation technology as an enabler to solve this unique problem?

Anshu: Yeah, it’s actually an interesting area to apply that branch of analytical thinking and algorithmic decision-making. So we apply machine learning to large longitudinal data sets as sort of a starting point for the work that we do. So we understand that there are some patterns that will hold, and we can plan and schedule freight against those patterns. Just doing that, using some of the technology we’ve built, allows us to coordinate those shipments across shippers at a thousand times the efficiency and effectiveness that people in the industry do. So that confers a pretty significant advantage. Just planning and scheduling with the benefit of machine learning, pointing us to where we know that patterns will hold.

Where we’re starting to see some decision-making get enhanced is there are way too many inputs, right? So just with two or three shippers, the numbers of decision variables you might need to consider, too, for example, we’re working a fleet right now that works across multiple shippers in eastern Pennsylvania. It keeps 10 trucks and drivers and 32 trailers busy on a continuous basis. But on load by load level, that could mean there’s a load that is being fit into a, a standard plan that the pattern identified by machine learning holds over and over again. But it could also mean that there’s a load that needs to be taken to Long Island or to Ohio, and you need to be able to solve for that. And the consequences of stretching the fleet to Ohio needs to be factored in. And that sort of supervised learning based on those different inputs so that the algorithm is smarter the next time that an Ohio load pops up on the board becomes important. And building the technology to think about that because we know that those problems exist, I, we see that in the historical data. And so, how can we train the algorithms to do that? To kind of give you an example- optimizing for those decisions on a weekly basis as opposed to annual basis, which is what the industry typically does, confers anywhere between six and 16% advantage. So just literally taking sort of the learnings from week one and applying it to week two. Week two, applying it to week three, can have that kind of an impact. You know, let’s call it 10% on a $500 million spend — that is an enormous impact for a company.

What we don’t know is what shape it will take in the future sort of working of this industry. There are something like 5 million white-collar workers in U.S. logistics. Do we arm them with better decision-making tools so that the transactional work that they do now they have better data at their fingertips so they can execute smarter decisions? Or do we do what media buying and ad buying have done, where the algorithms take some of the rote decision-making and figure that out and execute that so that the creative brain power of the humans can be focused on up and downstream decisions that are impacted by transportation? I don’t know which way the industry will evolve and at what pace, but there are significant opportunities for bringing some of these technologies into this industry.

Suffice it to say that the millions of man-hours that are spent doing transactional work. I think, for most people outside the industry, it’d be alarming the level of manual intensity that transportation still requires. It will be rung out of the system. Exactly how that will be rung out of the system so that people can work on, hey, if I now know the rate from Dallas to these two locations three months in advance, how would I structure my production scheduling and my manufacturing processes differently? You just can’t answer that question today because those data don’t exist. But when those data exist, there are some very interesting problems for humans to spend their energies on versus what the machine or the algorithm can take off their plate.

Aseem: That’s fascinating. And you know, I, I, I think this is really unique as to how you guys are thinking about the problem and bringing the technology of today to solving a very well-known complex problem.

Anshu: It is fundamentally something we’ve all bashed our heads against the wall at for a long enough time. We talk a lot about waste in the industry and in terms of empty miles and emissions associated with them, but there’s just the waste of human capital. Today, a truck driver in our industry, if he or she’s driving empty to pick up the next load, they don’t get paid. They’re paying for diesel out of their pocket in a lot of cases. And then there are, of course, the man-hours wasted. On average, over four hours are wasted at pickup and at delivery, loading, and unloading. And so many inefficiencies that we’re all paying the tax for. If we can free up the human capital to work on more interesting, more valuable problems, we’re all going to be better off.

Aseem: You know, wanted to sort of just pop back up for a bit to get back to the 30,000 feet view. How are you thinking about scaling, and what are the challenges in front of you?

Anshu: It’s a very interesting problem, and in some weird ways, because of the complexity of the problem, there are multiple areas to pursue. So, one of the main things for scaling is to continue to have a disciplined focus on the few things that we think will make the most difference to our customers over the next handful of stages of our growth.

That focus and discipline becomes a really important thing for the management team to focus on, which brings me to maybe the most important point. One of the things that we’ve been very clear-eyed about is the team that it took to muscle through and get from zero to one may not be, and likely isn’t, the team that scales from where we are to where we’re trying to go. There just different skillsets. The obsession with the problem. The ability to iterate and think in first principles was essential for us to get off the starting block. Now we have to take the pieces of product-market fit and repeatability and drive toward scalability by looking at patterns and executing against those patterns with discipline. And hiring and upgrading our talent and challenging each other to make sure that we’re not settling for the status quo have been really important. Culturally we have a very transparent and open culture. Many of us have had the opportunity to work with other people on the team in past lives. So, there’s built-up trust, and yet we’re all trying to do things that scaling is an interesting word to use in the context of a startup, but human beings don’t scale very well. There are certain things that we do remarkably well, this is an organizational culture challenge to build something that scales, and that might mean that myself and others need to give up things that we used to get our hands dirty with to allow other people to pick them up and do a better job with. And that is, frankly, a big challenge. Hiring for and building the organizational muscle to genuinely scale as opposed to just doing a few of the things that we’ve been successful at a few more times. It’s really, it’s fascinating. And what’s been interesting is the learning that we, almost on an individual level, you can palpably feel are going through. This idea of letting something go that you used to obsess all night over because somebody else can come pick that up and, within a couple of hours, have a different solution than you, just because they look at the problem and frankly at the world differently than you, is a learning experience, a growth opportunity for many of us.

Aseem: Well said. So much of it is, building the right team, hiring folks that are coming from different backgrounds, different points of view, looking at the problem differently, but also world-class at what they do, right? And oftentimes, that’s probably not the existing team that’s there because they have different domain expertise or they come from various stages of a company’s life cycle as you scale fast. Another question on that front is, how do you think about repeatability and understanding patterns on what to invest behind? The challenge with scale is often prioritization because you can’t scale if you are focused on too many things. I mean, Yeah, you can scale horizontally, but that often doesn’t make you best-in-class in certain areas. So, what’s your guidance to founders or companies who are just slightly behind you on prioritization and being maniacally focused on a few core areas?

Anshu: I think that’s one of the toughest things for us to do and, honestly, to challenge ourselves to ensure that we’re applying the same strict filter continuously. Because sometimes we fall in love with our own ideas. And one of the challenges for an experienced team like ours is we do have so much familiarity with the problem, but we might be a little too close to it. So sometimes, our hypotheses are are tough to let go of. And similarly, even our most high-conviction customers might not be able to tell you what is it that they want next. So this is, oftentimes, when we’re talking about something different, we’re skipping a few logical steps in the solution design. So asking the customer for a set of features might lead us down the wrong path. And being able to really understand that requires that we have more than a handful of data points. And so we have this sort of ethos here that zero to one is very hard. One to 10 gives you data. And one to 10 is just, we’re going to be disciplined in making sure that we get enough data points so that we are not getting skewed perspectives that we double down on, and we don’t scale until we’ve got that repeatability understood. So repeatability and scalability are seen as distinct. And oftentimes, the people who are invested in innovation are not the people to take it to repeatability. And the people who are in the repeatability motion of sort of new ideas that we germinate with our customers are not the people that are responsible for or charged with scaling it.

And that sort of baton handoff has been helpful because I think that’s something we struggled with. Just switching gears as the founding team was very hard to do because, to your point, each idea deserves a ton of scrutiny and attention.

The other sort of lens that we apply is we have north star metrics that we look at, and we look at the differential impact of those north star metrics from each idea. So, it’s almost like a mini PNL ROI-based argument per idea. An exercise that we go through, which is different from the standing sort of reviews of the project planning and the metrics, it’s stepping back and saying, if I had to draw the line at three, which ones would be above and below the line, and forcing a debate. So, people are then debating the data that they have, the ideas, as opposed to any sort of custodianship for, you know, the work that they’ve been doing. It’s learning from great companies who will put competing teams to work on the same feature because they learn so much from looking at the same problem but with different diverse teams tackling the problem independently. We’re trying to just borrow from those pages. And that means that reprioritization is as important as prioritization in the face of new data. But it just becomes the way we work, and we’re trying to develop that muscle as we scale because we start to get to be a larger company, to be able to reset priorities doesn’t seem like what big companies do very well.

Aseem: The one thing that I’ve observed in partnering with the team, which is just amazing, is you all think in terms of 10x, you all think in terms of the outsized impact that an effort or a project or an idea could have relative to the metrics. Does it improve it by 5%, 10%, and is it worth doing it, or does it actually have its own leapfrog moment where it’s having an outsized impact if you go funded or if you go execute on that idea? That’s a good sort of framework for somebody to have as they think about scale.

Anshu, let’s talk a little bit about your experience and your principles around hiring and adding to the team. What tenants do you keep in mind when you hire people, especially at this stage in attacking this scale challenge? What roles are you adding, what should founders in your position know and learn from you on how you are thinking about the right kind of team and shaping the right kind of, I would say family, to go after this problem?

Anshu: Yeah, I think family is a great term for it. I think one fundamental thing is that the needs shift. Early on, one of the most important things we look for are people who have demonstrated grit. That they’ve had to go out and find a way through. And that can come in multiple disciplines, but there’s something to be said for finding a way through. And the shift between that and the scaling phase now is the thing that we spend a lot of time doing, even in panel interviews and group discussions with some final round sort of leadership candidates are filtering for the ability to distinguish between the things to pursue and which things to leave behind. And that honestly is very hard for that founding grit-based team. Cause that grit-based grinding team, they can’t leave any stone unturned. You just keep working. And the problem with scaling is you can’t afford to have every detail consume your time because it gets you in the way. So, the ability to put the blinders on and make sure that the blinders get tighter with each iteration is a skill that people who’ve scaled before seem to demonstrate, and they can prove that to you. We can even look at our current set of priorities that people who are working at Leaf Logistics right now are struggling with force ranking or prioritizing. Put that in front of someone who’s had scaling experience, and they’ll ask the right essential questions to be able to distinguish and at least relatively prioritize those items on the list. That’s the clear-eyed kind of perspective that I think at the scaling stage is distinct from that sort of grind it out and find a way type person or people you’re looking for at that early stage.

Aseem: just following through on that thought. Leading into 2023, Anshu, I know you’re growing, you’re adding to the team. Tell us a little bit about what would ‘great’ look like for you this year?

Anshu: There are three things, and we try to make sure that at this point, for everybody on the team, we all know what those three things are. The first is we are seeing the coordination thesis that we’ve started with actually playing out, and that’s driving an improvement in our net revenue picture. And so, as we get more scaled, frankly, people who haven’t spent as much time as you and your team have, Aseem, understanding what we’re doing and why can look at the business from the outside and understand the progress that’s being made in just pure sort of financial statement terms. That’s an area of focus. So we’re just trying to get those clear financial metrics to jump from our performance. And that is, through doing some things that are pretty cool and pretty distinct in terms of being able to build circuits and continuous moves and even deploy fleets and parts of the geography that others aren’t able to do. And we, frankly, put a lot of effort in being able to get to this point but to go execute those things and show that impact on the bottom line is job one.

Second, is the only way or the best way that we think that we’re going to get there is to double down with some of our key customers who are growing very rapidly with us, but there’s still yet another gear that we can hit together. And so, account management becomes incredibly important as a discipline to not just further build out but to enhance. And the amazing thing is that there’s just as much appetite from our customers. We’re finding engagement at such different levels and across so many different personas that it’s an incredibly intellectually stimulating exercise to find those different perspectives because many of these customers, this matters a lot. So just earlier today, we had one of our logistics service providers, CEO and CFO, in the office, specifically talking about their 2023 plans and how much the work that we are doing together could impact that trajectory. And that’s the kind of partnership we’re really looking for from an account management perspective.

And then the third thing for us is to make sure that we are prioritizing the 10x moonshots that are coming next. You know, how do we build upon some of the early advantages that we’ve established to continue to do things that other people just don’t have the established foundation to do?

So, we’re really excited about some of the payment and lending-type solutions that we can bring to market right now in an economy where those types of solutions are pretty few and far between. This is still a massive industry with huge inefficiencies and a recognized need for change. A lot of innovation needs to be brought here to mitigate the significant amount of waste that we have in the industry. That hurts both people and all of us indirectly as the environmental impact of an inefficient supply chain is experienced across the economy and climate. How do we make those investments possible? That’s going to require innovation and the 10x ideas that we’ve been of working on. Making sure that those ideas see the light of day that they’ve germinated, but also that we talk about some of those things to pull some of the next set of customers and prospects into the journey with us. There’s a fair bit of growth for us this year, Aseem, but we will sacrifice top-line growth for growing with the right people at the right pace, with the right level of innovation to set us up for the future potential that we see for the company and for the impact that we can have on this industry.

Aseem: One of the things I admire about you and the team, Anshu, is just this notion of growing right versus growing in an inflated way. And I love the fact that you’re looking at 2023 from a, Hey, what’s today? What is one year out, and what is the 10-year out change in this industry look like? And aligning yourself with that. Anshu, it’s amazing to me how the team has come together and how you’re hiring, and how you’re growing. You know, you talked a lot about you’re so focused, and you’re so close to the problem, but who is your sounding board? Who do you go to for advice? Tell us a little bit about that.

Anshu: You know, as I said before, I think people don’t scale, and that goes for founders. I think a lot about people who can work on the business as opposed to in the business. And that’s where our literal board folks at Madrona, but also just generally people from outside of Leaf Logistics, can look in and see what they see. So, I make it a point to start my week with external advisers and to bookend the back half of the week with the same because, at the end of the day, I’m not building this company for anybody aside from the problem. And the problem needs to be solved furiously, sort working on the problem from the inside is insufficient. It needs to translate. And so that external perspective is really important. I think, for me personally, making sure that the blinders aren’t on too tight in terms of the narrowness of scope. I probably read more widely than I did at the earlier parts of the company’s growth. And I’m always on the lookout for things that will just be absorbing and bring different perspectives. Understanding what’s going on in other fields, being able to speak with people who’ve just done outlandish things in other disciplines, and understanding what types of models of leadership there are. Entrepreneurs who are further along on the journey are incredibly helpful to learn from because they have run through some of the roadblocks, and they’re incredibly generous with their advice. So I think those are the three areas. Really making sure that the personal growth at least tries to keep pace because it’s not realistic that any of us evolve that rapidly. But it’s a lot of fun. And it’s a lot more interesting and multifaceted than it might feel on a day-to-day basis.

Aseem: Anshu, any parting thoughts for founders who are new or first-time founders or thinking about walking in your shoes and are just maybe a year or 18 months behind?

Anshu: I, I asked that question of founders 18 months ahead of me, and I benefited a lot. So, hopefully, this is of use to some of you. Really two things. One is to ask for advice and ask for people to pressure test your problem. And funding and fundraising will come with that. Asking for advice will bring you money. Asking for money will bring you advice, as somebody told me early on in my journey. And that was really helpful. And every single partner that we have today, we engaged in a conversation outside of, and well before, there was a fundraising opportunity. So, it was really about understanding do we see the problem the same way or do we see pieces of the problem that we could be helpful to each other before it was time for fundraising.

The second is, clearly, there are a lot of exciting things about the fundraising process itself, but if anything else, it’s a learning opportunity. You’re not just pitching your company, you’re getting an understanding of who else is out there, what perspectives they have, and what can you learn from. If you really love the problem you’re trying to solve, it’s not about winning the argument or getting your point of view across. As fun as it is to watch Shark Tank, it is not about trying to convince people to just follow along with your way of thinking. It’s about making your thinking better, so you can solve the problem you came here to solve. And the best thing I think I can say about working with Madrona and other key investors and partners, and advisers that we have around the table is they love the problem just as much as we do.

I will get pings, texts, and phone calls with ideas around why does this or why not this as much from people that are not working the problem day to day as those who are, which gives me a lot of confidence that I think we have the right team assembling to really solve something that matters over time.

Aseem: You know, I will say that having known the team for quite a bit now, I have had a deep level of appreciation for this industry and the challenges that your customers face on a daily level. And I often find myself wondering, where is this person driving the truck going from point A to point B? Where are they going? Like, how much load are they carrying? And it’s fascinating. If you’re in that job, you’re powering the economy, and yet you have a suboptimal experience as a person who’s doing a very tough job, and I think I, I feel nothing but empathy on that front, but Anshu, thank you so much for taking the time. And we couldn’t be more thankful to have you on this podcast and for sharing your words of wisdom. Good luck in 2023, and we are excited to be on this journey.

Anshu: Thank you, Aseem. Thanks for the continued partnership. It’s going to be an exciting year, but there is much more to do.

Coral: Thank you for joining us for this episode of Founded & Funded. If you’d like to learn more about Leaf Logistics, please visit their website at leaflogistics.com. Thanks again for tuning in, and we’ll be back in a couple of weeks with our next episode of Founded & Funded with Common Room Co-founder and CTO Viraj Mody.

 

Lexion’s Gaurav Oberoi on Applying AI to Change an Industry

 

Founded & Funded IA40 Lexion with Guarav Oberoi

In this week’s IA40 Spotlight Episode of Founded & Funded, Investor Elisa La Cava talks to Lexion Co-founder and CEO Gaurav Oberoi. Lexion was one of the first spinouts from AI2, and Madrona invested in the first round the company raised in 2019. Like many companies that come from AI2 – Lexion is focused on applying AI to change an industry. Specifically, Lexion helps legal teams at enterprises manage contracts – and they are one of the companies that have added features using OpenAI’s GPT technology.

I’ll go ahead and hand it over to Elisa to dive in.

This transcript was automatically generated and edited for clarity.

Elisa: Hello everyone. My name is Elisa. I’m an investor with Madrona Venture Group, and I am excited to have the CEO of one of our portfolio companies on the podcast today. Please meet Gaurav. He is the CEO of Lexion, Gaurav, welcome to the Founded & Funded podcast.

Gaurav: Thank you Elisa. It’s great to be here. I’m excited to talk to you about Lexion.

Elisa: One of the things that we love to talk about is the founding journey. You’re not a first-time CEO, first of all, and you’re not a first-time founder. I would love to hear some background on what in your career led you to this point of founding Lexion.

Gaurav: Yeah, absolutely. I studied computer science when I was in college. I enjoyed writing code as a teenager, and I knew I wanted to get into technology when I grew up. I moved to Seattle a long time ago in 04′ to work for Amazon as a junior engineer. And it was a really amazing place to learn how to build software at scale, build amazing products, and work with incredible engineering talent. I’ve always had the entrepreneurial bug and soon after that, I left to bootstrap my first company. And in my career, I’ve bootstrapped three companies, exited two, and one still runs itself. This is my first venture back company. I started Lexion in 2019 is when we launched the business. And the year before that I had spent at the Allen Institute for Artificial Intelligence as their first entrepreneur and residence, working with their research scientists and team, looking at what are the new advancements that are coming out of AI and looking at ways to commercialize them. This was 2018 when I went there, and in the years leading up to it, we had these huge step-function improvements in a lot of machine learning applications, you know, ImageNet and our ability to detect objects and images and classify them, and then revolutions happening in NLP. And so for me, it was how do we take these innovations that are real and bring them into products that actually help people get their jobs done.

I met both of my co-founders, James and Emad, at the Allen Institute. And actually what has become Lexion today, really started with Emad coming in and pushing us to look at some of the new NLP breakthroughs that were happening and applying them to a problem that his wife felt at work. She worked in procurement at a very large telco.

Elisa: I’m sure you get this from other aspiring founders, aspiring CEOs, thinking about, “Hey, I have this inkling of an idea, I kind of want a co-founder to join me”. What advice do you give future founders on how do you find a great co-founder partner to build this big idea with?

Gaurav: So my advice to folks looking for a founder, find people who are complementary to you where they can augment your strengths and maybe not duplicate them. Find people that you can have a very honest relationship with right from the get-go. That is really central to building a business. And find people that you really like and admire. People you can learn from that you respect, that you’re like, wow I wish I had some of that person’s qualities. I think those things, the right strengths to help you build your business, a good trusting relationship, and someone you look up to, those things actually go a long way.

Elisa: Wow, such deep-seated respect there and it’s just incredible.

Gaurav: It doesn’t hurt that Emad is incredibly accomplished in the field of natural language processing and James is one of those hundred X engineers that you hear about. So those strengths definitely help, but I love hanging out with them. They’re wonderful people and that really helps us get through the difficult challenges of building a business.

Elisa: So I mean, you started in mid-2019. Now we’re in early 2023. You’ve been at this for a few years at this point. You’ve gone from, your three co-founders to now a team of, is it 50? 52?

Gaurav: That 50 number sounds great, except as I learned from my legal team, it comes with all sorts of new rules and regulations we have to adhere to. So there’s also that.

Elisa: Well, maybe you put some of those contracts through Lexion to help you understand everything.

Gaurav: Oh, yes. Absolutely.

Elisa: Well, let’s, use that as a perfect segue into talking about how you and Emad and James and now your expanded leadership team, including Jessica, have thoughtfully considered how do we grow Lexion into this incredible outsized business over time. What was that philosophy going in together?

You mentioned earlier, Emad is the real deal when it comes to natural language processing and his understanding of ML. James Baird, an incredible engineer. How did you think about that formation at the very early stages when they sat down, you all began to code, what did you do?

Gaurav: So for us, the early days were really about recognizing that there is a huge opportunity in automatically understanding the contents of long-form documents. At the time you have to recognize all of the big cloud providers Microsoft, Amazon, and Google did have APIs for text parsing, but they were all really aimed at short-form text. So think a customer review or a support ticket or a Tweet. There was really nothing out there that would help you understand the contents of even a page, let alone a 50-page contract. And none of them also dealt with the complexities of the very nasty format that many contracts are in, which is PDF, which is a very poorly standardized format. So that was the opportunity. And we knew from the early days that there are myriad applications and we’ve seen companies over the years expand into many of these, contracts being won commercial contracts that we focus on, but there are also companies that focus on looking at case law and what’s happening in the courts. There’s companies that focus on patents. There’s also companies that look at big banking contracts and the big LIBOR scandal and moving away from it, there’s a whole business around doing that.

So we knew that opportunities abound because back then, while those companies didn’t exist in their current forms, there were businesses that were doing this with lots of human labor. And for us we’re like, just fast forward five years, if you do the thought experiment and this NLP technology matures, the world isn’t going to look like that. There’s going to be technology either assisting these humans or removing some of the really low-value tasks that they do. So right from the get-go, our hypothesis was if we can build a system where you can come to us with a pile of documents like Wilson Sonsini did in the early days for proof of concept. They came to us with a pile of venture financing documents and said, “Hey guys, if you can quickly design models that will go through term sheets, certificate of incorporations, voting agreements, stock purchase agreements, and spit out for us answers like what are the liquidation preferences, what are the pari-passu rights, what’s the pre-post money?” That could be really interesting because we spend considerable time extracting this information when a deal is done.

Elisa: And let’s pause for a second. We’re talking about thousands of pages of documents that normally a lawyer would need to review, get an eye on each page going into different clauses, finding out what different terms are, tracking them down, and then organizing it all in one place, and then getting onto the part that is their job, which is then what do you do about it and what are the next steps?

Gaurav: That’s right. And with our prototype back then, our goal was how can we quickly go from, here’s a pile of documents, to here are very high-quality AI models that can extract this information reliably. And also a UI that helps the user then gain confidence and identify any issues. Because I think these things go hand in hand. So that is where we started, was the crux of our technology, and we knew that we have something. Because Wilson Sonsini from those early days based on that proof of concept, entered into a commercial relationship with us to help do this processing for their knowledge management teams. But then also became an investor. And David Wong, their chief innovation officer, still sits on our board and has been an enormous help. So that was the early days. You know, and the other cool thing to recognize is in 2018, there was a groundbreaking paper that came out of AI2 called the Elmo Paper. And soon after that, Google built on top of it and cheekily called it Bert. Bert was one of the early large language models that distilled language in a way that made it richer and made representations of language or embeddings, richer so you could get more value out of them when you work with them and fed them into your neural nets.

And so that was one of the innovations. The other innovation that we were highly inspired by was looking at the deep dive project, which eventually became the Snorkel project. And looking at their approach of weak supervision. And so we combined a variety of these ideas and built the initial technology prototype that got us to launch the company and go raise a seed round. So those were the early days.

Elisa: And this is exciting because what you’re talking about is the intelligent repository product, which was your very first product, and you were testing it and ingesting and training with information from Wilson Sonsini, the law firm. But then how did you then move into your sector of customers today, which looks a little bit different?

Gaurav: Yeah they’re very different. We did not keep growing into big law. We actually moved to selling to corporates. There were a few reasons. The biggest one is just the market size. There’s a much larger market serving corporates.

The second was the magnitude and urgency of the problem. We just found as we started talking to in-house council that there are all sorts of challenges they run into with managing their agreements, specifically with managing executed agreements. Things like, “Hey, what are all the vendors that are coming up for renewal next month? Oh, we don’t know”. Or, “Hey, there’s been a data privacy change in California. Which contracts do we need to go and amend to address these issues?” We don’t know. So all sorts of analytic questions that one, help with the day-to-day running of the business. Finance, trying to do revenue recognition, or somebody trying to pay a vendor, or, “Hey, is this NDA active or not?” Two more complex queries that would happen periodically, like the ones I described, laws changing. So urgency of the problem was there. We also had insight from Emad’s wife, working in procurement, and other friends looking deeper into the bowels of large enterprises and seeing how those manifest there, like “Hey, until we structure these contracts and type them into large systems for procurement, for example, we can’t really operate our procurement systems correctly.

So a lot of energy and effort goes into people reading contracts and then typing in the handful of things that are in there. So it was clear from those that the market opportunity and the need, the urgency both exist in corporates. And so we started to make our way towards corporates. Unlike a lot of other CLM companies, we took a very different route in that we didn’t really build the end application, the repository with all its features first. We instead focused heavily on building our machine learning stack, and it meant that it took us longer to get to market. It was a higher initial capital investment. But it was a very conscious decision on our part because we recognized that, again, if you look five years into the future there, there will be players that are going after this opportunity, but the ones that will differentiate themselves are the ones that can dramatically alter the amount of effort that human users are having to put in.

Elisa: I love what you’re touching on because one of the ‘aha’ moments over the past few years is falling into that realization of these in-house councils, there’s often only one person supporting and lobbying back and forth these contracts. There’s the whole sales team that’s trying to get their deals done. There’s an ops team that is supporting, maybe there’s a customer success team or account management teams that are working with existing customers trying to get them renewed or upsold and in a certain way there’s this critical bottleneck that happens with the in-house council in working with all of these contracts. And so the ‘aha’ is what tools do these people have at their disposal? Not many …

Gaurav: Email. Spreadsheets.

Elisa: Email and spreadsheets which is a very natural workflow and, you know, you make it work. But they’re a fairly under-resourced and super critical part of what we’re kind of now calling the quote ‘deal ops process’. So thinking through that intentional investment in embedding AI and ML deep into the platform at the very beginning so that it could create that seamless magic for the in-house councils. And what you see now at your current customers is paying off in dividends.

Gaurav: It really is. And you’re absolutely right. We have since evolved the platform to help all of these teams get deals done faster. If you go back to the beginning, we started with let’s invest heavily in a deep NLP platform and we continue to invest in that. On top of it, we built a repository application, which will do things like, as soon as your contract is signed in DocuSign, your general counsel doesn’t have to download the PDF, open it to find out who it was with and when it was signed, rename it at their file convention, and then drag it into the right folder in Google Drive. No. Instead, we’ll just automatically do all that. We’ll pull it from DocuSign, identify it was with, and index it away. We’ll give you great reporting. We’ll automatically give you a list of alerts and reminders. Boom. So that was our repository. And then as we continued to grow the business, we started to hear customers say, your repository is amazing. It helps us with post-signature contract management after it’s signed. But what about pre-signature? What about all of the stuff that goes up to signing it? Generating it from a draft or a template sometimes. Just the negotiation and managing all the various red lines and drafts that happen. Getting approvals is a huge part of the process. And then things like task and status reporting. And so we started to see a lot of demand from our prospects. And this led to the next evolution of the company, which is where we are now, helping operations teams accelerate deals.

At the time, I was both excited to go after this opportunity and a little hesitant. The excitement came from natural market poll. When you hear something from your customers, listen to them, and we kept hearing it again and again. So they’re people ready to open their wallets for this. On the other hand, it’s a very competitive space. There are other contract management and other workflow automation companies that try to help with a variety of these areas. And so before we jumped into it, we spent a lot of time speaking with over 50 in-house councils, current customers, users of competitor products, and prospects to understand what is working and what is not working. And we heard one thing very consistently. It’s that a lot of these CLM projects end up failing just in the implementation phase. When you look at the effort companies put into this, it’s not just the license fee you pay to the vendor, it’s the training time, it’s the change management of it all. And if you don’t realize the benefits, it’s very taxing on the organization because everyone still has to get their daily jobs done. And that’s when it clicked. We said, “You know what? The way that we can really make a product that addresses change management and adoption is if we really focus on making something that the rest of the business can use out of the box.”

Elisa: And that’s an incredible learning. How do you iterate and hear feedback from an early set of customers or design partners that are helping you understand what features are most valuable? How much pull are you hearing and repetition about certain things that they want to be able to do moving forward?

Just hearing you talk about that now and what we can help share with other founders is listening to your customers. Come in with a point of view on an understanding of the workflows, not just of the team you’re helping, but the surrounding teams that they touch and how do they get their job done, and then what are different ways that you can remove friction in that process makes any software solution something that the core users are going to say, ” over my dead body, you’re going to take this away because it’s so critical to helping me get my job done.”

Gaurav: That’s right. And it is common advice. Listen to your users, and iterate based on them. There are a few things we did that helped us get there. One very early on, we recognize that this is a very specialized group of people — in-house council. And so we were very lucky to bring Jessica Nguyen on board. She has had a career, spanning lots of different scales of business, working in-house from Avalara in the early days, to Microsoft and working in a large tech company where she got to meet Emad, and then to being general counsel at PayScale. She kind of saw it all, and she was really the ideal person because she understood the problem. She has a lot of respect in the community, and she’s just an incredibly charismatic person. She helped us in so many ways. One, really understanding what are the problems customers face, what is useful to them, and what is fluff. How do you message so that people listen to you and aren’t just turned off, with, oh, you said AI, and I don’t really know what that means? And it sounds buzzy versus, oh, actually, you know, if we just tell them, we’ll automatically file your contracts for you and give you a reminders report. Okay, now you’re talking of value. From those kinds of things to testing product features and then all the way to helping us bring in customers, and run webinars — she really helped us understand that.

The other thing I think that has really helped us is, right from the beginning, our culture has been very customer obsessed. One of the core traits we have in our culture is to always ask why. Think it really shows when we talk to customers and they tell us I really need help with pre-signature. Why do you need help with pre-signature? And then we’d start to hear stories like I’m a team of three and me and two other council, and we’re supporting 60 salespeople. And our company is growing, next year we’re going to grow to a hundred salespeople, and I’m not getting any headcount, so I need help.

Why? Why do you need help? What do you do? Oh, all these contracts come in. Some of them are bespoke. We have to negotiate them. Others, I feel like we don’t need to touch, I want to automate them. How do we do that? And then we start to get the picture and we start to hear other stories. Oh, at the end of the quarter when we’re doing a deal rip, we’re going through our 40 deals, and these 11, just say legal. What the hell does that mean? And I tell my AEs to email them a week in advance to get an update. But it takes days to get an update. So I’ll ask the council, why does it take days? Because there are three of us and it’s all in our mailboxes and we have to update a, a spreadsheet. And you begin to understand that these teams are trying to do the best they can with the tools they have. And so that has been our natural evolution being closely embedded with these teams — listening to them, we’ve gone from a core NLP technology prototype, which is still at the core of our machine learning infrastructure, then to an intelligent repository for your contracts to an end-to-end workflow automation platform for these operations teams.

Because here’s what we also learned when we went back to council and said what about these 11 deals that just say legal? They would say, “Dude, no three of them are in legal.” The others. There are a few that are in IT security review. Finance is looking at some because of commercial terms, and like two are sitting with the CEO, who’s the one complaining about it. It’s in his mailbox. We need approval. When you really dig in, we began to realize, wow. This isn’t just about the legal team to get deals done in the company, whether you’re closing a customer deal, onboarding a vendor, even getting an employee onboarded, or doing an RFP or a security review, you’re going to touch a lot of the same teams.

You’re going to touch sales and revenue ops or procurement. You’re going to touch IT. You’re going to touch finance, you’re going to touch legal and maybe HR if it’s an employment matter. And in all these cases, the activities are also similar. You might be generating something from a template or you might be negotiating something back and forth with red lines. And then you’re going to, at some point need to get a bunch of approvals. As soon as you close a customer order, finance is going to say, “Hey, where is it? Because I need to send an invoice.” And that invoice data is in the contract. It doesn’t go into your CRM. So…

Elisa: Right. And by the way, you’re going to be renewing said customer a year down the road, and they might get a new contract. This process starts over. To put a finer point on one of the things that you just said around the evolution of the product. One of the beautiful mixes of art and science in early-stage company building is how do you decide what features to build and in what order. You mentioned, deciding one day as a team we’re going to add pre-signature work into Lexion. Based on what I remember, pre-sig, it was at least a few more quarters out on the roadmap at that time. It wasn’t an imminent build scenario. You had a lot of other things going on and a lot of other high-priority items the team was working on. But I would love to hear how did you decide which capabilities in this case, pre-sig need to be so prioritized that they have to be pulled forward. How does that decision-making process work for you?

Gaurav: As you know, these decisions don’t happen overnight. There’s some undercurrent of, we’re hearing this from customers and we discuss it in a meeting and it’s ” Hey, we should definitely do it in the second half of next year. That’s how it gets into a later part of the roadmap. So you start to build a thesis on why this is important. What can cause it to tip over and say, actually we, we need to accelerate the priority on this is, you know, one thing I found really useful are board meetings in bootstrap companies, you don’t do board meetings because you’re just going to hang out and chat with your founders or you don’t always. But one thing I found very helpful about our board meetings is it’s a time to pause and reflect on the business and look at some of the data because day-to-day you are, you’re very involved in getting it done. Shipping product, closing customers, and helping existing customers succeed. And these board meetings allow us to reflect and some of the reflections we would look at is our wins and losses in our pipeline. And as we started to look at the reasons, we increasingly heard comments like, we love your repository, but we also wish you had pre-signature workflows. And when we talked to some of our customers that had purchased our repository but had another product for workflow, they expressed the same. They said, yeah, we would love to have one platform. We only have two because neither platform has everything we need. So it was a combination of having a huge amount of signal in our active customer pipeline that told us that if we made this change now, we would actually see different results in a quarter from now because our salespeople would actually be able to close these customers that we’re having to turn away. So in this case, the acceleration was a combination of customer demand and having built up a thesis as we’re doing this of customer research and building a point of view on, if we were to execute this tomorrow, what would it look like? How are we going to do something that’s really going to stand out and give us a moat as opposed to just copying, maybe what other products are doing.

Elisa: What you’re describing is what is classically referred to as reinforcement of strong product market fit. You are hearing pull from your existing customers saying, we love what we have and we want more. And so this is an amazing moment where as a founder you probably said to yourself like, “Hey, we’ve got something. We are like rocking. We have momentum. Let’s keep going.” We need to pull forward, these really critical…

Gaurav: This is what you wait for. This is what you hope for in Startupland — when a bunch of customers with a real problem tell you ” this is a problem. If you solve it, it’s really worth it to both of us.”

We had another such moment earlier this year where one of the things we started to hear from customers was, “Hey, look, you do have ways to gather approvals in Lexion, but we need more sophisticated automated approvals.” And we, we again, talked to our customers and looked at what competitors were doing. And this was a, another case where it was clear we needed to do it. But Emad and Chris, who runs the product and came from Smartsheet and is an incredible product manager, both of them said there’s a missed opportunity here if we just go and wrote build a sort of approval chain like a lot of the other products on the market. The real opportunity here is to build a generic workflow automation tool. Because if you think about it, you could say, if this is greater than 50 grand, then seek approval from finance. But what if the action was to seek approval from finance? And then update the Slack channel saying, “Hey, finance, we’ve sent you a ticket, if someone can jump on this, it’ll be helpful.” Or once finance approves, why not then go file a Jira ticket to it to do the security review because they work in Jira and that’s where they want to be. And so the realization became if we do this right, we can build an incredibly flexible tool that will allow these backend operations teams to further stitch together the systems they use and express even more complex chains automatically. But using the same UI and the same infrastructure, it’s really triggers and actions. What’s the trigger? Hey, did you submit this ticket? And then what’s the action? Ask for approval, add a follower so they’re in the loop, set an owner so they work on it, update a Jira ticket, and so on.

And so this was a case where we actually knew that if we raced to build this feature, we would close more deals in our pipeline and have more upsell opportunities for our customers. But we actually made the conscious decision, much like our investments in ML, to say, okay, we have to look at what these teams are going to be doing on our platform. And if we pause and build a richer infrastructure, then we’ll be able to deliver a lot more value.

Elisa: Having that thoughtfulness to understand that customer journey, that user workflow, I mean, this goes for any company, is the most critical in understanding how do we start and build the infrastructure of our platform today so that we have option value for areas that we already have some kind of conviction will become critical for our capabilities in the future.

Gaurav: Yep. I have to say this is possible because of a few amazing things that happen at Lexion. One, Emad has just built an in incredible engineering org. We have a very small engineering organization for the surface area of product that we support. And Emad has been very methodical in how he’s built up the team. But then the other is making sure that everybody in the company, down to the engineer building the feature, is very aware of why we’re doing something so it doesn’t feel like there’s whiplash.

In fact, we follow a great road mapping process. Chris is again, is, he is just an amazing product manager. I love going to Chris and saying, “Chris, oh my God, we really need to build this thing. I really think it’s time.” And he is like, “Yeah, I agree with you. What are we going to cut? Let’s look at the list.”

Elisa: Ruthless prioritization!

Gaurav: Uh, And sometimes I walk away being like, oh no, you’re right. Actually, we’ve already done this exercise. So we really have an amazing team.

Elisa: Everyone says they have an amazing team. Everyone says, “Oh, my CTO is great. We have AI built at the core.” But I think in the case of Lexion, the power of the customer love that you guys receive, kind of echoes and reverberates across the investor community even where we perk up our ears and say, Hey, what’s going on with Lexion? And Lexion was a winner this year of the Intelligent Applications 40, which is an award that we run Madrona, where we ask 50 of the top VCs across the U.S. To vote for which companies did they believe are building the most intelligence into their products. And Lexion was a winner in the IA40 this year for the early-stage company category, which is incredible.

Gaurav: We were so grateful for the recognition.

Elisa: Yes. It’s amazing.

Gaurav: It’s been a really good year for us. It feels wonderful to get this recognition because of the amount of effort and investment we put into our AI. One of the things that we’ve learned over the years is if someone comes to you and says, I have 5,000, 10,000, 20,000 contracts that have been sitting in my SharePoint folder or Google Drive, and we really need to understand what’s in them because we want it to be loaded into Salesforce and Coupa and understand renewals, etc. We need your help. And from the beginning, when we would ingest these contracts, we know that the algorithms aren’t perfect. Depending on the models, you could have 95% accuracy or it could be a little lower, and so you’re going to have some errors. And right from the beginning, we knew that there should be some human in the loop before we hand this off to the customer.

Now when we look at the competition out there, we’ve seen companies that have themselves gone out and said, oh, we have lower gross margins because we have a large team that helps do the human in the loop part. Which to me really meant that their algorithms are not doing the amount of work that you’d want them to do. They’re not working as well as they should. For us, I remember early board meetings whereas our volume started to grow and customers started to come in, even we discussed, “Hey, should we look at augmenting our labor by partnering with larger offshore teams and things like that.” We made a very conscious decision and said we don’t want to create a tech-enabled services business. On the contrary, we should keep higher skilled people on our team full-time, but far fewer of them. And we’ve reduced that team size over the years as volume has gone up. Instead, we’ve said our whole process should be, if somebody comes in with a bunch of contracts and their errors, we’re not going to fix any of them manually. There should be a close collaboration with the ML team, and we should build the right tooling so you can click, retrain the model, rerun it on our validation set to make sure it hasn’t regressed, and then roll it out to the customer and improve the customer’s results. So, you know, there are significant investments there. We’ve built our own annotation tool, we’ve built our own model training, model versioning, stage deployment, and it has really paid off because it’s allowed us to accelerate how we improve these models, accelerate delivering new models, and serve a higher volume of customers with more contracts at an incredible price because we’re using technology to solve the problem, not people.

The other thing we do is we stay abreast of the latest research. We’ve been lucky to hire an incredible machine learning team. And with them, they’ve brought a culture of paper reading, of wanting to contribute to academia. And along with this, when GPT-3’s API was first released in 2021, we started to experiment and said well, first we need to understand how do these models perform at the task we already do. Can they extract parties and dates and summarize clauses better than we are and faster at a better price? And, you know, we were quickly able to identify not really, there’s still a lot of gaps to get there. But what new things can they do and how do they match to customer value? Even back then we knew that eventually, we would want to get into helping teams negotiate the actual contract itself or complete a security questionnaire itself.

Elisa: Everyone’s talking about ChatGPT and foundation models. What does this mean? And you’re saying, Hey, we were testing this a year ago. But the great news is what that evolution meant in terms of new magic in the product.

Gaurav: Yep. Absolutely. What it’s meant for us is, that earlier this year we released a Word plugin. This was in preparation for releasing AI features alongside your contract editing experience. And even there we talked a lot about whether we should we build an in-browser editing experience or should we do it in Word, which is where a lot of our customers live. And that’s where we ended up going. The initial release was really about just getting the canvas out there and providing some value. So, you can just click a button, edit in Word on Lexion, the document opens in word, you can edit it there and hit save, and we’ll do version management. It’ll go back into Lexion without you having to upload files and rename files and all that. We have a roadmap on what we want to release, starting with being able to identify clauses and say, “Hey, here are clauses from your playbook or from your prior contracts that you may want.” And all the way to automatically looking at a contract and saying, “here are the high-risk and low-risk areas.”

When Da Vinci 3 was released in late ’22 we continued to experiment and said, “Hey, let’s go see how this performs against some of the tasks that we’re giving it. And we saw remarkable improvements in generating contract clauses, and in proposing edits and because we have several in-house lawyers — Jessica is just one of them. But Krysta, who runs BizOps has lots of experience with negotiating deals and contracts. Staci on sales enablement used to be a lawyer. We have a lot of people with experience that we can test these ideas with. And when we started showing it to them, the ‘wows’ were immediate and we’re like, okay, this is great. Let’s start showing it to some customers in this prototype form. And again, we started to see, oh wow, this is very helpful. And that’s when we knew we should really move around a bit of our roadmap and accelerate getting this into the hands of customers.

And so we rolled out AI Contract Assist in December. It is a Word plugin that helps you generate new clauses or edit existing ones. You can do things like highlight a big old payment clause and in colloquial language say, “Hey, can we modify this to be net 90 and quarterly billing, and I don’t want any payment fees.”

Enter. Literally, you can type that and we will show you red lines in line that you can then accept or reject or ask for another suggestion. And this is just the beginning. The fact that we have your entire team’s workflow. We have the email that came in, “Hey, the customer wants quarterly billing and net 90, are we cool with this?” And we have all your historical red lines because we manage drafts and we have the final executed contract. We have a wealth of data to train these models. This is a very exciting area of research, but also exciting because we think this is going to turn into products very quickly and start adding value.

Elisa: The magic of what you’re talking about is incredible. I know this has been a hot item since you’ve shown it to some of your customers and, we’re very excited for the year ahead. We’ll pause there. One of the things we like to end on is a couple of lightning round questions. So to wrap things up, the first lightning round question is what do you think will be the greatest source of technological disruption?

Gaurav: It’s probably already passe to say GPT X or N. I don’t know. There are so many exciting and interesting things happening in the world right now. It’s hard to say, which is going to be the most disruptive. Some of the things that I look at, we’re going to see AI become pervasive in applications. I’d say this is a foregone conclusion and not something anybody is surprised by. But I think we will also see changes to how we consume and produce energy over the next 10 to 20 years and how we think about long supply chains versus shorter ones. And I think there’s going to be a lot of opportunity in how we think about tackling climate change using energy-consuming products.

Elisa: Next question. Aside from your own, what startup or company are you most excited about in the broader intelligent application space and why?

Gaurav: I’m inspired by GitHub Co-pilot. It’s a remarkable addition to a developer’s tool set. I think it’s very far blown that Co-pilot will start writing entire blocks of code. Having been a developer and enjoying writing code for fun, I see the benefit of removing a lot of boilerplates, making it easier to work with new libraries, of being able to jump in and produce something a little bit faster. And think it’s the early innings for co-pilot. I think it’s going to be quite a transformative product for GitHub, but time will tell.

Elisa: All right. Next one is, what is the most important lesson likely something you may wish you did better, that you’ve learned over your startup journey?

Gaurav: I think energy and emotion management is closely tied to sleep and diet and exercise. I find that if I’m having a bad day or, you know, it’s, it’s a tough day, I’m able to deal with it a lot better if I’ve just taken care of myself and done those things. And it’s a lot harder if I haven’t. I’ve generally not been very good at listening to my body and taking care of those things, but making a conscious effort really pays huge dividends in my ability to have quality output in a given day. I know it, it’s such obvious advice, but I think a lot of people don’t really take care of themselves in the way they need to. And when you’re in a high-performance dare I say sport, like running a startup, you need to be in good physical and mental shape. And it is just as important to take care of these things as it is any aspect of your business or your team, or your family.

Elisa: So important because it never really slows down so then you just have to make space for yourself. Okay, last question. What’s something you’re watching or reading right now?

Gaurav: I am a science fiction junkie, so I just finished reading “Termination Shock” by Neil Stevenson, and now I’m reading, “Dodo,” his other book. I’m a big fan of Neil Stevenson. He’s also a Seattleite, which I love.

Elisa: All right. Well, Gaurav, thank you so much for this amazing conversation. It’s been such a pleasure to work together the last few years, and so excited for the direction Lexion is headed and this big opportunity, and it’s just such a pleasure to chat today. So, thank you.

Gaurav: Thank you for having me. This has been really fun.

Coral: Thank you for listening to this week’s episode of Founded & Funded. To learn more about Lexion, please visit Lexion.AI – that’s L-E-X-I-O-N.AI. If you’re interested in learning more about the IA40, please visit IA40.com. Thanks again for joining us and come back in a couple of weeks for the next episode of Founded & Funded.

 

Magnify’s Josh Crossman on Incubating a Startup and Bringing AI to the Customer Lifecycle

Welcome to Founded & Funded. My name is Coral Garnick Ducken — I’m the digital editor here at Madrona. Today, investor Elisa La Cava is talking with Josh Crossman, CEO of Magnify, which was incubated at Madrona Venture Labs. Josh was actually recruited by Madrona Venture Labs to help launch a business that would bring AI to the customer lifecycle. He was quickly persuaded and signed on in 2021, spinning out of MVL in less than three months with a $6 million seed round.

In today’s episode, Josh and Elisa discussed the incubation process and how Magnify’s intelligent application to improve customer retention, expansion, and adoption is solving one of the biggest pain points of the customer experience — focusing on and understanding the needs of every single user. They also dive into finding product-market fit and the importance of incorporating AI/ML into a product from the very beginning. I’ll go ahead and hand it over to Elisa to dive into all this and so much more.

This transcript was automatically generated and edited for clarity.

Elisa: Well I’m so excited to be here today I’m Elisa La Cava — I’m an investor on the Madrona team, and I have the distinct pleasure of having a conversation with Joshua Crossman. Josh and I have known each other now for a little over a year, since we invested in Magnify’s seed round. And today’s topic is all around very early-stage company building. Josh, you have been in the trenches, literally going from zero to one, building a company from ideation to launch and there are so many incredibly meaty topics we can cover, and I’m excited to dive in. But first I just want to give you a chance to introduce yourself.

Josh: Yeah. Thanks Elisa. So I’m the CEO and Co-founder of Magnify, the operating system for the customer lifecycle, and I’m really excited to be here and — let’s dive into it.

Elisa: So the customer life cycle, that’s a like a big statement, right? Everything, especially in today’s economy, it’s all about how do we make sure our customers are happy. In software that means are they using our product the way that we wanted them to? Can we get more folks to use the product over time? What does it look like years down the road when you want them to continue to be happy, thriving customers and utilizing all of the new products and features that you’re building? Sometimes we call that process post-sales orchestration, which can be a mouthful — how do you think about what that space is?

Josh: Yeah. The whole concept is exactly what you’re talking about. The challenge is that we’ve built these really amazing technologies in the software industry — particularly in B2B software, and enterprise software — but most enterprise software companies have real significant challenges with adoption and retention. And so what Magnify is doing is bringing automation, bringing AI/ML, bringing software into a problem that software faces it in itself. It automates and personalizes that customer life cycle. And fundamentally, that’s about understanding the needs of the user — what are their challenges and how do we automate and connect with them in ways that can transform their experience in really delightful ways? It’s a real shift from the way that traditional enterprise software thinks about working with their customers and working with their users. And we think it’s one the industry’s really ready for.

Elisa: Let’s talk about that shift. What is the status quo? Why does enterprise not get this today, and why is this a huge pain point that is worth solving?

Josh: Let’s start with kind of the current state of the state. Let’s say you buy a piece of business software — what typically happens is that you’re assigned a human being called a customer success manager. And this customer success manager is this wonderful human that is going to work with you over the course of your onboarding, your adoption of the product, ongoing usage, retention, your experience. This is the account manager for you that is really centered on making sure that you get value out of your software product. And I’ve run some of the largest and most highly regarded customer success teams in the industry. And I have nothing but love for customer success.

Elisa: Well, and it’s important, right? You are the voice and the face of that company and that software. You are the point person they go to when something goes wrong.

Josh: That’s right.

Elisa: You know, when they have questions about things they can do better. It’s like, this is the one person on your team that is always a go-to.

Josh: That’s right. Sometimes we call it “The one throat to choke,” when things are going bad. Usually, we like to say it’s your single point of contact that’s here to make sure you are delighted by our piece of software. And so this human being is doing great work, and we’ll call her “Sally CSM” and Sally CSM is talking to you every day maybe every week or maybe every month, depending on the nature of the engagement. The challenge is that Sally’s only talking to Elisa, and Sally has another 15, 20, 30 other accounts that she’s managing. Sally just doesn’t scale. Really the model and the industry has really been relying on that customer success manager working with a single point of contact and then that point of contact in turn driving adoption and usage out into the rest of that business, into that enterprise. And Sally never talks to the thousands of users at Elisa’s company. She can’t. She’s a human being with like finite time and finite capacity. And that just doesn’t scale. You can’t scale the personalization.

And with the rise of product-led growth, with the rise of user adoption, we think there’s a real change needed in the way that we think about it. We’re still going to have CSMs. We still need that. That’s absolutely essential. And we think that we need to start centering on the user. So much of everything we do in, in software and enterprise software is centered to the account level. And we have to get to a place where we’re thinking about every single user, no matter the size of the account, and understanding their needs, understanding their behaviors, understanding where they are and their adoption journey, understanding what are their excited and thrilled, and where they’re frustrated and understand how can we automate and personalize that experience for each and every user.

Elisa: This is exciting. I love this space. I love what you’re building. Let’s talk about what building a day-one startup feels like. You co-founded this company literally day zero to now with product launch. And you also had an interesting path that I want to talk about in how you did that, which was through a venture lab. When you started working with Madrona Venture Labs to build the idea for Magnify, what was your goal?

Josh: So, I’ve been in tech for over 20 years now. I’ve been a senior executive at a bunch of different companies, scaled companies, taken companies public, and as a GM I took a company from single-digit millions to almost a hundred million and profitable. The last one we scaled and then it was acquired by a public software company. So, where I was in my process after we sold the last company, I took some time off. I sort of poked my head up and said, “What am I going to do?” And I was in conversations with a late-stage data observability company doing some really interesting stuff. They’d just taken down a big round and they wanted to bring in sort of a COO/ president type to help run the company and work with the CEO founder. And I thought, oh, that’s great. It’s a perfect kind of role for me and let’s go do that. And then I get this phone call, and this phone call is from Madrona, and I know some of the partners and folks and, and they have this phone call says, “Hey, we’ve got this really interesting idea that we’d love to talk to you about.”

And I think that’s where the conversation with MVL (Madrona Venture Labs) starts. So, MVL has two models. One model is that you are a CEO/founder type that wants to come in and you’ve got this concept, you’ve got this passion. And if it aligns with what MVL is thinking about and how they think about the world, they can help bring you along on that journey. There’s a second type of idea though, that they have, and that is ideas that they’ve been thinking about and saying, Hey, we want to bring AI to finance, or we want to bring AI to travel, or we want to bring AI and just take AI for a second. We want to bring AI to the post-sales world. And so Moderna Venture Labs has been thinking hard about this problem, and then what they say is, I think there’s something here. We need to bring in a co-founder to help solve this problem, to help create the idea. We’ve sort of developed it, we’ve tested it with other companies, depending on where they are in that process can be relatively far along and the idea, and then they’re trying someone to help take it all the way.

And that was what happened to me. So they said, “Hey, we’ve got this thesis around bringing AI automation into the customer experience, into the post-sales world. Sounds like it’d be a fit given your background, Josh, why don’t we talk?” And I said, you know, “Tell me about the company.” And they said, “It’s pre-revenue…”

Elisa: it’s not a company, yet.

Josh: It’s not a company yet, it’s an idea.

And I said, oh, no way. That’s crazy talk. You know, that’s a young man’s game. What are you talking about? Uh, you know, I’m not that old. And I’ll tell you what, once I talked to them, I absolutely fell in love with the idea, fell in love with MVL and what they’re doing there, and got so excited. And, and you know, I think the process took about three weeks.

Elisa: Wow, that’s fast. That’s a quick turn. So you were instantly hooked. So how, how was that process? Tell me more!

Josh: So, in my case, you know, it moved really quickly. They already had a relatively strong idea so we took that idea, and you know, I’d say I put my 25 to 30% spin on the idea. Like, okay, let’s change this. We’re going to modify the product concept this way. Think if we add this capability or that capability, it could make a real difference. And then, MVL really just worked with me. So the way that Madrona Venture Labs works is that they have a set of functional capabilities and functional experts on the team.

So you may have a CTO type and they’ve got, uh, in my case, a guy named Keith Rosema. And Keith is amazing and super smart and talented technically. So, they’ve got sort of the engineering side. Then they may have a product side, they may have a marketing and sales and GTM side, they have a design capability and branding, and then some general management experience and all those things. And so in my case, what happened was we took the different functional capabilities and used them as we needed to refine the product concept to get the pitch right. I probably needed a little less of that and needed more help on the product side. So I’ve got a lot of product perspectives on what the product needed. But I’m not an engineer. I’m not a VP of product. And so what I really needed was the help, like, let’s get the mocks right, let’s get the designs right. Let’s talk about the backend architecture. How are we going to think about data stores? That allowed us to accelerate and move on the build right away rather than maybe being gated until I had a technical co-founder, until we had made some hires, until we had a bunch of other stuff. So we could accelerate that process in some really important ways and allow us to get to market much more quickly.

Elisa: Okay. Switching gears — I want to talk about product-market fit. In your case with Magnify, you had an idea, you spun that out, you did fundraising, you found a co-founder, you started building your initial team, you really went from zero to one. Like you had mock-ups that you were thinking about, and then trying to build kind of three products in one to go to market in a really strong way. And that’s a hard and long process. So, I would love to hear kind of what’s your approach or what has been your philosophy over the past year as you have gone from napkin to bits flowing, product launching software company.

Josh: First of all, it happened over the course of about a year, but it feels like it’s happened really quickly. Like, just to help put context, I think we started talking with MVL in July like is 2021. I came on board in August. We pitched to Madrona as the primary pitch and then to Decibel as the second, you know, as the other investor, in September. We funded October. That was a very quick process. And then you’re, you’re kind of like, oh, great, now I’ve got this check for $6 million. You’re kind of like the proverbial dog that caught the car. It’s like, now what? I’ve got this big check. I got to go build a product. Holy smoke.

So, I think a couple of things that, at least for our journey were specific to us. We had already, MVL specifically, Madrona Venture Labs, had already talked to a bunch of customers and had a thesis on the market. And so there was a bunch of research that had been done that we could immediately plow into it. I’ve led large customer success and, and customer-facing teams for many, many years now. And so I had a point of view on the market as well. So, in some ways, we could immediately accelerate the process of, okay, what do we want to build? What do we want to design? Because I can say, I want this, not that, I want this, not that. And that’s really dangerous for myself to be like, Hey, I know all the answers and all of that because that becomes very quickly a segment of one. But I want to be clear, like, if you are a founder and have a vision for the product, yes, you need to get external points of view, and also, my council is to build what you think you need to build. I don’t think it’s going to be crazy off the mark. If you’re in the space and you know what you’re doing or you know what you want to build and understand and have empathy for the users of your product, then there’s a lot of real estate that that covers. And so I think that was kind of the first moment, or first few months of the process was like, Hey, we know we’re going to need this thing, that thing, that thing. Let’s go work on those and, and design the process.

Now, once we got into that, then you very quickly go and get a set of design partners. So, we talked to a number of folks in my network and other networks and saying, Hey, I’m going to test the positioning, the concept with you. And so there was a sort of quasi pitch deck that we built, that we tested with them, and a bunch of questions and some really helpful scripts that actually Decibel had given us around ways to ask questions and do focus groups and things like that. There were some really good things about product that we learned during that process and learned by getting input and counsel from some subject matter experts into the design. Then you start putting mocks in front of your customers. And, you know, and mock we’re talking like stuff in Figma that we’ve, we designed and, you know, it’s actual clickable demos, but it’s, there’s no code. It’s just all, all slideware. I think. Here’s one of the things that, you know, sometimes you’ll hear, was that “nos” were much more helpful than “yeses.” People will often say things like, yeah, yeah, yeah. Or, I like that. Because people generally don’t want to offend other people.

Elisa: Said another way, if someone’s saying “yes” maybe they’re just not engaging. Maybe they’re not into it, so, if you get someone saying “no,” it means some part of them cares enough to give you that feedback, and some part of them thinks the problem is annoying enough to talk about.

Josh: That’s right. And so what would happen is sometimes we test product concept. And I’d be like, oh, this is like the best idea ever. And I, I remember this one call with this one woman who is a chief customer officer at a, a fairly large company, and she’s like, I don’t get it. This doesn’t make sense. I’ve already got the solution — it is a solved problem. I’m like, here are the differences. Here’s why this isn’t a solved problem for you. And she’s like, yeah, I’m not compelled. And I remember getting so pissed at the end of that call. I was externalizing my failure to persuade and convince and you know, you ask all the why, how, what questions in that conversation, trying and unpack, well, what would make it compelling? How do you solve this problem today? So, we got a ton of data, but I remember the whole time just sort of seething inside being like, how dare you not believe in my vision? And like…

Elisa: That’s the fire you need because you’re thinking back to, I mean, you’re talking about building these mockups in Figma, which is basically a, a pretty picture for prospective customer to look at and react to, but they can’t really click through get genuine insights. But it gives them enough context for the conversation that they can give you feedback. And so I can imagine that kind of a conversation with a number of prospective customers, kind of put some fire in your belly. Like, how do I translate my belief and conviction, and what my product can solve onto a page and do it in the flow that resonates with my prospective customers?

Josh: That’s right. So after we did, you know, a bunch of these mocks, we did proof of concepts. And this is, you know, this is not very revolutionary, but we did a lot of stuff manually — some in code, some with a little bit of mechanical turk, like human beings sort of doing the work to show that yes, indeed this would work and that we can solve these problems. In one case we worked with a company and they took a year to build basically an equivalent product with us and generate some insights. They had sort of built something homegrown and we have a product that can replace their homegrown solution. And we were able to do something that took almost a year for them to do in the span of a couple of weeks. And that is awesome. Like when you can do that sort of proof of concept and get somebody excited. And in particular, I’d say a great indicator of product-market fit is when you start running into multiple customers that have built something similar as a homegrown solution. Because that means it’s important enough for them to invest dollars. It’s important enough for them to invest time. They think it’s a real problem. And so even if you can’t displace a homegrown solution immediately because maybe you just are not far enough along and your development process or whatever it is, that’s still great validation of product-market fit.

And so anyway, . We did a bunch of proof of concepts, got sort of good validation, good fit. And then ultimately we get to a place where we are today, which is releasing the product to getting to minimum viable product. And what we like to talk about a lot is MDP, which is minimum delightful product.

Elisa: You brought up an interesting point, and I’m curious if this has been a part of your discovery with your prospective customers in selling and figuring out if there is a space in the market and budget in the market for me to build this incredible solution that a homegrown product couldn’t fix, for example. And what we see with a number of our other companies we work with is that decision some companies have between buy versus build and how do you make that decision? Engineering resources are scarce. Time is always a really critical factor. And so what it sounds like with that discussion you had is, Hey, what you guys, took you a year to do with part-time resources, that we could do in a number of months.

Josh: Weeks days, you can’t sell me short.

Elisa: Okay. Weeks to days. Plus, even more importantly, what you plan to do and what’s on your roadmap for the year ahead in creating value and helping them drive effectively top-line revenue to the business is a very strong value proposition.

Josh: And I think the way that you get there is you have to demonstrate sort of competency, and I think you have to create transparency and trust. It’s a two-part process because first, the product has to work or you have to be able to show that you can actually do something. And, and all three of our initial customers that we did, uh, some of our initial proof of concepts with, in every single instance, we had to demonstrate competency and trust and the product work, that our ML insights were significant and superior, all of that sort of stuff. And if we didn’t do that, I’m not sure we’d be in the place we are today with the product. Because that pushes you to excellence, it pushes you to build something that’s very compelling. From our point of view, it’s not enough just to meet a minimum bar. It’s like, no, we have to demonstrate real and significant value. Then I think at the same time, the whole time I’m in conversation with the executives that are sponsoring projects saying, Hey, I’m going to be really transparent about where we are, here’s what we’d like to do. We’d like the opportunity to earn your business. We’d like the opportunity to partner with you. You know, is that a ridiculous question? Like, For you, a big company to work with, a small company, you know, and then they say, no, it’s not ridiculous. That’s great.

And I say, okay, good now what would you need to see from us to feel comfortable to do that? That then also shapes your product roadmap. That shapes your deployment model. It shapes a bunch of different things around what they need to see from you. And I think that that becomes really important when you’re moving from kind of zero to one. When you’re moving from some proof of concepts to actual revenue. What are those components that you need to have? And it could, by the way, it could not just be product features. It could be, well, am I going to get a customer success manager to help me manage or, what are your service level agreements? Like, there are a bunch of things that sit in there that you have to understand, and if you’re open early days in that process and you’re clear and transparent about what your priorities are and what their priorities are, you can usually get to a place where that translates to revenue in a relatively short period of time.

Elisa: Okay, one last topic.

Josh: We still haven’t talked about the product, by the way.

Elisa: Okay. Let’s get into the product. Uh, well this is almost a segue into that, and it’s thinking about how do you build intelligence. You have effectively multiple different products that you’re building right now inside of Magnify. And one of the beautiful and magical things is how do you build artificial intelligence, machine learning, deep learning into the data that you’re collecting and pulling, to create these incredible insights for your customers. So let’s hear more about what those multiple products are, and then I would love to hear how are you thinking about building an intelligent application.

Josh: So, Magnify automates and personalizes the customer life cycle for every single user. So, the way to think of it is it’s taking all of the data in your systems, across all the disparate disconnected systems, taking that in, generating business insights on them, and then automatically engaging every single user to drive product adoption and satisfaction. And if you can do that, you’re going to grow your revenue, you’re going to improve your retention rates, you’re going to get your upsell, and your customers are going to feel better for it, which is, which is arguably the most important thing. And we do that through three components. The first component is actually, that we have to ingest all this data. So, there’s user behavior from product telemetry, and from other systems. There’s sales revenue data, there’s customer success data, there’s marketing data, there’s all this stuff. So, you have to pull all these different disconnected systems into a single repository.

Now, some folks have a CDP, customer data platform or sort of other data warehouses that grab all that information, which is great, and that makes our life a lot easier. Most do not. And so in our experience, we take all that data and we connect and stitch it all together and we create what we call the lifecycle graph. And that is where every single user is in their adoption journey. And how that connects to other signal like revenue or retention or churn or growth. Okay. Then what you do is you do the second piece of our product, which is we then apply user insights on top of that. So, we can then say, ah, we now have looked at every single user, we can understand where they are in their adoption journey and what is the next best step for them. So, user 258 is in this place in their adoption journey, and here’s what they need to do next. And that’s different than user 259 and different than user 260, and so on and so forth. And what that allows you to do is actually create a real level of personalization for every single user. That’s fundamentally important.

What matters there is that we can also then say, how does that correlate or connect with things like churn, revenue growth, trial conversion. So, we can then say, great, here are the risk indicators. Here’s revenue prediction. Here’s how we think about the world both at the account level, and at the user level, and this set of insights, we can literally predict revenue quarters out now for our customers. Then, okay, cool. Great that you’ve got these insights, but frankly, insight without execution is kind of worthless. And so what we ultimately do is we then connect and drive orchestration/ execution. Most companies have lots of different digital touchpoint systems. So maybe they have an email system, maybe they’ve got some sort of end product platform — there’s this laundry list, this Cambrian explosion of tools: Slack, text, chat all of that stuff that sits out there. And each of those are disconnected. And so what we do is we then can connect via API to every single one of those different systems. And then drive the next best touchpoint. So, let’s say user 259, they need to use this feature. The next time they log into the product, that feature pops up. Did they use it? No. Oh, maybe we send them a text reminder. Maybe we send them a Slack reminder. Maybe we open a support ticket because they could only get a third of the way through and they seem stuck somewhere. And we execute and drive each of those actions in those different existing digital touchpoint systems, which allow our customers, the users of Magnify, to ultimately get more value out of their go-to-market investments.

Elisa: And I love this because it’s personalization and almost magic at scale. Those three product pillars that you’re building inside of Magnify to deliver that, that is the hardest technical challenge and the most beautiful and magical solution when you can deliver it. So that’s the vision for Magnify today.

Josh: That’s right. And so you’d asked the question like, Hey, how does AI connect to this? And so here’s what I think some companies do that is the anti-pattern, which is you can’t just sprinkle some sort of user, magic pixie dust on something and it will all of a sudden fix these problems. The way that we’ve thought about AI and ML is that it has to be incorporated from the very beginning. We had applied scientists on our team from day one, and they were influential in understanding what are the product requirements, and how you think about that. For instance, we pull in all this data to create the customer lifecycle graph, but you’re pulling data from all these different systems and each of those data fields has different contexts. There’s different metadata around that that the AI systems need to understand in order to be able to correlate and compare signals across different systems. So if I just said, well, I’ve just created this AI insight engine, but our applied science team isn’t talking to our product and engineering teams around their requirements upstream for data ingest, and the work that we’re going to have to do and to our customer success teams on what is needed for customer onboarding and onboarding wizards and things like that, all of that needs to be incorporated into the product. So, when you think about AI – AI is delivering value because it’s giving these insights, and it can optimize the journeys, the next best steps for every user. There’s all the stuff that it can do, but In order for it to do it well, it has to be woven into the very fabric of your product from day one.

Elisa: We should talk about this in a part two because this is exciting and I know that the journey for Magnify is just beginning. But I have a couple of lightning round questions I do want to end on.

Josh: Bring it on.

Elisa: Okay. So the first one, what do you think will be the greatest source of technological disruption in the next five years?

Josh: Hmm, I’m really torn. I’d say the short answer is the generative AI I think will be a significant source. If you asked me 15 to 20, I think it’s going to be something in biotech.

Elisa: Second question, what is an important lesson you’ve learned becoming a first-time CEO?

Josh: I think how important it is to constantly reinforce the vision and the messages you’ve already communicated over and over and over.

Elisa: It’s so funny hearing you say that because every single CEO I talk with says the same thing. It’s like half my job is just reinforcing the vision, repeating the vision, making sure that what we are doing and our go forward is ingrained with all of our people. Alignment is huge, especially at these early stages when you’re building your first product. Okay. Finally, what’s one thing you’re watching or reading right now?

Josh: Ooh. I just finished binging “Welcome to Wrexham” with Ryan Reynolds and Rob McElhenney, which is a story of them buying a tiny little English football slash soccer team in the middle of nowhere North Wales, and them kind of going this turnaround journey. And neither of them are business types. That’s very clear. And it is gripping television in a fun, lighthearted way. I cannot, it’s like, it’s like a real, it is not just like it is a real-life Ted Lasso. If Ted Lasso were the owner of the football team. It’s a great show.

Elisa: Well, Josh, thank you for spending so much time with us so thoroughly enjoyed the conversation, love working together, and it’s exciting to get more of the Magnified story out into the world.

Josh: Yep. Fantastic. It was great to see you, Elisa, and I hope you have a wonderful next few days.

Coral: Thank you for joining us for this week’s episode of Founded & Funded. If you want to learn more about Magnify visit Magnify.io. That’s M-A-G-N-I-F-y.io. Thanks again for listening, and tune in in a couple of weeks for another episode of Founded & Funded.

A-Alpha Bio’s David Younger on machine learning in biotech, building cross-functional teams

A-Alpha Founded & Funded.

This week on Founded & Funded, Partner Chris Picardo is talking with A-Alpha Bio Co-founder and CEO David Younger for our first Intelligent Application 40 Spotlight episode of 2023. We announced the 2022 IA40 winners in October, and A-Alpha was the first biotech company to make the list, which was no surprise to us. As one of our portfolio companies, we know the work David and his team are doing at the intersections of biological and data/computer sciences will change the world — but having a group of judges agree with us makes us all the more certain.

Protein interactions govern just about all of biology and A-Alpha uses synthetic biology and machine learning to measure and engineer protein-protein interactions, speeding up a traditionally slow wet lab process. The company’s proprietary platform — AlphaSeq — uses genetically engineered cells to experimentally measure millions of protein-protein interactions simultaneously, generating enormous amounts of data to inform the discovery and development of therapeutics.

It is within that enormous amount of data that the company is adding to every day that so many answers will start to be found as the company is able to use machine learning to train predictive models and begin predicting new antibody sequences that could be effective against different viruses and diseases — improving the way that we are able to discover drugs.

Chris and David dive into that future that A-Alpha is working toward and so much more — the power of data engineering, building business models around data, building cross-functional teams, having both tech and biotech-focused investors. It is an episode you won’t want to miss. So with that, I’ll hand it over to Chris to take it away.

This transcript was automatically generated and edited for clarity.

Chris: Thanks everyone for listening today. My name is Chris Picardo. I’m a partner at Madrona, and I’m super excited to be here with the co-founder, and CEO of A-Alpha Bio, David Younger. Welcome, David.

David: Thank you, Chris. Yeah. Wonderful to be here.

Chris: So, A-Alpha is one of our intersections of innovation portfolio companies. And for those who are new to that term, at Madrona, we use that to mean companies that combine machine learning and wet lab life sciences on a day-to-day basis as sort of a core part of what they do. And I think A-Alpha is an extremely good example of this. And building on that, they were named in the 2022 Intelligent Application 40 list — and were actually the first IOI, or life science, company named to the list. David, could you just share a little bit of background about A-Alpha Bio — kind of the founding story and how you started working on this problem?

David: I didn’t realize that we were the first IOI company on the top 40 — that makes it even more special. So A-Alpha Bio is the protein-protein interaction company. So we use synthetic biology, machine learning, and protein engineering as a tool to improve human health. We use these technologies to measure, predict, and engineer protein-protein interactions for a variety of different therapeutic applications. Protein interactions govern just about all of biology from how your cells communicate with each other to how genes are regulated. So for example, how coronavirus enters your cells, it’s through proteins on the surface of the virus binding to proteins on the surface of your cells. And so by understanding protein interactions, we can do things like design therapeutic proteins that will bind and block to prevent those proteins from interacting and thereby curing someone of coronavirus for example.

Chris: Historically this has been a really hard problem for people to figure out, right? How does one protein interact with the other protein? Because, as you said, that dynamic is really key to understanding what’s going on but also designing possibly an effective therapeutic for some disease that you’re looking for. I’d love to just go a little bit deeper into why this has been a hard problem and how you guys uniquely approach mapping and understanding these interactions.

David: Across all of biology, the traditional approach is to do wet lab experiments, to express proteins, to purify proteins, to measure things more or less one at a time. And those approaches are powerful but very, very slow. So, I think a great analogy to this is determining the structure of a protein — where historically, once you have a protein sequence and you express that protein, you purify that protein, it can take months or potentially even years to figure out how to crystallize that protein and then solve a crystal structure to determine a three-dimensional experimental structure. What we have been seeing over the last couple of years is essentially the infusion of data science, the infusion of machine learning into this space that has now allowed groups like DeepMind, like my alma mater, David Baker’s lab with Rosetta Fold, to develop software that can near-instantaneously predict the structure of a protein without doing any of those experiments.

With protein binding, the complexity of the experiments is maybe not quite as challenging as solving a structure, but they’re, they’re pretty close. We have to purify proteins, so express them, purify them, and then one at a time measure to see whether or not they interact. With the example of coronavirus, because this is a virus that is mutating so rapidly, there are hundreds of different variants that have been observed. There are near-infinite numbers of combinations of those mutants. And there are vast numbers of mutations that potentially could occur in a coronavirus that hasn’t ever been observed. And so, if we really want to understand how an antibody or multiple antibodies are going to bind to the coronavirus, we can’t possibly use experimentation to measure antibody binding against all of those different variants. So, machine learning becomes a really effective tool to measure subsets of those interactions and then train models that can essentially infer the binding properties of the remaining ones.

Chris: You talk about the old version of experimentation — one-to-one throughput. You know, it might be worth mentioning a little bit about how A-Alpha differs on the scale side of your capabilities.

David: A great way to kind of put this into perspective at a very high level is to say that the largest public repository of protein-protein measurements is a database called BioGRID. Any measurement of protein interactions that anyone publishes gets collated into BioGRID. And BioGRID currently contains about a million and a half protein interaction measurements. At A-Alpha, with a relatively small team of 39 folks, we’re measuring about 6 million protein interactions each week. So, we have a database that now has over 200 million protein-protein interactions. We expect that it’s by orders of magnitude the largest repository of PPI data in the world. And each assay that we perform because we’re able to leverage synthetic biology and next-generation sequencing and advances in DNA synthesis to really scale these experiments up, we’re able to measure millions of interactions at a time instead of one at a time.

Chris: It just impresses me every time you say the numbers. When we talk about data generation and the life sciences and in biology, A-Alpha is a really good example of differentiated data at scale. And I think that brings us to this machine learning point, which is I don’t think that what you guys are doing on a daily basis is really possible to parse through without machine learning. So, I’d love to get your take on how do you think about the role of machine learning in A-Alpha and how it fits into the way that you run the company and you run your assays on a daily basis.

David: I think that’s exactly right. I mean, we think about the power of our platform kind of in two different scales. So, one of those scales is what we call our platform advantage. And essentially our platform advantage is a technology that allows us to measure protein interactions faster, more quantitatively, and at higher throughput than other techniques. And even without machine learning, we can use our platform advantage to solve high-value problems across the pharmaceutical industry better, faster, and cheaper. It’s not that without machine learning there isn’t value to the data that we generate. But without machine learning, we’re leaving so much on the table because we are able to essentially extract insights from a tiny, tiny subset of the data that we generate. So, if we’re measuring a million interactions in a single assay. Sure, we can find the interactions that are the strongest, or we can find the interactions that fit a particular profile most closely. We can do those things without machine learning, but what we can’t do is uncover all of the nuances of the patterns that go behind the influence of each possible amino acid mutation and how that influences binding and stability, expression, and all of these other really important biological characteristics.

So, if we start to get to, how do we start to optimize proteins faster? How do we do multi-parameter optimization for different properties like affinity and specificity and cross-reactivity and epitope engagement? To solve these types of properties, without machine learning, we’d be living in the Stone Age.

Chris: A couple of things David just said came in at rapid fire, but I think one of the ways to understand this is that there are a bunch of different ways that proteins can interact with each other. From the strength of the binding to the behavior to the specific physical places where they actually touch. What David’s talking about here is that A-Alpha has built a way to interrogate all of those types of interactions at scale in a way that nobody else can. And I think one of the interesting things too is, for a long time, a lot of these experiments as you talk about, were kind of binary one-on-one. Put two things in a tube and see what happens. And I think with A-Alpha, you get all of these other variables. You get the stuff that doesn’t happen, you get the stuff that kind of happens. And so, as you parse that apart, it’s really this machine learning that kind of takes over. And I’m curious, as you start to observe those types of things, where is it going? Now you’ve got a 200 plus million data point, let’s call it a training set, you’ve got the ability to screen 6 million PPIs every week, and it’s getting bigger. Where are you pointing this? What’s ML going to start to really unlock when you think about, what the outputs look like down the line?

David: So, the first place where we’ve already seen our database have a substantive effect is in understanding what antibody sequences don’t work. Being able to rule out particular sequences, particular patterns of amino acids that just don’t produce good binders that don’t produce stable antibodies. By ruling these things out, we can design libraries that are essentially enriched for things that are better, or we can computationally knock down observations that we see about sequences that we know are not going to behave well.

If, for example, we generate a lot of data around a library of antibodies binding to a number of different targets, and now we want to generate a second set of newly predicted antibodies that have an improved binding profile, we can use all the data from that experiment, but we can also essentially reference all of the historical data that we’ve generated in order to take those predictions and screen them for how likely is this antibody actually going to function properly. So that allows us to essentially move faster, and we can optimize these really complex problems in fewer iterations, which means cost savings and time savings.

Where we see this going eventually is getting to a point where we’re doing more and more in silico prediction of new sequences. So coming back to the coronavirus example, if we have a dataset that consists of thousands or millions of different antibodies binding to thousands or millions of different coronavirus variants, we can start to map a landscape such that if a new coronavirus variant crops up, even if it’s one that we’ve never seen before, we can take all of the data that we’ve generated historically and predict a new antibody sequence that’s likely to be an effective drug against that never-before-seen virus. That’s an incredibly exciting promise of what we can really harness this quantity of data for.

Chris: I think that’s just such an important point that you just made. In the sort of early drug discovery process, it’s just been a very difficult search problem. Where you have to have, to use the industry’s term, a library of specific things that you want to try out, and then you search it — slowly, one by one. And if nothing works in that library, you have to find another library. And I think the way you’ve reframed the problem, which is, hey, if something kind of works or if a subset of things totally doesn’t work, oh, we go get another library, but we build that based on all of the information that we just learned and all of the information that we previously screened. I think that’s a powerful new paradigm in this entire space. And I think A-Alpha is the type of company that’s pushing that forward from like a “how do we change the game perspective here?”

David: I think that’s exactly right. The technologies that have generated many of the antibodies that are currently in the clinic as cancer therapies or autoimmune therapies were discovered by essentially throwing millions and millions of darts at a dart board and picking the ones that hit the bullseye and ignoring all the others. And we’re in a day and age, and our approach at A-Alpha is: Sure, we’re going to pick the ones that get closest to the bullseye, but we’re also going to take a snapshot of that entire landscape and learn from it so that when we’re developing the next therapy, we can get more shots on goal.

Chris: Yeah, every time you do it, you’re just making better darts, and you’re really figuring out what that looks like. It’s such a cool way to think about it. One other thing I wanted to ask you about here is just the power of data generation. I would say it’s something that we hear about a lot in biology and life sciences, but it’s hard to wrap your brain around it. How important do you think novel data generation is? And if you look forward 10 years, is every company going to be just figuring out, like, how do we produce huge novel data generation at scale? What’s the sort of importance level in terms of how you think about that as a component of strong discovery?

David: Yeah, I think it’s, central to everything that we do. It’s central to many companies that are taking a similar thesis to ours of really being a data-driven drug discovery company. And I think that this isn’t just true for companies that are developing therapeutics. This is really a paradigm shift across all companies that are doing biological research and all academic groups that are doing biological research. The tools that are at our disposal today are enabling just a step-function increase in the pace of scientific discovery. And that’s because experiments don’t have to be run one at a time anymore. We can now synthesize millions of different defined DNA sequences that are all in a test tube that arrive in a week and at an affordable price. And we can build experiments essentially thousands or millions at a time and then use next-gen sequencing as an output. No longer do we have to create a single controlled experiment that tests for one hypothesis that focuses on just one question. We can now ask a million questions simultaneously, which allows for very, very rapid discoveries for therapeutic applications, but also just in accelerating our understanding of biology.

Chris: And it becomes such an important machine learning problem because historically, there have been a couple of data sets, like you mentioned BioGRID, and you could try to throw the 500th algorithm at that and see if you can find anything interesting, or you can go generate totally novel training data and do that iteratively. I think this is an interesting transition that when you think about applying machine learning to this space — this is something that’s really compelling to people who want to do that. And so, when you think about that, something that you’re doing obviously every day is building a cross-functional team — software engineers, ML engineers, wet lab scientists — how do you think about this? It’s not a challenge that every company faces. It’s very multidisciplinary. What is your thought on team building and bringing different personas and backgrounds together?

David: I think the most important thing in our experience is that the teams have to be really excited and passionate about working with each other. It’s not necessarily that a data scientist needs to come into A-Alpha knowing everything about biology, it’s that they have to be incredibly excited about getting into the weeds and learning about, at least to the depth that’s needed for them to understand the biological context, for them to ask the right, ML questions.

The same is true for biologists and biochemists. They need to understand what the data science is capable of and the parameters by which we need data in, in order to effectively train models. So having a very close collaboration between those teams and a mutual interest in understanding what each other do is essential for the company to be effective. I think if we were building a team that was just wet lab and we were outsourcing all of our data science or vice versa, building just a data science team and outsourcing all of our wet lab, we would not be able to do what we do as effectively and certainly not nearly as quickly.

Chris: That leads me to a question, we hear this a lot now, right? That people are encouraging ML scientists to go work on life science. And the problem can seem scary. You’re walking into something where there’s all these biological terms, they don’t really make any sense — it feels like people are speaking a foreign language. Is it possible to teach an ML scientist biology and vice versa?

David: I think both are possible, but both are hard. My experience, so I, was trained as a wet lab biologist and would certainly not consider myself a computational biologist at all. But during my graduate work, I realized that in order to stay relevant long term in biological science, there is a need to figure out how to get more proficient at data science. Because biological science is moving more and more toward these massive data sets that are impossible to parse without some sort of data science or bioinformatics tools. It would be very hard to stay relevant. And so, from that perspective, there’s a good amount of sort of healthy pressure on biologists to pick up some of those skills. If a biologist does not have any of those data science skills, over time, they’re more or less going to be relegated to generating data and then not having the tools to be able to play with that data. And I think, from the perspective of just about any scientist, the fun part of the job is not just generating the data, but it’s digging into that data and trying to get insights. From a data science perspective, I think a lot of people who choose to work in companies like ours have some reason to be passionate about biology. Maybe it was interesting from high school. Maybe it’s that a family member had a particular disease and that launched a passion to get involved in some healthcare-type aspect of a career. But you know, typically, there is some driving force that leads to that interest.

Chris: I’ve watched you between these two, so I can tell everybody that David is more than capable of it. But I do think these worlds are colliding in a very interesting way. I think what you mentioned about the scientists realizing that the quantitative tools are becoming table stakes is getting more and more true. And the ML engineers and the ML scientists are realizing there are some interesting problems to go solve on the life science side where you’re just going to get handed a pile of novel, interesting, totally untouched data, and you’re going to go generate new insights. And that has to be a powerful message, right?

David: Absolutely. Part of it is the impact, right? You’re, potentially involved in better understanding biology or curing disease. But I think also there is something that’s just innately complicated and messy and noisy about biological data. It’s just a very exciting source of data that I see as very much the next frontier of data science.

Chris: Yeah, as we talk about, you know, the Intelligent Applications 40 and the companies that are on it this is a core theme right here, especially as the world of biology and life sciences moves forward — you’re not going to be able to interrogate the data without machine learning tools. It will be too high scale. You won’t be able to do it manually in the ways that you used to. And so, that really brings up another question, which is on the company creation side — it used to be, life science companies generally spun out of an academic lab, got a really core life science-focused investor, and then tried to get something into the clinic. A-Alpha and companies of your style have been built differently than that, right? You did spin out of an academic lab, but the funding and the investors are, are different and the goal is a little bit different. So, I’d just love you to talk a little bit about how the kind of different company-building process here has worked. You have a tech-focused investor on your board, — us at Madrona. You have a much more life-science-focused investor on your board over at Xontogeny. What has that dynamic been like, and how has that influenced the way you think about building the company?

David: We are very much a platform company in the biotech universe, so we are not focused just on getting single drugs to the clinic. We’re focused on building a platform that can be used over and over again to glean biological insights and to develop multiple therapeutics across potentially many different disease areas. It was very important to us to have the credibility and the know-how of a group like Xontogeny Perceptive and Ben Askew, who is on our board — traditional life science investors who know that process of taking biological data, finding targets, finding drugs, getting those drugs into the clinic — really core expertise that we absolutely need. But we’re also thinking again about building this platform that can have a long-term impact across lots of therapeutic programs, which is a big part of all of these efforts in machine learning to train predictive models and improve the way that we’re able to discover drugs over time. This is all sort of core to our platform thesis. And so, bringing Madrona and you, Chris, and Matt onto the board, have really helped to bring that sort of platform perspective. And has led to very productive conversations with some amount of healthy tension between that traditional life science investor and the kind of longer-term tech-enabled enabled VC perspective.

Chris: As someone who gets to go to the board meetings, it’s been so fascinating to get to see these discussions play out across a bunch of different angles because, at the end of the day, right, you’re one way or the other going to help a therapeutic get to market. It might come directly off of the platform, you might enable someone else to do it, but that would be the goal. However, you’re going to use all of these modern approaches and tools to do it. And so, you kind of have to think equally about, how do I build the software and ML capabilities of my business. How do I build them in line with the life sciences and the biological capabilities of the business? And it seems like this paired investor approach, at least in your case, has worked really well. Is that something you’d recommend to other companies — this kind of hybrid style of investors?

David: I think that if you’re building a company that really lies at this intersection of data science and biological science, and your goal is to build a platform company, I think having investors, having board members who have experience in those two different domains is incredibly valuable. I think a good example of that right is across the pharma industry, across biotech, there is still a lot of uncertainty around how to structure business models around data, right? So, you have all of these companies that are generating massive data sets and they’re using those data sets internally to discover drugs. But one of the things that has been fun about many of our board meetings is that we’ve started to have creative discussions about, you know, how else might we be able to use that data in creative ways. And I think those conversations only happen when you have folks with very different perspectives and different experiences at the table.

Chris: Yeah, you beat me to the question because before we jump into the lightning round, I was going to ask you about: changes in business models. Historically there have been three ways to build a business model in this platform space. One, you build a drug internally, you take it into the clinic, and then likely you license it to someone else.

Two, you have amazing platform capability, generate insights, and you partner with people who have interesting things for you to work on — and hopefully, they take a drug to the clinic. And three, you can be a little bit more, call it service or CRO, like — contract research organization, which has often been like, hey, someone needs some stuff done, and so they’ll send it to you. And A-Alpha, I think, has been very creative in figuring out how to create different versions of all of those models. And I’m curious, how are you seeing the business models evolve, and is there a type of business model here that you’re more excited about or that you are really excited to see emerge?

David: So, because we have a highly differentiated technology that really allows us to enable both ourselves and potential partners to discover new drugs that they wouldn’t be able to discover otherwise, we are able to work with partners in the context of a service-like model. But it’s sort of a very high-valued service. It’s a partnership that is structured around work done by A-Alpha but then comes with an upfront payment and milestone payments, and eventually royalties, which is that traditional pharma partnership model. We also can use our capabilities, kind of turn them inwards and build a pipeline of our own and there are certainly exciting opportunities there. What we’re also starting to think more about is, again, how we can really leverage data and data generation as an asset in and of itself. So, talking with partners about the potential to build data sets together that can be used to train predictive machine learning models in a way that really is only enabled by the type of tool that we have that gives us that competitive advantage for generating data sets that no one else is able to generate. I think that there are a number of different exciting ways, over different time scales, in which we are able to leverage the types of data, the types of capabilities that we have, both directly for discovering and optimizing therapeutics, but also for moving the whole field forward by generating these massive data sets.

Chris: Personally, like you just said, I think these data partnerships are going to be crucial for how this industry as a whole pushes forward with machine learning and as these data sets get created and these models get trained, we really will start to see these new types of deals emerge, and I think it’s emblematic of what companies in the IA40 are doing in general, which is pushing the boundaries of the existing business model by leveraging data — one way or the other, right? Data plus intelligence. So, I think you guys being out on the leading edge of that is particularly telling, and makes sense why you are part of the IA40.

David: I think as well, in the pharmaceutical industry, there has been a very strong historical resistance to sharing any type of data. Targets are confidential. Data is confidential. I mean, everything is behind closed doors, with a lock and key. I think because you’re starting to see more and more proprietary sources of kind of niche data sets that help to explain different aspects of biology that are hugely valuable in and of themselves but might be even more valuable when they’re all combined together. It really starts to create better incentives for companies to get creative about how we can leverage data sharing or different ways to enable the entire industry to grow by getting more creative with data partnerships.

Chris: And I just think it’s going to be such an exciting thing to watch going forward. To wrap up we’re going to do a lightning round of the three questions that we’re asking all of the IA40. So, I’ll start with the first one, aside from your own company, what startup or company are you most excited about in the intelligent application space and why that company?

David: There are so many of them. I’m most familiar with biotech, biopharma, so I’m going to give one from that space, which is Octant. This is a company that I’ve been a fan of for a long time — founded by Sri Kosuri, who I’ve also been a fan of for a very long time. They are using synthetic biology to engineer cells to essentially develop different disease models. They’re leveraging the power of DNA synthesis and DNA sequencing — but to create cellular models so they can test small molecule drugs in a much higher throughput setting.

But they, like us, can use the power of high throughput experimentation to develop these massive data sets and essentially improve their platform over time by training predictive machine learning models. So yeah, a very, very cool company that has some analogies to what we do but really focused on the small molecule drug discovery space.

Chris: Totally agree, Octant is a super cool company, pushing the boundaries. Second question. So, outside of enabling and applying artificial intelligence to solve real-world challenges, what do you think is going to be the next greatest source of technological disruption in innovation in the next five years?

David: Keeping this close to home and in kind of the realm of biology and biotech, I think it’s DNA synthesis. That has been a major limitation for many decades around, know, how quickly you can do experiments, how high throughput you can do experiments. We’ve made a lot of progress even over the last few years. We’re now at a point where we can order from a company like Twist on the order of tens of thousands of 300 nucleotide oligos and get them back in about a week. But that’s only long enough DNA for us to produce very, very short proteins. So over time, what we really want to see at A-Alpha is advances in DNA synthesis so that we can synthesize arbitrary-length proteins and massive, massive libraries of those arbitrary-length proteins. I think that that’s going to be a major driver for even higher throughput experimentation, even more, precise experimentation, because then we can fully define those proteins that we make. And we’ll just have a really, really huge impact across biotech, biopharma. And there are a lot of companies working in this space. I think there’s a good chance that there’s going to be at least one company that really cracks this.

Chris: All right. Last question. What is the most important lesson or something that you look back on and you’re like, boy, I wish I could have done that better, that you’ve taken away from your journey building A-Alpha so far?

David: One of the things that I’ve kind of gotten there eventually, but maybe it took me a little bit too long is to find the right balance of stepping away from all of the technical details. I think being a technical founder is a blessing and a curse. It’s a blessing because you understand the ins and outs of the system, of the platform. You can be involved in those technical conversations and help to steer the technical strategy of the company. But I think, at a certain point, there is a drawback to being too involved. Partly that’s a bandwidth issue, right? I mean, I have other things that I need to be focusing my time on. But I think the other thing that it took me maybe too long to realize was that when I’m in the room, the conversation is inherently different. So, sometimes, to have the best technical discussions, it’s important for the CEO not to be in the room. That was something that probably took me too long to figure out, and I’m glad that I’ve gotten there eventually.

Chris: I think that’s a really important and thoughtful insight for similarly technical founders out there and is a good one to end the conversation on and a good note for everybody to take home. So, David, we really appreciate having the conversation and for you being on this episode of Founded & Funded.

David: Thank you, Chris. Wonderful to be here.

Coral: Thank you for listening to this IA40 Spotlight episode of Founded & Funded. To learn more about the IA40, please visit IA40.com. To learn more about A-Alpha, visit AAlphabio.com bio.com. That’s A-A-L-P-H-A-B-I-O.com. Thanks again for listening and tune in in a couple of weeks for our next episode of Founded & Funded with Magnify CEO Josh Crossman.

dbt Labs’ Tristan Handy on the Modern Data Stack, Partnerships, Creating Community

dbt Labs, Tristan Handy, Founded & Funded

In this week’s IA40 Spotlight episode of Founded & Funded, Madrona Partner Jon Turow talks with dbt Labs Founder and CEO Tristan Handy. Here at Madrona, we just announced our 2022 IA40, and dbt Labs is one of our two-time winners. The company has positioned itself as the industry standard for data transformation in the cloud, and it raised $222 million at the beginning of the year, which was led by Altimeter, but Databricks and Snowflakes both participated in the round, further solidifying dbt’s place and the modern data stack.

Jon and Tristan dive into the concept of epistemic truth, how the modern data stack has significantly improved the frontier of what’s possible in data, the collaboration that needs to happen between data analysts, analytics engineers, and data scientists, the right way to use partnerships, and how the best way to try and create a community around your product is to not try and create a community, but you’ll have to listen to Tristan’s explanation. So I’ll let Jon and Tristan take it away.

This transcript was automatically generated and edited for clarity.

Jon: I am thrilled to have Tristan Handy here, who is the founder of dbt Labs. Dbt is an analytics as code tool that has quickly become an industry standard, and it has championed a new type of role — the analytics engineer — whose job it is to provide clean data sets to end users by modeling data in a way that empowers end users to answer their own questions. And with all this, they’ve attracted more than 9,000 weekly active customers and a Slack community of 38,000. So, thanks for joining Tristan.

Tristan: Yeah, thanks for having me. To set the record straight, we are at 15,000 companies using dbt today, which is really unbelievable. I remember in the early days thinking, “Hey, maybe a hundred companies would use this thing.” So this is a very unexpected world that we’re living in.

Jon: Maybe unexpected, but you do have a very special product and community. Tristan, to get us started off on the right foot, can you tell us in your words what exactly is dbt?

Tristan: Dbt has two parts. It has a commercial part, it has an open-source part. Overall, dbt wants to enable data professionals to work more like software engineers — to steward an analytic code base that describes the reality for an organization, or at least as close to reality as we can get, and allows people to move quickly. So it doesn’t unnecessarily force people to go through a bunch of hoops, but it allows people to work with a lot of maturity and governance with confidence that the data is accurate and timely, etc. So, the open source part of dbt is all of the language features. It’s, how do you write dbt code? How does it run against a data warehouse? And then dbt cloud is functionality that makes it easier to run dbt in production, makes it easier to write dbt code this kind of stuff.

Jon: So, considering the two sides of dbt, how do you think of who is the customer and what problem he or she is trying to solve?

Tristan: Let’s leave the word customer for a second. If I can just talk about users for a second because those two things are not the same in an open-source context.

Our users are folks typically on data teams or who are at least in a line of business that is very quantitative. Their companies have invested in modern data platforms, you know, Redshift, Snowflake, Big Query, Databricks, etc. And they are tasked with either providing clean data sets to folks who are going to answer business questions, or they are themselves tasked with answering business questions and need to do data preparation to get there.

So the core problem, and I ran into this back in 2015, which is kind of where the initial insight came from, but I was involved in launching a product called Stitch, which is a data ingestion tool. When we launched, it was just pulling data from about 10 different SaaS products into Redshift. And I got to use some of this data, and it was awesome. It was amazing to have my hands on all of this without having to do any CSV exports and VLOOKUPS and all this stuff. But the amount of data was pretty overwhelming. I remember having to do an analysis for Facebook ad ROI, and I was looking at literally a hundred tables in this one schema, and I was just like, this should be easy. Like, there should be a table that has campaign names and dates, and it should tell me the ROI. And it turns out that you actually have to make that for yourself. And so, dbt is the tool that I initially built for me to sort through all of these ingested data sets and turn them into the thing that would actually be useful to answer business questions.

Jon: So you’ve spoken about your users, but who are your customers?

Tristan: It really spans from one-person data teams at 20-person seed-funded startups all the way to some of the largest companies in the world with the most data professionals. Super high level, we started the company in 2016, dbt barely exists, we land a small handful of consulting clients, and a small community develops. We continued to bootstrap the business over the course of three and a half years as a consulting company. Over that time period, the dbt community grows to about 4,000 individuals, and there are about a thousand companies using dbt in production. That’s when we raised our first round of funding. At that point, the company had maybe eight or nine consultants and four or five engineers, and that was it. That was the whole company. We did have a SaaS product that was hacked together by these very small number of folks, but it was a way to help productionize dbt. You write all this dbt code that does all this data transformation, and you need a way to actually run it in production on an ongoing basis and to do logging and alerting and all of this kind of stuff. And so it provided all of this around the edges of the kind of open-source experience. It barely existed when we first raised money, and since then, it’s grown very quickly. It’s turned out that dbt scales well into the enterprise, and that’s something that I think you often don’t find because the enterprise needs a different set of features and functionality to deal with the complexity there. But what we found as essentially a developer tool is that as long as we are providing the language constructs that people can use to describe their business, we don’t get caught up in a features and functionality conversation going into the enterprise. So I think we’ve had a little bit of a smoother transition there.

Jon: So, you know, before we get a little more technical, I want to talk about a concept that you’ve spoken about a few times, which is the concept of epistemic truth. Can you talk about an example of how truth has played out with a customer and the analysis that you’ve run, and how the customer has benefited from that?

Tristan: I’ve become very interested in this topic, and I’ve realized there are actually two parts to it. The first one is how can you know that something is true? Originally, I was of the opinion that your e-commerce company processed a certain number of orders yesterday, and that number of orders was simply the ground truth of the matter. And our job was to write analytic code that reflected that ground truth of the matter. What I have come to believe on that topic is that that is insufficiently nuanced. If you look closely enough, there are always these cases of, like, well, does this one count? It was returned? Does this order count, it was, whatever, in some different state? It turns out that the question, ” How many orders did your company process yesterday,” is actually undefined without additional specificity. And so, what we do in our companies is we create these windows into the world, and we kind of socially construct these definitions.

Let’s leave the concept of ground truth for a second. And what I actually believe the job of data teams and dbt to be doing is that we need to steward this social construction process. So, what happens in many companies is that there’s a tremendous amount of chaos. There’s no accepted definition for metric A, metric B, metric C, so as a result, you get a lot of confusion about — “How do we talk about our reality?” There’s no good way to have a conversation about reality when everybody’s using different definitions. And so while I don’t think that there’s a way to reflect ground truth about the number of orders, there is a way to run a social process whereby the end of that social process is, we all agree — even if this is not the perfect metric, it is the metric that we use, and we can all consistently use it to talk about our business. And it turns out that like this is something that software engineers already know how to do. There’s no such thing as bug-free code, but there is code that works in production, and there is a process to get that code to production. And there’s a process to when you find a bug in production, like what do you do about it? So the goal in software engineering is not to architect some perfectly working set of routines. It is to build something that basically works and that you know how to, over time, continue to iterate toward correctness. That’s a big topic. I hope that was useful at all.

Jon: It’s very useful. My question, though, is how organizations have responded to that kind of discipline with the benefit of a tool like dbt? Has that changed the thinking that they did — the decisions that they made?

Tristan: Here’s how I’m going to try to answer this question because it’s a big one. How have organizations responded to dbt and dbt’s way of thinking? I think that that is very mixed. It’s not surprising that it would be mixed because there’s this Harvard Business School article from like the early ’90s that essentially says the primary task of any company is to create and disseminate knowledge. Everything’s changing all the time, so this group of humans who are here to advance a goal, that the most important thing that we do is figure out how to learn new stuff and then spread that learning to everybody else. So, you would then expect — and I would not actually say this is just in response to dbt, but in response to what in the industry, we would call the “Modern Data Stack.”

I think the modern data stack has very significantly improved the frontier of what is possible in data. And it’s not that any one given analysis using the modern data stack was not possible previously. I think about it as this kind of two by two — and on one axis there’s governance. Like, do you have any control over how knowledge is flowing through your organization? Can you trust it, etc? And the other access is velocity. And previously you could have things that were fast and not very trustworthy, or you could have things that were very trustworthy and incredibly slow — but you couldn’t have fast and well-governed.

And what the modern data stack has allowed companies to do, who really adopt it, is to get fast and governed. The implications of this for how organizations operate, I think, will be continuing to play out for a very long time.

Jon: Let’s take in a little bit to dbt and the sort of world around you. Way back, how did you get the dbt community started? How did you kick that flywheel into motion?

Tristan: I think of this as, you know, the best way to see stars in the night sky is to not look directly at them because it turns out that the edges of your eyesight are much more low light sensitive. And I think one of the best ways to start a community is to not try to start a community. Sometimes I field questions from software founders who have gotten from zero to one, and now they’re thinking about scalable marketing channels to continue to grow. And they say, “Ah, I want to start a community.” It’s like, I, that’s not generally how that goes. For us, we were practitioners, we were trying to solve real problems. We were using dbt as a tool in solving those problems, but we were not really just talking about dbt, we were talking about the problems that we were facing in the context of doing the kinds of analytics that digital native businesses do. And so we had a Slack group, and the Slack group was like for our little network of people to kind of collaborate. And three months in, we ended up working with a company called Casper. They were really very central in the New York tech community in 2016. Their data team was like a dozen people. And they hosted meetups and all this stuff. And as a result of this project that we worked on together, they adopted dbt, and they became this kind of central locus. They brought other folks from the New York tech community and told them about this new tool that they were using. And things have kind of spread from there. And Drew and I, who don’t live in New York, we were kind of observing all this from afar. We just continued to be helpful on Slack, and people were trying to get set up and running, and people were trying to absorb the things that dbt kind of assumed about how you were going to work. We just worked with people without any expectation of an immediate payoff there. So if I were going to kind of summarize all that — create some focus that people can kind of organize around and then just provide value. But then do it for a very long period of time. I mean, it was years and years before there were a real meaningful number of people in there.

Jon: You know, one thing I asked myself looking at the history and the growth of all of this is at what point did you start to get access and support from bigger tech players who were in the ecosystem as well?

Tristan: Hmm. Like as users or as partners, or…

Jon: However you would define it. If you think about the hyperscaler clouds — AWS, Azure, GCP — or you think about Snowflake or Databricks or whatever else. Did you get engagement from them? Did you get what you needed? Would you have liked to have more in looking back?

Tristan: For a long time, we thought that that would be a really big accelerator. In the early days, we tried to get the Redshift team to talk to us, and they were like, “Come on, two guys with a little open-source project. Like, sorry, we don’t have time.” And that’s, that’s fair. That’s like probably the right decision on their part. But what that ended up making us do was we learned Redshift inside and out. Like I, I don’t know that there’s that many people in the universe that know the Redshift optimizer as well as my co-founder Drew. That story has played out similarly with, other big tech companies over the years. I think that what we’ve learned, and certainly at this point, we do have fantastic partnerships with really all the major players in our space. But what I’ve come to terms with is that if your product is unique and if it assumes that users are going to need to go through some learning, some mindset shift in order to use it, then really you’ve got to do that work yourself. No other vendor is going to understand how to sell our version of reality — that’s on us. And maybe we can get invited to do road shows with partner A. We can get on invited on stage at partner B. That stuff is really good. It’s good exposure, but like at the end of the day, none of that stuff matters to us as much as being consistent with our own messaging, consistently growing our own community of users, getting them to see the value, and getting them to share that value with their colleagues.

Jon: Got it. That helps.

Tristan: Let me just say, though, we would not be successful without our partners. No enterprise technology company, I think, is really successful without its partners. But I think that sometimes, especially founders in the earlier stages, think that partnerships are going to save them. And that’s not true. You have to do the work yourself, and your partners are an accelerator once you’ve done the work.

Jon: And you’re in the other position now where you’re the captain of an ecosystem, and you can see any number of younger companies — Features & Labels, Continual, Monte Carlo, Datafold — who explicitly are playing in the dbt ecosystem. And they are finding their own path. If you speak to any of them, they’re going to tell you why what their building is important and how they’re making it happen. But as the captain of that ecosystem, how are you able to help, and what should new founders know who are going to forge that path in your orbit?

Tristan: Yeah, you’re totally correct that we’ve had to do a lot of navigating on this front ourselves over the past couple of years. I have never been at a company that is in the position that ours is. So, I don’t know how all partnerships teams think about this, but my guess is that frequently partnerships are thought of primarily from a commercial lens — how do we drive revenue together? And not that that’s unimportant to us over the long term, but we are a community first — we’re open source first. And so, our primary relationship with partners is one of neutrality, which is a strange thing to say, but actually, the last thing that we want to do is try to influence the technical choices of our community members by putting our thumb on the scale for one partner versus another partner because they drive more pipeline. We think that it is a real privilege that so many companies have chosen to use dbt. Dbt has become the standard for the layer in the modern data stack that we are. And, if we are going to continue to be trusted in this way, we have to act in a way that is good for all of the community as opposed to just constantly pushing things toward our own commercial interest.

So that’s, that’s lens one. You know, how do we stay neutral here and create space for these vendors to participate? The second part of this is we want to paint a vision of where we hope and believe that the ecosystem can go so that vendors can try to figure out if they are aligned with that. And if so, how do we work together to get there? Because any vendor that is explicitly trying to build toward the same type of future that we envision, we want to roll up our sleeves and do everything that we can to make that happen with you. We have this explicitly ecosystem-focused view of how the future will unfold. What that means is we cannot sit in a room by ourselves and just decide on a product roadmap for the entire ecosystem. That’s not how that works. We can talk about where we hope everyone will get to and what our part of that can be, but then we need everybody to build all those different puzzle pieces.

Jon: So how do you signal to the ecosystem what principles or visions you have for the future?

Tristan: I get one time a year to talk live to everybody in the community — my Coalesce keynote. I have a newsletter, that I use to test ideas and also ask challenging questions about the future.

One of the interesting things I think about this ecosystem curation role is that many technology companies only want to talk about how amazing their stuff is. But if you think about the future, inevitably, if you want to improve along some axis that then you are implicitly saying we are not as good today as we would like to be along that axis, which is something that, I think can be very uncomfortable for many commercial software companies. But if we don’t actually paint that vision of the future, and if we’re not transparent about the ways in which the lives of practitioners today probably could be better than we’re not going to be able to all get there. I think this is one of the interesting tensions between open source and commercial. Open source wants to be talking about all of the terribleness that we all live in today and how tomorrow we’re going to build the following things to fix it. And commercial wants to be focused on, “Look how amazing the world is today.” So, we have to do both.

Jon: Well, let’s talk a little bit about the, the technology environment. You said that dbt was created to take advantage of all this latent compute available via SQL run times, and now there’s new things like Snowpark or the notebook Runtime from Databricks that you, Tristan, and you dbt can access that same compute now with the flexibility of a procedural language like Python. What are the implications of that for what dbt can now achieve that you couldn’t achieve before under the covers for your customers?

Tristan: I come from a sequel background. I think dbt’s original M.O. was to take people like me who were not fully fledged data engineers but were reasonably technical data analysts and to give them tooling to build mature data pipelines. This made sense because originally Redshift and later — Snowflake, Big Query, Databricks, etc, — they had this, cloud infrastructure that all of a sudden, you didn’t have to think about, how your, compute and storage was provisioned. You just signed up online and clicked a few buttons and, maybe, opened up an IP address in your firewall, and you had infrastructure. This was a permissionless way to get a new set of capabilities into a lot more hands. The challenge there, though, is that that’s only a subset of data practitioners. There are the folks that consider themselves more data scientists or statisticians or other folks who are using more statistical methods in their work. And then there’s also a set of folks who are less comfortable describing all their work in code. If we take seriously the idea that dbt’s job is to create and disseminate knowledge, that’s not a job that is done exclusively by one role at a company. We’re trying to, over time, address more and more of these user profiles. So, while we didn’t start with Python because Python was not quite as turnkey as SQL was, we’re seeing the big data platforms roll out services that make Python more and more turnkey, and so we saw some of these innovations, and we said, “Okay, this is a great time to welcome a new set of folks into the dbt workflow.” And it’s a big experiment. It is actually the first time in six years that we have changed the primary persona of the product. And I don’t actually know if that means that the floodgates will open, and honestly, that was never our experience with our original persona. So, I don’t think it’s going to be our experience with persona number two. But what I do think is that over time we need to take data analysts and analytics engineers and make them share a lot more of their infrastructure and tooling with data scientists. The work that they do is too related to each other to be operating in these 100% separate ecosystems.

Jon: There’s something I don’t hear you saying, and I just want to press on that for a moment, if I may, which is that for the SQL persona, Jon Turow, writes some SQL, dbt’s going to go executed historically in SQL. Dbt now has the ability to execute Jon’s instructions that came in SQL, but by dbt’s choice, could be in Python instead. Does that give you the flexibility to do things that you’ve never done before? Have you started to look at that?

Tristan: I want to make sure I’m understanding your question right. In your example, you are writing SQL inside of dbt, and dbt is then turning around and running that SQL against a data warehouse. In the future, what if you wrote SQL and then dbt turned around and executed Python against the warehouse? Is that right?

Jon: Yeah.

Tristan: That’s theoretically possible. But here’s the way that we think about dbt. I don’t know if this dates me, but I learned to build web applications in the mid-2000s using Rails. I am by no means a gifted programmer — I figured out in my time how to build some basic web applications. But I think the only way that I was able to actually do that was that I had a framework that told me to put these files here, we’re going to wire them all together, and we’re going to kind of deal with the complexity. So, Rails doesn’t actually go about writing your code for you. It doesn’t express your business logic. It doesn’t do any real magic under the covers. It just provides you a framework wherein you can kind of focus on the high-value add activities and not focus on like, how a web request passes from M to V to C. So, we think about dbt in the same way. It is a way to create a lot of leverage for practitioners such that they don’t have to think about, ” Oh, what’s the create table syntax on this data warehouse?” or “How do I ensure transactional consistency” or any of this stuff that’s critical but it’s also kind of boring. We take care of all that stuff. But what that means is that the user actually has to ultimately express the thing that they want. And so with python in dbt, we’re allowing users to express what they want in Python, but dbt itself does not write Python on your behalf.

Jon: You’ve spoken about SQL as almost a TCP/IP layer between components of the modern data stack in the sense that it’s ubiquitously implemented and, therefore, kind of a lingua franca for those infrastructure components. But, of course, there’s the other benefit that very many people, very many information workers, at least can write bad SQL. The stories you’ve told Tristan, and that people told about you, is that you can write queries like music. But I, Jon Turow, cannot. I can write queries that run, and I think we see a lot of queries that are even sort of hacked and edited and remixed over Slack. So my question to you as an industry is, what do we need to do to further democratize and expand access to data and analytics?

Tristan: Okay, let’s start small and tactical. There’s remix culture in software engineering, right? This is a big innovation in music, and it’s where most content on the internet comes from at this point with memes. It exists in software engineering too. It’s like Stack Overflow culture, right? It’s something that is often made fun of, but at the same time, it’s tremendously valuable being able to say, “I have problem X, I am going to go find other people who have problem X” — and there is a way to find those people and to learn about their solutions and potentially adopt them. That’s incredibly valuable. We don’t really have that in data. And I think that there’s a couple of reasons why. One of them is that while you can share the code, you can’t actually understand what the code is doing without data. You can’t execute that code without the data that backs it. And often that data is proprietary. And so, while the code, some seven-line subroutine is not particularly proprietary, and generally employers don’t really care if you share seven lines of code on the internet, you can’t share a single row from a database on the internet. So, it makes it very hard to collaborate in this way.

I also think that there’s tooling that doesn’t exist. Data people generally have been kind of far away from the Git workflow, and so we don’t have the concept of a gist, really. There’s not a lot of like public code sharing in this way, and then commentary on it. This is one potential answer for DuckDB. Like what if something like DuckDB made it easy to kind of package up little data sets that you could run shared code samples on top of so that you could start to build some of this remix culture. Because not everybody has a computer science degree, but it turns out that by using Stack Overflow, you can still build some actual working code, and we need that to start to be true in data as well.

I also think that since dbt kind of took the hard line that we needed to bring Git into data teams, we’ve seen more and more products bake Git in as a first-class element of their experience. One of the elements of the “SQL process” is that none of that SQL that’s kind of passed around feels like it’s permanent, that it’s not part of some mission-critical working application. It’s just like a message that you sent to your coworker in Slack. But if you take that collaborative process out of DMs, and you put it into Git, you will find that just the mechanisms of Git and pull requests and comments will slowly tend the process toward higher quality over time. And I’ve watched individual data professionals go through this experience time and time again. And it has everything to do with the signals that their context is sending to them about, like, does quality matter? And then longer term, we could get into — how do you create a no-code tool that still participates in the Git workflow? Because at the end of the day, not every single person sitting in front of a computer for work is going to learn to write SQL. And that’s okay. And we have to also allow these folks to have experiences that give them the accessibility that they need but do not sacrifice, as tools in the past have sacrificed, that accessibility for quality. We have to be able to have both. And I think there’s ways to do that.

Jon: I just want to touch on something you said and maybe expand on it — there are these signals, either active or passive signals, that happen in the communication between producers and consumers of data or between consumers and consumers of data. You can even think about things like Amundsen catalog types of tools that add a social layer where if I know there are three fields called active customer, but Tristan uses the second one and might use the second one too for a similar query.

Tristan: I think that what we are fundamentally trying to do is not so dissimilar from what Wikipedia did. Whether you want to call it the grand total of human knowledge or whatever it is that Wikipedia represents. The thing that was built there was not some piece of software. It was a sociotechnical system. It was an interlocking between software tooling and community and individual motivations, and the end result was this process whereby subsequently, more and more information was contributed, and that information had a process to go through that could be more and more correct and more and more validated.

So, what I think we need to do inside our companies now is create a similar sociotechnical system. And it’s funny that most tooling providers don’t seem to think like that. They’re worried about capabilities. Does my thing do X? And what I think, actually, we need to start thinking about is — when I build my tool in the following way, what behaviors does that encourage this set of people to undertake?

And it’s actually not possible to know the answer to that at the outset. It’s a much more experimental mindset. And I think that in the past, enterprise software broadly, and data tooling as well, has not tended to think about experimentation as much as the consumer space has. But I think that what we’re trying to do is create this emergent behavior where companies are constantly contributing new knowledge and refining it and collaborating on it. And that’s not just a list of features that’s required to do that.

Jon: Super cool. So, looking ahead, we spoke about who are your users and your customers and what problems they all want to solve. And you’ve really been consistent about data analysis and data analysts and analytics engineers. You’ve separately spoken about how ML engineers occupy a different space in many organizations than their data colleagues do. They have different tasks. They get treated differently. They may have different tools today. But, of course, they still have lots of appetite for distilling truth from data. And my question to you, Tristan, is whether you see ML engineers as sufficiently similar to data engineers that ML engineers should also use dbt, or whether you think it’s such a different persona that they need their own community, their own technology, and their own product?

Tristan: I think that what I feel very strongly about is that the world of the ML engineer, the data scientist, should be less bifurcated from the world of the data analyst, analytics engineer. I’m not a maximalist when it comes to what should the product surface area of any given tool be. I have no need to conquer the world. I don’t need to convince ML engineers to use dbt if that’s not the right answer. Honestly, the thing that feels problematic today is that there are huge teams whose entire reason for existence is to take the upstream mess of data that flows into the cloud data environments and distill it into something useful. And that process typically happens twice — in most companies. A majority of that effort happens to support analytics and BI. But then there’s this separate effort that kind of does much of that again in support of machine learning projects. And sometimes, using today’s tooling that’s actually required.

Sometimes the latency requirements are completely different. There’s different types of transformations that are needed. Whatever. So, sometimes there are good reasons for this, But I think that we need to sand those edges off. This whole refinement of the truth process needs to happen as a collaborative effort. Now, if you take this truth, and you want to run ML models on it, and that process does not happen in the same stack, that seems completely reasonable to me. I don’t think that you’re going to find a lot of folks who are strongly opinionated that like Tesla’s self-driving car algorithms should also run inside of dbt. So there’s a line somewhere. But I think that we need to kind of bring this lower-level processing closer together and then kind of see where things go from there.

Jon: I think that’s a great answer. Just a couple more questions — I want to go through kind of a lightning round. First, either inside your ecosystem or outside it, is there a startup that we haven’t discussed today that you’re particularly excited about?

Tristan: Oh, oh my gosh. Okay. I don’t want to name a specific startup. There are actually two attacking a similar problem today, I honestly don’t know if it’s time for this problem to be solved, but it’s a problem that I’ve been asked to solve for 20 years. It is the ability to ask questions in plain English and get correct answers out of structured data. And the thing that I think these two startups are betting on, and with some success so far, is that large language models are the bridge that we have been waiting for to be able to finally do this. So it is way too early to tell if this is going to be successful. But I do think across the two decades of my career, it’s been kind of that thing that everybody wishes that they had for the data last mile problem.

Jon: We could pile out of that a lot, but I did say lighting round, so we’ll save that for next time. Second question. In the bigger picture, what do you believe will be the greatest source of technological disruption or innovation over the next five years?

Tristan: Hmm. This is a boring answer, but I still think that we’re incredibly early in the cloud transition. All of the work that we do is a part of the cloud story. And I think that people say things like, “Cloud adoptions is at 50% of enterprises globally.” But what does that mean? Does that mean that somebody bought an EC2 instance? That’s not cloud adoption. Cloud adoption actually implies organizational change. And that takes a long time. And I think that we’re still pretty early in that process.

Jon: Next question. What is the most important lesson, maybe from something you wish that you did better, that you have learned over your startup journey so far?

Tristan: I got a coach about three years ago, and it was the single most impactful decision I ever made. At the time, we spent 2% of our monthly revenue — this is when we were bootstrapped — 2% of our monthly revenue on this coach. But it ended up being money very well spent. I think that any leader has to come to terms with the fact that many of your instincts as a human do not serve you well in a leadership position. I felt like I was never good enough for the people around me — like people always wanted more from me or like I made a decision that wasn’t as good or that there’s always things that could be better. And as a human, you end up being very defensive I found myself wanting to explain, “Well, we had to do it that way because…” And a lot of times, your role as a leader is actually just to absorb those thoughts and feelings and just say like, “Okay, I hear you. Let’s talk more about that.” And that’s only just one example of, you know, something that I worked through with my coach. But I think that investing in the human side of leadership is just all too infrequently done and so, so important.

Jon: I will follow up with just one point on this. What have you learned about doing that in a Zoom world?

Tristan: I’m better at this on Zoom. I bet you that many people are better at it on Zoom because I think that sometimes getting into some of the harder human topics can be very intense when you’re literally right there with the person. I actually like having the safety of being like, “Okay, at the end of this, I’m going to close my browser, and that will be that.” I don’t know that that’s true of everybody, but I’ve learned to be really on and present via a screen in a way that I wasn’t actually as good at in person.

Jon: Tristan, thank you so much for your time today. I really enjoyed the discussion.

Tristan: Thank you. It’s been a lot of fun.

Coral: Thank you for listening to this week’s IA40 Spotlight episode of Founded & Funded. Keep an eye and ear out for coverage from our inaugural IA40 Summit. And tune in in a couple of weeks for our next episode of Founded & Funded.

Data Visionary Bob Muglia on the Modern Data Stack and Lessons from Snowflake

In this week’s episode, which is leading up to our Intelligent Applications Summit on November 2nd, Soma speaks with Bob Muglia. Bob has thought deeply about the Modern Data Stack, and they speak about it here — what is needed in the data stack to enable Intelligent Applications (or data-driven apps as Bob calls them) and the opportunities for new companies to innovate. Bob is also well known as the CEO that took Snowflake from a promising application for the public cloud to success by focusing on the problem of scaling a data warehouse in the cloud, and building product and sales teams that could win the hearts and minds of their loyal customers. Bob talks here about the early days after he joined Snowflake and what he did to get a product to market, how partnering with the big public cloud providers worked- and had its challenging moments. It’s a great view into how both Soma and Bob are thinking about the future of enterprise data and intelligent applications.

Note: Bob is on the board of IA40 company, Fivetran, which was the focus of a recent podcast, and he is chairman of the board of FaunaDB and RelationalAI, Madrona portfolio companies. Madrona holds shares in Snowflake,

This transcript was automatically generated and edited for clarity.

Soma: Bob, good afternoon. It’s fantastic to have you here with us. I’m very excited to talk to you about the future of data and data-driven and intelligent applications

Bob: Good to be here with you, Soma.

Soma: Absolutely Bob. And as you know, we at Madrona have been longtime believers in ML/AI and, more importantly, how do we apply ML/AI to different enterprise use cases and to different scenarios to be able to build what we refer to as next-generation intelligent applications.

And I was thinking about this, and as I was getting ready for the session, I couldn’t think of a better person to have this conversation with — and let me tell you why I say that. First of all, let me introduce you. Here with me is Bob Muglia, the former CEO of Snowflake, and prior to that, a long-term senior executive at Microsoft. He has done a variety of incredible things in his career — a lot of it data-driven, and this is where I come back to why I think you are the best guy for this conversation. Bob. Ever since I’ve known you, and I’ve known you for almost 30 years now, I think about you as a data guy first and foremost.

You go back to when you started your career at Microsoft, you were a Product Manager in SQL server. And through the following decades, I’ve seen you do something or other with data in one way, shape, or form. After leaving Microsoft, you decided to take on the range of Snowflake when it was a pre-product and a pre-revenue company. You spent over six years at Snowflake, growing it literally from zero to hundreds of millions of dollars of revenue. And I think you laid a lot of the foundation for Snowflake to be the leader that it is today in the cloud data platform world. After your stint at Snowflake, you’ve been working with half a dozen or more companies, startups, I should say, private companies as an investor, adviser, and board director.

The one common thread among all these companies is they all are doing something or other with data. I just look at the body of work behind you, and I say, “What a fantastic opportunity for us, and by extension, our audience to be able to hear from you about the future of data and how you see the world of intelligent applications evolving.” With that as a backdrop, I thought let’s just dive into some questions to kickstart this conversation. Let’s first go back to your days at Snowflake. As I just finished mentioning, when you started at Snowflake the team was still working on a product.

The product wasn’t in the market, and you went through this sort of what I call the “growing pains” of birthing a product and bringing it to market, thinking about the business model and getting it to scale. But along the way, I’m sure there were a handful of what I call “defining moments.”

Where you had to make a decision, or you had to think about something that literally laid the foundation for why Snowflake is who is today and what it is today. Can you think about a couple of those defining moments and just share with us what those are and how you navigated through those?

Bob: Sure. There were a couple of things early on that happened in the early time of Snowflake. You’ve got to go back to the period we’re talking about, which is 2014, 2015, where it was the early days of the cloud. Really, AWS was the most viable cloud at the time. Azure was still very early, and GCP was in some ways even earlier. it was a very different time. And a lot the of the focus of Snowflake was really about changing that. But a big part of it was also getting the product to the market because we were fortunate in the sense that we could scale to data of any size basically and as many users as you wanted to throw on it. And only having one copy of data for the whole organization instead of having to have copies scattered hither, tither and yon, which was the default at the time. So, it was a revolutionary product, but it still had to come to market.

And it was funny because when I started at Snowflake, the founders, said to me that their plan was to make the product generally available to enterprises in about six months. That was in June of 2014. I knew that somewhat unlikely, frankly, from all of our experience. You’re smiling, Soma, so you know what this is like in terms of developers in the early days. And I watched them for a period as they went through a couple of these two months’ milestones that were doing. And I had this observation that during that two months, they said they were going to do a bunch of things, and basically, none of them got finished during that period of time.

Other things did get done. They were working hard. They were certainly working hard, but it wasn’t like they were really working towards some well defined goals. One of the things I focused on was really trying to help bring some rigor and discipline to what it means to be an enterprise class product , , over the period of the next year or so, a little bit less than that, we went through a process whereby we really defined what general availability meant, and we went through a process of, getting, focusing on getting those tasks done.

I literally turned weekly team meetings into a project review only thing the sales people cared about was the status of the product as we don’t everybody cared about. And, we went through focused effort and got the product shipped in the middle of June. And that was really the beginning the beginning of the Snowflake experience.

The another thing that, we had, there’s always these sort of things that happen to companies in their early days that they, that, that happened to them and they survive or not. one of the more challenging things we went through early on was inside Snowflake, the transactional heart of the product is a technology called Foundation DB.

And Foundation DB the time in 2014 was a company, it was actually a sister company of one of our VCs, Sutter Hill. So we knew the company well. But I was in the process of negotiating agreement and I was able to negotiate an agreement. If anything happened to that technology, if it went off the market, that we had access to it through a code escrow, of course we hoped never happened, but it turns out it did happen.

And in seven, eight months later, Apple bought Foundation DB and immediately took the product off the market and made it unavailable to which is our worst nightmare. And, fortunately we were running it and we’re a bunch of database people and the source code escrow actually worked and we got the product through that we actually had to do what it took to actually learn how to be good at bugs and Foundation DB.

And pretty much had to do that all from scratch. And that was a very big deal. Had that, we not had access to Foundation DB, there really was no other good choice. Not at that time. Products like Fawn and Cockroach didn’t exist. And I don’t know what we would’ve done, to be honest with you.

I don’t know. I honestly don’t know what we would’ve done. But we survived that and now, fortunately, Foundation to be as open sourced and that’s very healthy. It’s actually healthy and Snowflake’s a major, actually a major contributor to it. So it’s actually a really good story, but it was a tough one.

So there’s, things like that happen in your process. I would say the other thing is just customers, I focused on all the time and being successful with customers. And, we didn’t lose customers basically speaking because didn’t take on things we couldn’t do, times would turn people down because we couldn’t do the work they wanted us to do occasionally.

And and really focused on the success of working with costumers.

Soma: That’s super helpful, Bob. I also remember that there was a lot of talk during the initial days of Snowflake about hey, we should think about like, you separating out computer and storage and that could enable us to get to the level of scale and economics, right?

That would be good for our customers and hence for us kind of thing. Any sort of color on, on, like how that came about.

Bob: think architecturally that was always part of the idea of separating compute and storage was always part of the design demo. And Terry had, the architecture at Snowflake has something called Global Services, that manages the metadata and does the query and does the query planning.

And then they have an execution processor that runs the actual, is the virtual warehouse and runs the actual SQL jobs. And now I believe it’s running the Python jobs too and, other languages. So it’s become multi-language really. And, the evolution of that whole thing changed dramatically over time and how we stored the metadata and everything and that separation of the metadata was a fundamental component of Snowflake.

But the way we did it certainly changed over time and I think, we were able to stay ahead from a scale perspective. I always said was interesting because, we were just ahead of our customers. In the early days, they were chasing our tail and scale in a variety of ways. And we, it was always, we were always working hard to stay ahead of customers, so customers had a great experience.

Soma: Bob, I do want to take this opportunity to say thank you to allowing both Madrona and I to be able to invest in Snowflake and be a part of the journey along with you and see it come to scale

Bob: …you guys were super helpful too. At the time we were opening Bellevue, the Bellevue office, which was very, I think, very pivotal office for Snowflake. of course Madrona has such strength in the Seattle area,

Soma: . I’m glad it worked out all well. But when I got involved in Snowflake, one of the things I heard, a fair bit is you got all these like big cloud platform providers, whether it’s AWS or Azure or GCP, all wanting to have their own solution in the space and how they’re going to , you crush Snowflake and how a fledgling startup can just not compete with any of these, at scale, massive cloud providers , but somehow Snowflake navigated through that and just reached a level of scale and success and is literally a leader in the cloud data platform world today.

, two questions that I want to ask you. In that context, how did you feel about it when everybody was probably telling you, or you heard the same thing about “Hey, all these big guys are there, they got their own, data warehousing solution, the cloud”, and how did you feel like confident that Snowflake was going to be able to navigate through it?

But then the second part, which I want to focus on is the partnership that Snowflake had with all the cloud providers. Because on the one hand, you could argue like, if if there is a customer that know goes with Snowflake on Azure, it is still a win for Azure. On the other hand, if you think about Snowflake running on AWS, Snowflake is competing with Redshift on AWS, right?

So you got this what I call a cooperative, in mind, midway, you are, partnering with the platform, but you’re competing with the service. How did that whole landscape, work out for you?

Bob: Yeah. To, so in terms of how we competed with the big cloud vendors, we had a better product. It was really that simple. If the product has, I said many times, if Snowflake was 10% or 20% better than Redshift, snowflake wouldn’t have gained any material share, but it was many times better.

I It worked in situations where Redshift didn’t work and Redshift is a very good product, it, paved the roads for cloud data warehouse. And for that I’m eternally grateful.

By bringing out Redshift very early in the marketplace, which they did. It was, the thing is it was a on-premises product brought to the cloud, so it didn’t really take advantage of the cloud. And what it was cheaper. It was definitely cheaper than anything you could buy. It on premises.

, but it didn’t ultimately scale.

People in the cloud world particularly wanted it to scale. And we saw, I wonder, in fact, one of my earliest, my earliest first salespeople, Vince Trada, I remember vividly, I was on the subway with him in New York in February or so of 2015. And we’re seeing customers who were talking about adopting Redshift.

And Vince said to me, “Bob, don’t worry about this because every one of those customers that adopt Redshift are going to come to us in the next 18 months when they run out of gas”. And he was right. That’s essentially what happened. A lot of Snowflake’s early business was Redshift conversions, well as working with semi-structured data, which we did a good job on and nobody else did.

Certainly we were better than Hadoop, which is what people were using at the time. And and so that was a major, the major part of the success force. So we were just better and frankly, particularly in AWS, we had a much better product. We’re lucky that we were in the timeframe we were establishing, and that’s the other thing, it was the right time. That was the time for establishing , the position in that, in the data space in the cloud. Because it was all pretty new.

Terms of our relationships with the vendors, they were challenging to say the least. We certainly had, many challenging times with Amazon, who we were competing with in Redshift. What I would say is first of all, is Amazon did an, incredibly good job of supporting Snowflake at all times and they were great at support and

AWS is a great product to build on top of. But they were brutally fought against us in the business marketplace in the early days and, it was pretty challenging it sometimes, but we were winning. We, the thing is we won those challenges partially because again, we had a better product and frankly we had them much a better trained sales team.

Our sales team. Was able to, to outsell Amazon’s. And so that was the early days of Amazon. And then, when we moved to Azure and we established Azure as our second cloud in part because of my relationships with Microsoft people, we were able to build good partner relationships there and actually had some amazing, very positive going to market motions with Microsoft in the early days where they did a bunch of joint selling with us and really discovered, whole different business.

What we discovered was that Azure, it was a whole set of customers we’d just never seen before. It’s just a whole, it’s a whole different market almost, really customers and we always said this, choose your cloud first and then choose your data warehouse.

And Snowflake ran on all of them, so it makes it a little easier. But at the time we were just running on AWS and then Azure and so it was positive it was a win-win situation in some senses for Microsoft and Snowflake to go together. I think that about the time I left Snowflake in 2019, Snowflake was probably becoming more competitive in a number of ways.

And in some senses the strength of the partnerships in Snowflake, I think flipped really. And they had a rough time with the Azure folks for a while and they actually built some very strong relationships with AWS, .

There’s lot of good things happening there. I think Google is still tough, if I’m not mistaken. , Google has, generally speaking, not the most partner-centric company on the planet. And I know that’s been a little bit more challenging for Snowflake, in part because they really love Big Query and they have the same feelings about Big Query that, the folks used to have about Redshift.

Only time will tell. These are challenging because they’re competitive they’re definitely complimentary and competitive.

Soma: Yeah the thing that was interesting for me to watch is, there would be a face off time when you would think now, hey, this particular cloud provider is the best partner. And then things will change and then things will change back. Just the volatile team, the partnership as Snowflake went from strength to strength and depending on where the other cloud providers were all, it was just fascinating to see how it was a very interesting and ever changing landscape.

Bob: It It just proves my first rule of partnership. Soma, partnerships are tactical. You know when it’s win-win, they work. When not, they start to falter a bit

Soma: But I think no Snowflake could be a sort of a good good, what should I say? An inspiration or a good role model or a good case study. For a lot of the other new startups that are coming up and saying “Hey, am I competing with the cloud providers or am I partnering? How do I navigate this tough thing?”

And depending on what space they are in and what the cloud provider’s aspirations are, it, many companies could be in a similar situation. That’s why I want to make sure that we talked a little bit…

Bob: That’s very true in fact. I have this conversation with a number of the companies that I talked to about potential, about their potential conflicts with cloud vendors. A lot of the stuff people are working on these days is complimentary to it’s new things that I don’t think have the same kind of conflicts that we had with Snowflake.

I do think in general though, that Snowflake is a good role model. Building a partner-centric company in general. In addition to really working with the strategic, the strategic cloud vendors and spending a lot of energy there, we spend a massive amount of time working to build an ecosystem and working with partners all around, whether they be, partners, like BI partners, ML partners, I mean, ATL partners, whatever it might be there, as size, and I feel very good about what Snowflake has done in that space.

And I think that, I definitely felt like I had something to do with that. And the history our shared history together at Microsoft, is the lessons that I learned from

Soma: Great, Bob. I thought it’d be good to take a step back now and think about hey you’ve been, as I mentioned, you’ve been working in data in one way, shape, or form for the last 30 years. How do, how have you seen the..

Over 30 years,

Bob: Been over 30 years. It was Windows NT Summit. It was Windows NT.

Soma: Over 30 years. But during this period of time, Bob, how have you seen the world of data evolve? New platforms, new computing paradigms, new devices, new, everything has happened. But the importance of data seems to have only gone from strength to strength and has exponentially gone up in the last 10, 15 years.

Now, I wanted to get your quick thoughts on “Hey, where do you see data today and where do you see data moving forward?”

Bob: It was just over 30 years ago that Bill did his information at your fingertips. Saw talk, which really, I was working on, I was a program manager when I started at Microsoft and SQL Server. So I was working and I had been working on database things as a, as really building applications inside a company before I joined Microsoft.

So I’d been focusing on data pretty much my whole career. And so I, while I’ve been focusing on SQL in the business side, but I still feel in some senses, like the beginning and the perspective began with information at your fingertips and all the focus that we had on information of all kinds at Microsoft and building out businesses and enabling people to work with data.

In the early days, I was found in, involved in SQL Server from the, from very early on. And then I watched as other folks at Microsoft built SQL Server and built it into the business that it really became. And I watched that transform. I watched these kinds of data systems together with the applications that sit on top of it, transform businesses of all sizes.

And, Microsoft contribution was the of all sizes really. You know, if you were a big company you could buy from IBM, Digital or Sun. A big, expensive set of systems, but Microsoft made servers that were quite inexpensive and brought computing to literally millions of small businesses around the world, maybe tens of millions never had it before.

And that was really, data was a centric part of that. We’ve watched, now we’re clearly head to head, we’ve gone through the internet era and the evolution of that has been new types of data that have become important, in particular, semi-structured data, that’s generated in large quantities by machines.

In some ways is some of the most important data we analyze today. We’re now living in a cloud centric world, which allows us to do things that we never could do before. I am a big believer that, data’s generated everywhere, but you need to centralize it to a certain extent to do analysis around it, to bring different types of data together so that you can, you can perform the relationships, but look at the relationships between them and perform the kinds of and dashboarding that people want to do, as well as deeper analysis with machine learning. So things have changed so dramatically from, a fairly simple environment where literally people worked on pencil and paper.

Literally we’re, Excel was a massive step forward and in or 1, 2, 3, was a massive step forward in dealing with information now this world of the cloud where we have this vast amount of data available to us. It’s pretty amazing really.

Soma: You just summed it up Bob. It’s pretty amazing actually. What in the world, how far we’ve come along, but for all the progress we’ve made, I feel like there is still a turn more that is waiting to happen. And it’s just that the rate of innovation is only getting faster as opposed to slower as we move forward here.

Today, like now you can’t have a conversation about data without know, talking about the modern data stack. That’s that’s a sort of buzzwords or a new concept or whatever you want to think about it kind of thing. But everybody talks about like the modern data stack. In your mind, how do you define the modern data stack?

Bob: So I people have been trying to work with data in a variety of ways and fundamentally the cloud and the ability for companies to work together to provide a complete solution for organizations on the cloud, has never been as strong as it is today. And that’s really what the modern data stack is about.

Really enabling the industry to work together to provide solutions to companies. And those companies take on a cer, those solutions take on a certain shape in the modern data stack. And there’s three defining characteristics that I think exemplify that the modern data stack is really building modern, building data analytics.

That is delivered as a SaaS cloud service first and foremost, which means that building these components, you’re purchasing them from third parties that are providing the service for you and means that a lot of the things are taken care of for the customer. So the first thing is that it’s a SaaS service.

The second thing is that it runs in the cloud and it takes advantage the scalability, that the cloud provides to allow you to work. All of your users and any kind of data, and I mentioned earlier that data, is both structured data that people work with SQL and semi-structured data that comes out of machine generated systems.

But it’s also more and more other types of data that are, is quite rich in terms of its content. People sometimes refer to this as unstructured data. I really tend to think of it as complex data. Data types such as video, audio, photos, turns out to be a rich source of complex data.

All of these things that exist in business in the form of documents of all kinds and recordings of all kinds are essentially sources of data for the modern data stack. And with the cloud, it needs to scale for all, to work with as much as many users as you want, and so the final point is that when you’re doing the analysis against it the data is modeled for a SQL database.

And that’s, that I think is a distinguishing element of the modern data stack. Is when the data comes into the system the way you actually transform it, there are multiple techniques for doing it. And so let’s put that aside. But the target environment you’re modeling it for is a sequel database and you use relational commands.

Relational algebra, basically to operate against that, that data in a relational form. So three things. Data analytics is a service that leverages the cloud for scale and models data for SQL.

Soma: That’s great. And today, Bob, if you look at it and this is know I don’t know whether I would’ve predicted that. Maybe in hindsight it’s easy to say I thought about it this way kind of thing. But today you could say that there are like, key or big technology vendors that are providing like, vast parts of the modern data stack.

, you got the three cloud platform guys in Microsoft, Amazon, and Google. And then you got Snowflake and Data Bricks. And the fact that Snowflake and Data Bricks have literally come out from nowhere in the last, let’s say, eight years or so is fantastic because hey, that shows that hey, you can innovate, you can get to scale, you can get to a level of success even outside the biggest platform guys kind of thing.

And that I think is just goodness for the whole innovation ecosystem. Do you feel like, five is too many? Do you feel, five years going to become eight or any sort of thoughts on.

Bob: It’s about right. The database market has always been somewhat fragmented. It’s never been a winner take all. I Oracle has classically been the largest winner in the database market, but even they’re only like 40%. It’s a, it’s, it is a market that has a number of vendors and I think that’ll change.

My guess is you’ll actually see some more vendors appear. We see some smaller players coming in trying to on these five vendors in a variety of ways. I think it’s hard. There may be some, we may see six or seven having some small percentage share because for some more niche markets, I think these are the big five.

I think that, there’s going to be a big dog. There is a big dog fight happening between Snowflake and Data Bricks, and we’ll watch that get fought out for the next year or two. And meanwhile, the cloud vendors will just do what the cloud vendors do and their products will all get better. I do believe that the cloud vendor products, what clearly behind things like Snowflake, are getting better.

Google is probably the furthest along. And this micro, I know a fair amount of what the Microsoft team is doing. There’s a lot of actually great work happening there. I see some good stuff coming in the future.

Soma: That’s excellent as much as all these five players, and there are a whole host of other companies that are talking about “Hey, I’m building this for the modern data stack, “. As you see what is happening in the world today, do you see any big gaps in terms of what needs to happen in the modern data stack to make it really more complete and more robust for the next set of applications?

Bob: Yeah, I think there’s a number of really major gaps. I’m fairly sure that the platforms people are using for machine learning are fairly nascent and will evolve. I mean, I’m fairly sure that’s true. That, Spark is, has a lot of adoption, I don’t think it’s the end answer to every problem

and I think we’ll see evolution in that space. There are data types, , problem characteristics that are very poorly solved today, like graph. Problems are really situations where you have a lot of relationships between things and and if you look at the data model it’s a very large number of relationships that need to be managed more than a sequel database can handle.

And in general, the graph problem is poorly solved by today’s products. Meanwhile, there’s other things, that are critical to business logic. Like reasoning, which are still done pretty separate from the modern data stack. And you have bits and pieces of code all over the place and I think that’ll converge into more model based things over time.

I think a lot of the future is really around the evolution of model based development. And I think we’re in the early stages of that.

Soma: You talked about know, SQL systems and you talked about graph databases. Bob my perspective, and I’ll share that with you and tell me if that makes sense or not, is historically, and even today, the world is bifurcated into “Hey, you can go deal with relational database systems”.

And or you can go deal with the knowledge graph systems. Those two words are what I call two silos. They don’t, they really haven’t come together.

kind of thing.

Bob: You mean? relational systems or procedural systems today.

Soma: Or procedural systems. Yeah.

Bob: Yeah, like you’re working writing code in Python the one side and then sequel on the other side. Is that what you mean?

Soma: Do you think they’ll come together? They should come together? Do you think there is an opportunity?

Bob: I do. And I think that’s, as you said, a knowledge graph, that’s what a knowledge graph really can do. It and really the idea behind a knowledge graph is that you can encode of the attributes of the business into the database, the logic associated with the business.

And, that makes it, the idea then is it becomes a complete model. The organization is actually executable, where the model is the code itself. And in a way this has been a dream of computer science since I was a kid, when I was just not far out of school. I did work in early models based things where you model stuff with these diagram stuff and they spit out coball code at the bottom, which of course didn’t really was unmaintainable and didn’t work and all kinds of issues.

But, and because it never worked those sorts of ideas of modeling became more of a whiteboard effort, and I will argue that people always model business. Every, when you’re working at anything you’re doing, you’re modeling. But in today’s world, we do it implicitly. Implicitly, and we do it, with, might write a model of something that’s relatively thought through on a whiteboard, but then that gets implemented as bits and pieces of code all over the place, implicitly within the systems.

And I think we’ll move to a world that’s much more explicit in our, in what we’re defining. And that will happen when the knowledge graph comes about and when we think about implementing a knowledge graph. I’m pretty clear that they will be relational and they will leverage relational algebra and relational mathematics.

Partially because the industry has moved forward significantly in the last 10 years in terms of understanding algorithmic changes. New algorithms that allow you to work with large numbers of relationships sufficiently, and actually do things that you could never do previously with a SQL database because we just didn’t have the sophistication of the algorithms.

That are now appearing. So it’s pretty exciting actually. But it’s also early.

Soma: That’s true but as data becomes, what I call more democratized. One of the things that you talk to enterprise , CIOs, they’ll tell you that “Hey, we are really putting a lot of energy and effort into consolidating and standardizing our data infrastructure”.

But along with all these huge volumes of data and what can you do meaningfully with the data kind of thing. One issue that keeps coming up pretty much in every customer conversation today is data governance. This is also an area where, particularly in the last two years I would say, there have been a ton of new startups emerging.

All addressing one part of data governance or the other part of data governance kind of thing. How do broadly aid the space of data governance, and the kinds of companies that are coming up? Are there any specific companies that particularly catch your attention in the space?

Bob: Not really. They’re good companies. There are some good companies. They’re doing pieces of, solving pieces of the problem. But when I think about, you the issue with the modern data stack, governance is a very real problem. I It was always going to emerge as a major issue when we took data that was scattered everywhere and we put it together that it creates a certain risk profile where, which makes access control to that very important.

And in particular, that’s the aspect. I There are many aspects of governance data modeling. Data observability all sort, many things but the one that, that I think is that sort of at the top of people’s list is access control. And while there are products in the market that, that address some elements of that, I don’t think we’ve really reached the pinnacle of where we need to be.

And I, I don’t feel like we’re well served, that our customers are well served here. I believe that while there are some ways to, there are different ways to solve the problem and perhaps there are some shortcuts that people can take. I think in the long run, the right way to solve that is by having, establishing a semantic model that understands what the business is, which is essentially a knowledge graph.

And then from that you can derive the rules, for the policies that you want to establish on your data have a very much of a policy based approach, that’s based on the business data itself. And I think we’re still away from having a standardized platform to enable that. And that’s what we really need.

You know, one of the challenges we have, and I think one of the reasons why there we’re not seeing as much success in governance and modern data stack as customers might want, is that all of these tools that are coming out don’t use the modern data stack as their database. And the reason they don’t is cause they can’t. Because doesn’t solve the problems for them.

So they all use some sort of operational database of their own. They take different approaches, but none of them inter operate. I think what we need is a common platform for a semantic model, that will become the basis for modern data stack governance. I believe that platform will be a relational knowledge graph.

It’s still early. But that’s where I think it’ll go. In the meantime, I hope we can get customers and get some answers out there if it helps to solve their problems.

Soma: True. Let’s move up the stack a little bit. You’ve seen like open AI, do some great work and in the last many years on large scale machine learning models. You’ve got all kinds of face recognition and other kinds of machine learning models that are coming up at scale.

What do you think this, the situation is today in terms of these machine learning models? Do you feel , the right amount of innovation is happening there? How do you think these models are going to be evolving over time? Any perspective on where we are with models and where we are going.

Bob: It’s very exciting, I have to say. I mean it, we’ve seen incredible progress in the last five years even. I would say it’s accelerating progress. I recently had a conversation with Xuedang Huang who runs the, all the artificial, the machine learning team at Microsoft and is working with open AI and working on foundation models it, and they’re doing a lot of work on combinatorial foundation models where they bring multiple different types of data together into one large model.

These foundation models, let’s talk about that for just a second. What they, sometimes they’re called large language models. Which is fine, but it only speaks for one domain, which is the language oriented ones, because some foundation models also apply to photos and other domains besides written language.

What they really are is world scale trained machine learning models that are trained on a corpus that approaches, global scale. And so you know, what they become essentially is incredible concentrators human knowledge. Into a model. Now the models are statistically driven.

They’re not perfect. There’s still advances that need to be done in these. But this idea of of using machine learning to take the expertise of a given domain in the world and distill it into a model is fairly incredible in my opinion.

I don’t, I can’t think of a domain that it won’t effect. Honestly, I think it affects everything. I think it affects every single element of everywhere we go. So I think that’s a very exciting, element of what’s happening. We see some incredible stuff. This DALL-E stuff is interesting. Now people are doing videos against it.

This model that, that came to OpenAI, that was one of the early rewrite code, writing models code X. You know, has done some amazing things. GitHub copilot has been an incredible success for Microsoft and is really doing dramatic things to improve developer productivity.

And, I’m seeing people use that for different purposes. Can take and improve it writing in and do things around running sequel as an example. And very powerful ideas can come from that. On the other end of the sort of spectrum I think that there’s an opportunity, where you’re trying to use artificial inte machine learning AI to improve the business workflow in a given organization where the domain is actually the terminology of that organization itself.

And it, it’s much smaller and it’s, there’s no global model to look at. There’s some local set of content you can look at. And in that case, the interesting thing is how do you inform the model more and more about the business? I think what we’re going to see is, user assisted, interactive training models appearing, which are really applications they look like, applications are working with a given domain and then leveraging machine learning to really improve business process.

And the company I’ve been involved in that’s been working on this, that I’m pretty excited about is Docugami our friend, Jean Paul of Microsoft is CEO. And they’re really focusing on taking business documents, and other high value business documents and inverting them and in turning them into data that can be processed by data systems.

And in order to do that, you really need to understand the semantics of that document. And that requires user assistance. And that’s why this interactive development is important. So that’s a real, a UI kind of experience in that. That’s two different ends of the spectrum in some senses but both examples are pretty interesting to me.

Soma: . Bob you heard me talk about this quite a bit in in the last many years. We we are absolutely convinced that every application that gets built today and moving forward is what we refer to as intelligent application. You like to call it data driven applications but it’s basically hey, taking a corpus of data that is a available to the application.

Being able to, build a continuous learning system using some machine learning models, and then continue to get better and better. Deliver a better service, you get more data. The process just, it creatively makes the application, the service get better. That’s the world we see happening today, and as we move forward. (A) do you agree with that viewpoint? And then (B), what are some of the core things that you think are happening that is going to drive the world, getting there?

Bob: If I didn’t agree with that viewpoint, I wouldn’t be continuing to do this work. I Let’s face it, that’s the reason I continue to do the work. Look, my, my whole purpose basically, in, in my business career has been to build infrastructure components that make people’s lives easier in business in one sense or another.

And data has been a huge part of that. But I I worked on Windows Server for a lot of years and I built System Center and helped with Visual Studio and all those sorts of things where we’re not databases, they were all, they’re all about making it easier for people to build.

Systems to help them more effective in their lives. And in particular in business, I’ve mostly focused on the business side, not the consumer side. It’s interesting because, because when we think about this world today, we’re seeing a world where machine learning is transforming. I think pretty much every application category I talked about, foundation models, essentially distilling the world’s knowledge into a model in some sense or another.

It’s not perfect. And even though I would say it, it’s it it is a great learn model. It might not it probably isn’t what one would call fully intelligent. It doesn’t reach the point of saying this is intelligent. However, it is an incredible source of information and can be used as a base as many things.

But there’s things that are missing machine learning and that are missing in a more full intelligence things. And in particular, that’s things like reasoning. The ability to to reason over something that says, is this because I know that this is something else. And these systems, these models have a very hard time with that today.

They have a very hard time with that. And they can, sometimes that’s when they go off into wacko things, it’s because they haven’t got the ability of adding reasoning to that. Now, I’m sure that’ll change. I mean, I’m very confident that we’ll see reasoning get added to these models in a variety of ways.

I think of this problem is what’s the infrastructure that would actually solve this problem in a more generalized sense? I mean, give somebody a Python compiler or a C compiler. In a hundred nodes they can do an awful lot. But, to me it’s what sort of infrastructure you can build, can you build to make these systems more available to a larger number of companies.

And that’s why I think it all consolidates ultimately into a relational database that will take the form of a knowledge graph. And I do think ultimately these things will come together that where you can take all of the components of intelligence, and let me to somewhat define that, is a program that can sense.

It can reason, it can plan, act, and adapt. And we see these components coming together in different systems today, in different parts of intelligence systems today. But the idea of them coming together in a cohesive platform, we’re still some distance away from that. And to some extent where I’m thinking, how does the world, lots smarter people than me are going to build these models that do these amazing things. But to me, I’d like to figure out how I can help facilitate the creation of platforms to enable all these things to be created cohesively by mere mortals. Not just the great, smartest minds on the planet.

Soma: That, that’s awesome, Bob. That’s great to hear. And I’m so glad you’re continuing to be fully focused on that mission because I think the world needs that kind of an infrastructure and the kinds of innovation that the infrastructure can provide. Like you say, that makes what I call building an intelligent application, something that every developer can do and not just the rocket scientist in the world kind of thing.

So that I’m a big believer in democratizing access to all the developers and so kudos to everybody who’s working on the infrastructure that’s going to enable that to happen. In a, I know that we are coming up on time before we wrap up. There is one thing that keeps coming up quite a bit.

When I talk to all these, what I call modern data companies, are startups, right? There are two things that they ask about “Hey, how should I think about open source?” and the other thing is, how should I think about in a product led growth, these are two things that every startup founder or CEO’s thinking about, Hey when does it make sense for me to think about open source?

When do I not think about this? When do I think about this? Particularly given your sort of, experience with a variety of sort of an proprietary and open source work and product led growth versus enterprise sales kind of thing. Are there any sort of parting words of wisdom that you want to share with the next generation entrepreneurs?

Bob: What I would say is, the biggest advantage to open source is the potential path to rapid adoption of particularly a developer focused technology. And the, the ability to get more end users, using it more, developers using it more quickly. It’s appropriate if the component runs in the infrastructure of the customer.

And it, I would say today it’s may even be essential. If you expect a component to run as a core integral part of an infrastructure, Kaftka is a good example of it, right? I Kaftka’s a perfect sort of example of something like this where that thing’s going to be sitting in, know all over the place inside customer’s infrastructure and they’re going to, they just want it to be open source for their ability to choose vendors and all sorts of stuff.

Those are good reasons to, to do open source. You know, the, the challenge with open source is that you essentially have to abandon it. To build to build a business. I’m not going to say it’s a rouse, but it’s a, it, it’s it’s a, you’ve got to do an extended focus at the very least, where you’ve got open source and then you have something that’s commercial because that’s the only way to monetize.

I In the old days, people monetized open source with services and that was Red Hat’s business model. That’s gone away with the cloud. There’s no, the cloud doesn’t help that. You can’t take what you just put in open source classically and just run it in the cloud because the cloud vendors can do the same thing and they have infinite distributions.

And their cogs are lower than you, so you’re screwed from day one. But if you differentiate and start with an open source integral component, then build on top of it. In some ways it can be very successful. There are, there are certainly examples of that. But again, what is these companies are going off and innovating in, in, in non-open source ways right now.

Soma: Bob, fantastic to chat with you as always, fun conversation and really appreciate you taking the time to be with us here and do this podcast. Thank you.

Bob: Great. It’s good to talk to you again, Soma. Thanks.

Coral: Thanks for joining us for this week’s episode of Founded & Funded, and don’t forget to check out our Intelligent Application Summit event page if you’re interested in these types of discussions. Thanks again for joining us and tune in a couple of weeks for our next episode of Founded & Funded with dbt Labs Founder and CEO Tristan Handy.

Fivetran CEO George Fraser on Data Integration and Connectors

 

Sabrina Wu, George Fraser, Data IntegrationThis week, Investor Sabrina Wu talks with Fivetran Co-founder and CEO George Fraser. Fivetran is fundamentally a data replication company. That’s how George explains it. But the company actually started out trying to solve a completely different problem when it was founded in 2012 and pivoted to strictly data integration in 2015 after multiple customers started asking for it. But in attacking that problem differently than it had ever been done before — by only focusing on replicating people’s data into the desired destination without getting sucked into any of the workflows that the user intended to do on the other side — they’ve come out as a leader in the space. Fivetran landed a $565 million series D last year and made two acquisitions, and it was named one of our top 40 Intelligent Applications. In this IA40 spotlight episode, Sabrina and George not only dive into the story behind Fivetran and how it has taken time and patience to get to where they are now, but Sabrina also gets some hot takes on the modern data stack, reverse ETL, query federation, and why Fivetran doesn’t open source. George also has some great advice about coming up with a company name, but you’ll have to listen to get it.

This transcript was automatically generated and edited for clarity.

Sabrina: Hi everybody, I’m Sabrina Wu, and I’m an investor at Madrona. I’m excited to be here today with Fivetran CEO and Co-founder of George Fraser. It should be no surprise that Tran was selected as a top 40 Intelligent Application in 2021. Intelligent applications leverage artificial intelligence and machine learning to continuously become better at solving business problems. However, the data ingestion, preparation, and management challenges that enable intelligent applications are extremely difficult to solve, which is why intelligent applications require enabling layers, such as Fivetran. Fivetran has built fully automated data connectors that enable businesses to extract, load, and transform data from different cloud storage and database sources into one central data storage system. I’m excited to dive into more of this with George today.

George, thanks so much for being here with us.

George: Very nice to be with you. That was a great overview. And applications, of course, our original bread and butter — things like Salesforce, NetSuite, stuff like that.

Sabrina: That’s a great transition. Let’s go back to the beginning —how did Fivetran go from being a data analysis tool to becoming the leading provider of automated data integration? Was there some light-bulb moment for you guys that made you want to pivot the business?

George: Well, it took about two years. Basically, we figured out one thing in those two years, which is that we would find product-market fit by cutting out everything except the data integration. So yes, we built a vertically integrated tool that had connectors as part of it, that stored data behind the scenes and Redshift, and that provided you a user interface to interact with that data. And, it was, it was not great. It was a vertically integrated BI tool built by three guys, and we worked hard at it, but it had a long way to go. What happened was we started to get this request from people we were talking to, which was, “Hey, I’ve got my own Redshift cluster that I’ve just set up,” and this was 2014, right? So, Redshift was this phenomenon in data warehousing at the time. It was the first data warehouse that was fast and cheap. It was available in the AWS console. And at the time, it was the fastest-growing product in AWS’s history. So, we were talking to all these people, and more and more started to say, “I’ve got my own Redshift cluster that I’ve just set up. It’s empty, and the problem I have is just getting data into it. And I like the sound of these connectors that you’ve built as part of this system. Can I just get those into my own Redshift cluster? And then I have my own plan of what I wanna do with the data.” And eventually, we said yes to one of them, and then another, and then another, and that became the company.

Sabrina: And was it obvious at the time that these automated connectors would be so valuable to customers? And obviously, the database world has exploded since then. I’m curious if the problem has been much bigger than you had initially anticipated?

George: It has indeed. It’s turned out to be more valuable and more widely popular than I think anyone anticipated. It’s funny because this is not a new problem. Data integration — taking data from a bunch of systems of record, whether they be databases or applications, and putting it into a central data warehouse — has been around since the 1980s, so it’s not a new problem. There have been tools for doing this for years and years. But the tools were not very good at the time — in my humble opinion. They didn’t really solve the problem. They were like a pile of building blocks upon which you would build your own integrations, and you were responsible for the correctness and reliability of those connections. If it broke, that was your fault. You had to figure out why. So, most people were just writing code to do data integration. I had actually done a lot of that at my previous job in a very different context in biotech. But this is a problem that had been around for a long time. It was everywhere. You talk to 10 software engineers, five of them have written some code to do data integration inside their company at some point. There had been companies founded trying to solve this problem. None of them had ever really taken off. They were a fraction of the size of the data warehousing companies, even though logically, both always have to exist in every account. So why was this such small potatoes? Nobody had ever really found a good solution to this problem.

And we completely ignored the way it had been done before. There was a lot of conventional wisdom about the right way to do data integration, and we just totally ignored it. And we said, Okay, what seems like the right way to us? We should just replicate everything. You know, the data starts in the place that it lives. Replicate everything into a normalized schema. The destination is a database, so people can do whatever they want with it from there. As long as you get it all there in a correct replica, you’ve solved a big chunk of the problem. And the nice thing about that is it’s like a bounded problem. You don’t get sucked into all the workflows that the user intends to do on the other side. What is your definition of revenue? You don’t get pulled into that. You’re like, “Look, I’m going to replicate the amount field from the opportunity table in Salesforce, and I’m going to do that correctly — that’s my job. How that maps to your revenue recognition roles, that’s for you to figure out.” So, there was a nice, clear separation of concerns between what our job was and then the problems that remained to be solved by the user. And the part of the problem that we were taking on was a big chunk of the problem. It’s not the whole problem. And that was kind of the conventional wisdom we were walking away from, that you had to tackle those downstream elements. We said, “No, we don’t. We’re going to solve the replication portion of this, which is actually a pretty big chunk of the problem. That’s where we’re going to focus our efforts — correct replication. And the very first connector was for Salesforce, and then we did Zendesk and Stripe, and then we started doing databases and a bunch of other things. But we always took that philosophy like Fivetran is fundamentally a replication tool, and you are going to work out the semantics of that data in the destination after it arrives.

Sabrina: I think one of the reasons customers really love Fivetran is because the product itself is very simple to use, but in reality, you are solving a very complicated and difficult problem — something that is very cumbersome and tedious … an engineer spent a lot of time building this. You started to talk about it, but I’d love to understand Fivetran’s approach to ELT. So, extract, load, transform, which shifts, as you were saying, the transform step to the end of the process. Can you talk a bit about why Fivetran created this new approach and the evolution of ETL — extract, transform, load to ELT — extract, load, transform?

George: It’s interesting. You know, ELT is a little bit of a lie. It’s a lie that reveals an essential truth. But the reality is that Fivetran does a ton of transformation. So, it’s really ETLT. The way the data comes out of the source, people always imagine what the source gives us is like a nice little list of inserts, updates and deletes, and then we just take it over to the destination and load it in. If it worked like that, we’d have lots of good competitors by now, and we don’t. So, the reality is the sources are sort of crazy in what they give you, so we have to develop these extremely convoluted rules for reconstructing the set of what has changed from the source. And it’s different for every source. But, if you make your goal to produce a correct replica, then that problem is the same for every user. So it’s very complicated. There’s a ton of complicated transformation we’re doing under the hood, but it’s always the same, whether it’s your Stripe account or someone else’s Stripe account or whatever the case may be. Stripe is actually not as hard as some of the other ones. That’s not a great example. Stripe gives you the data in a pretty good format, but if it’s your HANA database versus someone else’s HANA database, the rules of stitching together changes are going to be the same. They’re very complicated, but they’re always the same. And so, we do that level of transformation, but then we abdicate this other job, of like, how do you map all this data onto the concepts of your business. There’s another layer of transformation that is different for every customer. And this is the problem we very intentionally chose not to tackle. We said, “You’ve got to solve that after we deliver the data, and there are multiple ways to solve that problem.” But by making this choice, it sort of gives us a problem to solve and the customer a problem to solve. And it’s a very nice, clean handoff. And so you get that very simple user experience. Fivetran is doing very complicated things under the hood, but you don’t need to be involved in that. You don’t need to know how that works because it’s fundamentally the same for every user, so we can just automate it behind the scenes.

Sabrina: That’s a good point. And I think that what you’re talking about here is also Fivetran’s big investments in change data capture, so this whole process of CDC as well as replicating and allowing customers to move really large amounts of volume with very low impact. I know Fivetran recently also acquired HVR to further strengthen this. And so, I’d love to understand why data replication is increasingly important for customers.

George: Well, I don’t know if data replication is increasingly important. It’s just always been very important. Maybe for smaller companies. You know, one thing we have noticed is that historically data warehouses were something that were only really created by the largest companies. And we have an astonishing number of like 50-person and under companies building data warehouses, which historically that was not really a thing. But the problem has become so much easier at every layer of the stack that it’s become feasible for much smaller companies to pull this off. Then they can realize the benefits of knowing what’s going on in your business, which is the primary benefit of a good data warehouse.

Sabrina: When you think about CDC as a whole — why is this problem so difficult to solve?

George: It’s just a maze of incidental complexity. There’s nothing really fundamentally hard about it in the way that building a globally distributed transactional database is just like a very fundamentally hard problem, and people write Ph.D. thesis about it. Nobody writes a Ph.D. thesis about data integration. It’s just a huge forest of incidental complexity, and the way we’ve been able to tackle it is with a lot of grit, a lot of hard work, and a lot of time. If you look at the history of Fivetran, we talked about the original pivot to just data integration in 2015, but then for the rest of 2015 and a lot of 2016, we didn’t grow that fast because it still didn’t work that well. Part of it just took time to figure out all these little rules that create that easy user experience where you just push the button, and your data appears and keeps itself up to date, and the details of how that happened are unknown to you. So, a lot of it has just been time. As the years have gone by, we have studied ourselves, and we have started to learn how to solve some of these problems more systematically and, in fact, automate the process of developing connectors internally at Fivetran. And you will notice if you look at our release notes that the rate of new connectors being released in the last couple of quarters has increased dramatically. Our CTO Meel Velliste and a small group of engineers spent a bunch of time last year really studying basically all of these quirks that we had observed in every connector we had ever built. And they sort of mapped it out and determined that data sources do a lot of crazy things, but there is a finite number of crazy things. You can kind of catalog them all — all the weird stuff that we’ve encountered over the years. And then they developed a new way of building connectors, like a configuration-driven connector where you just have to describe, within this vocabulary, how any particular data source works. And you don’t have to implement all the procedural rules to correctly deal with all of those quirks. And so that’s a pretty cool thing — it took years to figure that out and to do that right. But you’re seeing the benefits of that now with the acceleration of how many new connectors we’re able to build each month.

And we do hope to get to the point in the next couple of years where we have thousands of connectors. Cause that’s what we ultimately need to have. There are so many data sources out there. And it is extremely valuable to customers, especially larger customers, if Fivetran can cover all their data sources — if they can say, “I can adopt Fivetran, and then my data integration problem is solved.” Whatever the source is, Fivetran’s going to have a connector to it.

Sabrina: That’s a really good point. And I’m curious — you also have decided not to open source, to my understanding, any of your connectors.

George: We never seriously considered open sourcing our connectors. The way we looked at it is our users are not software engineers. They’re analysts and data engineers. and most of them aren’t data engineers, by the way. So they don’t really have the ability or the desire to contribute to these connectors. Open source works really well when your users are software engineers who have the ability and the interest in contributing back to things like Postgres, for example, or Linux. For us, that’s mostly not the case. And the other problem is — when people build connectors for themselves, they tend to take shortcuts that work for their particular situation but won’t work for others. They rely on behaviors of how they use the underlying system. Like, oh, you know, when I update rows in this table, I always update this column named “updated at,” so I can use that in order to get changes from that table. Well, that might be true for you. But it’s not true for others. And so that trick is not going to work. And so, for all these reasons, we didn’t really see a community of contributors being a good way to get high-quality connectors. And I think that hypothesis has mostly been born out over the last few years. Fivetran continues to have a big advantage in terms of the quality of our connectors, by which I mean, are they working? And is the data in the destination actually a correct copy of the source? That is really the hardest part.

Sabrina: Got it. In my mind, Fivetran targets a lot of people and adds a lot of value to multiple people in the organization. So it could be the data engineer, the data analyst, the business analyst, right? And so I’m just curious, how are you building the product with these people in mind? You touched on it a little bit there, but I’m just curious if there are certain use cases where it’s better suited for collecting and analyzing data. How do you think about this from a data analysis versus ML workloads?

George: You know, it’s funny, uh, the answer to that is it really doesn’t actually matter to us. This is something that was al always very frustrating to VCs and often to salespeople — this is not really a persona-driven problem or product. We deliver data. The data needs to be correct. It needs to be up to date. And you can do a lot of different things with that data. And our users do a lot of different things with that data, and oftentimes, the proximate user of Fivetran, like the person who we’re talking to at the company, they don’t even know what all people are doing with this data. There’s this great mantra, “Data attracts workloads.” You know, once you have a good central store of all your company’s data, people will just come up with all kinds of stuff to do with it.

Sabrina: That’s funny. I think people are always kind of asking who’s the right persona. Who’s the right user, right? But um, in reality, when you’re thinking about some of the plumbing work that goes in that Fivetran is working on, it really is impactful to the whole organization. Now I’d love to kind of shift gears a little bit and get your thoughts on the modern data stack. In today’s world, customers are really patching together a lot of different best-in-bread tools and solutions to host, store, transform, and eventually analyze and understand the data. That’s the end goal that customers have. And so, as the number of tools has proliferated, there’s been more complexity than ever before. And I’m just curious how does Fivetran continue to differentiate in a very competitive and complicated data stack?

George: Yeah. You know, people make these like market maps, and they put all these logos on them. By the way, if you look closely at those market maps, the same logos will appear multiple times in different categories. So it makes it look a lot more complicated than it is. And the other thing is, you don’t have to use all these tools. I mean, the first few Fivetran customers, most of them, used Redshift, Fivetran, and Looker. Which was at that time a relatively new BI tool, but it had this key strength, which was this modeling layer called LookML, which allowed you to do that post-Fivetran transformation of data that we required you to do because we had abdicated that job. And LookML has largely now been replaced in that role by dbt, which just does that. But the point I’m making is that stack is still available. You can still buy that today. It still works just as well as it ever did. You don’t actually have to adopt all of these other things. I don’t think it really has gotten more complicated. I actually think it’s gotten quite a bit simpler. You know, if you look at people who are running Fivetran, a good cloud data warehouse, like Snowflake, Big Query, Redshift, Databricks, and dbt to manage their transformations, life is pretty good for them. A small number of people can manage a lot of data and a lot of complexity with that set of tools, and it’s a pretty good stack to adopt.

Sabrina: Yeah, I tend to agree with that. Do you think that there’s going to be more consolidation here in the years to come?

George: There’s always consolidation happening. So, the short answer is yes. And how things consolidate. What are the key strategic workflows that they consolidate around is always a big question. I think we’ve seen some of that happen. As you mentioned earlier, Fivetran acquired HVR. And the reason for that was very simple. HVR was really good at replicating the biggest, most difficult enterprise databases at low latency and the highest volumes. And Fivetran was really good at everything else. And so, it was a perfect marriage. And for users, now you have one vendor that can do both. And we’ll probably see other things like that. It’s something we do think about a decent amount at Fivetran — how much are acquisitions going to be a part of our future … probably a medium amount. So yeah, I do think there will be consolidation. And I do think that Fivetran is going to be one of those key poles that consolidation happens around. Because we’re at the top of the funnel, right? We’re getting the data from everywhere. We control the rules of how the schemas work and how the updates happen, and when things happen. And for that reason, there are a lot of other secondary workflows that make sense to pull into that ecosystem.

Sabrina: At what point would you consider acquiring a company versus maybe just developing stronger partnerships with those companies? Integrating more into the workflow?

George: We’ve only done it a couple of times. You know, there was HVR, and there was a much smaller company called Teleport, which we acquired for an algorithm also for replicating databases and very different circumstances. We are mostly a partnership-driven company. Always have been. Our second customer was a partner referral, so most of the time, the answer is partnerships. And you see that right now with our approach to metadata. Fivetran has all this metadata about the data that’s sitting in your data warehouse: where did it come from? When was it last updated? And we are working to expose all that data. The only times when acquisitions have come into the picture is when, you know, it’s something that’s in that core focus that we felt we were not good at and needed to get better at, and it was going take a long time to do it ourselves. But, as I said earlier, we’ve only done that twice. So how that philosophy will evolve in the future, I can’t say.

Sabrina: Well, it might be a good time to be on the offensive and get some acquisitions under your guys’ belt, given a lot of what’s going on in the macro environment today. But I think that your point about partnerships is really, really important. I think Fivetran is one of the companies that has partnerships with almost all of the key players in the modern data stack ecosystem, Snowflake, as you mentioned, dbt, Collibra, Hightouch, and some of the governance players now with the release of Metadata API. And so, I’m just curious, you know, how have you been able to maintain these partnerships? And it seems very core to the Fivetran strategy, and I would just love to touch a little bit more upon this partnership strategy that you guys have built over the years.

George: Yeah, it’s, well, we have a partnerships team that works very hard. Part of it is just intrinsic to what we do. We do something that all the partners need. None of these tools do anything without data in them, and that’s what Fivetran does — it feeds the data. There is an element of like, we’ve become partner driven just because we do something that all these partners really care about and need us to do. We’ve always tried to just be very straightforward in our strategy and in the way we communicate that to partners.

You know, like I said, the core of Fivetran is connectors and always will be— we’re fundamentally a data movement company, and that’s not going to change. So, we’re very predictable in terms of what we’re going to do next. And then in the details of that, we’re very transparent with our partners about like, “Hey, this is what’s happening next quarter. This is what we think is going to happen next year,” and I think that helps.

Sabrina: There have been some of these newer concepts thrown around. As I’m sure you know, reverse ETL emerged a couple of years ago, and so initially, data warehouses were introduced to essentially eliminate the data silos, right? But for many companies, data warehouses have now become a data silo, you could argue. And so, there’s this concept in the modern data stack known as reverse ETL, which aims to remove the barriers between the data warehouse and all the end applications such that teams can operationalize data into the systems themselves. What is your thinking around reverse ETL?

George: Reverse ETL is such a funny name — it’s a good name because you immediately know what it is. But then, after you think about it for 15 seconds, you’re like, wait, this is also ETL. It’s not reversed in any way. It was originally a Fivetran feature request. Our very first customer asked us to do that within weeks of going to production. And they were not the only ones. And the problem was forwards ETL is hard enough. We had to just focus on that. And we talked very openly about it with other players in the ecosystem and with friends, including the founders of Census, actually. I’m not taking credit or anything, but we did tell them about how we kept getting this request before they started Census, and that was probably one of many pieces of evidence that contributed to their decision to attack that problem. So, it’s a need that is out there. It hasn’t gotten as big as we have just yet, and time will tell how big the demand for that actually is. I think that’s the key question, is this idea of using the data warehouse as a data bus that you can then send data onward to other places. It’s definitely a thing people are doing. Is that something everyone is going to do in a couple of years or is that going to be something some people do? Time will tell.

Sabrina: Yeah. Census and Hightouch, right? Those are the two going after it in the reverse ETL world. There are also some newer approaches around query federation that suggest that engineers and developers may no longer need ETL altogether because you can query data regardless of where it lives. So, you’re removing this step of ETL altogether. Do you think ETL will continue in light of the federation trend?

George: What trend? Query federation has been around for decades. And it has been a stupid idea the entire time. Query federation makes for an incredible demo. You have live access to data instantly. You don’t have to wait for historical backfills or anything. And as soon as you go into production, it will fall over because you will discover that the data sources are simply too slow to give you data fast enough to support realistic queries. There are these little optimizations you can do, like predicate push down, that will sometimes speed it up. But as soon as you go to production, you’re going to discover you have a lot of queries that are not subject to those optimizations, and you have to move the data. There is an exception, which is if you’re reading data from object storage like S3, that actually does have enough bandwidth to make query federation work. But other than that, it’s hopeless. You can’t read the data fast enough to support a real data warehouse workload using query federation. It’s like a beautiful dream. And I will say that in some ways, you know what Fivetran did, where we said we’re going to move the data, but we’re going to treat this as a replication problem. In many ways, we are creating the same user experience as query federation. You know, you look at your data warehouse, and you just see exactly the same schema as exists in all the data sources, except the way it is actually implemented is using data movement because it’s impossible to do anything else. So those are my thoughts on query federation.

Sabrina: I love the hot takes. It’s always great to hear, you know, differing perspectives around what’s “in” and what’s not, and I’m curious if there’s any other, you know, approaches that keep you up at night or anything else that has been a concern — something that you are just thinking through as Fivetran. Like, “Hey, there’s all these different approaches now to moving the data to being able to analyze that data.”

George: Yeah, I think that there are two limitations of, let’s call it, the Fivetran-centered data stack. And they’re really limitations of the destinations of the data warehouses we deliver to, and opportunities for those data warehouses to fix these limitations. And they’re working on it. One is latency. It’s pretty hard to do any better than 15-minute latency the way things currently work. And there is a set of use cases where that’s not good enough, but it is really hard right now to do better. So the world needs a low latency data warehouse, and I think that will happen. I think the great data warehouses that exist today are going to make progress on this. They are making progress on this. And we may see another player emerge where the primary value proposition is they just have much lower latency. Then the other problem is, you know, the usage of the data warehouse as a data bus where you centralize all this data in your data warehouse, but then not everyone wants to run SQL queries. Some people want to just pull the data out and send it on to some other system that does something with it, and it’s just very costly to do that by running SQL queries against a data warehouse. And so, we’re seeing a couple of different ideas emerge about how to solve that problem. So, some people try to adopt something like Kafka as a central data bus to solve this. Now you have a whole different set of problems. And I think that’s unworkable for very complicated reasons that have to do with the way the data comes out of the sources. People don’t realize the sources produce very unclean data. And if you’re not sending the data to a relational database that supports updates and things like that, the data you’re going to be looking at is going to be very ugly.

That’s one vector people are pushing on to try to attack this problem. Another vector is like data lakes. The problem with data lakes is that the latency is even worse. Big Query has done something interesting here. They have this thing called the Big Query Storage API, where you can, basically cheaply, directly read data out of the underlying storage layer of Big Query. So, if you want to do something that isn’t a SQL query with the data, you can use Big Query as a data bus. But no one is using this. That’s kind of a big problem that I’m thinking a lot about right now — how do we attack those twin problems of latency, and how do I support workflows other than SQL queries at reasonable cost and performance none of the solutions that exist right now look great.

Sabrina: Yeah, I like how you frame these two problems. I think they’re definitely key pain points that we’re also seeing, and I think as analytics are moving more towards the edge, especially for use cases around things like streaming and data apps, and as existing workloads grow, it’ll be interesting to really see how some of these new technologies play out in the fullness of time.

So just to wrap up here a little bit. It’s really impressive how fast Fivetran has grown over the last two years, and as you said before, it hasn’t always been an easy journey. It took two years of solving a different problem before pivoting, and then it took some time to get some of those first customers. I’d love it if you could share some of your key learnings for founders.

George: It’s funny, once it was passed a hundred people, it looked the same the whole time. It helped that our growth was extremely steady over the last, you know, five years. So, if you’re growing, you know, 100% a year, that’s hard. But it’s really hard if you grow 200% one year and then 20% the next. It helps if things are steady. Again, that’s something that is as much a property of the market as your company, so you don’t exactly have control over that. So, it’s not maybe very actionable advice. But that has definitely helped. Another thing that has helped is a large percentage of the leaders of the company are people who have been here for many years. We’ve had a very stable leadership team. I think a lot of startups will replace their key leaders of all the key functions every time the company gets twice as big. And if you have to do that, you have to do that. But, through a mix of luck, of, I guess, hiring the right people early, and of really giving people a chance to learn and improve themselves, we’ve been able to maintain a more stable leadership team than I think most startups who have gone through such rapid growth. And that has some big benefits in terms of like controlling the amount of drama as you grow, you know, having these people who have been here for a long time, who have seen it grow up, they can manage certain categories of problems that are harder when it’s a revolving door.

Sabrina: Okay, so I wanted to wrap today with a round of lightning questions. So we asked this to all of our guests on the intelligent applications podcast series, and so — aside from your own, what startup company are you most excited about in the intelligent application space and why?

George: Probably Materialize. I should disclose that I am a very small angel investor in Materialize. The reason that they are so exciting is that they have started with the hardest problem — the hardest unsolved problem, let’s say, in database management systems, which is materialized views. And then worked outward from there. Whereas everyone else starts with all the things that you already know how to do, and then they try to do materialized views at the end, and they never are able to make a very good implementation. If you can solve that problem, there are some really dramatic implications.

Sabrina: Outside of enabling and applying artificial intelligence to solve real-world challenges, what do you believe will be the greatest source of technological disruption in innovation over the next five years?

George: I think that artificial intelligence is incredibly significant. I have a car that basically drives itself, a Tesla, and it’s amazing. But I don’t think it’s going to be a horizontal technology that changes every space. I think what people do with data is mostly going to be the same and is not going to be impacted by AI in the context of businesses managing their data. I think, actually, it’s going to have a lot less impact than people think.

Sabrina: And what is the most important lesson, likely from something you wish you did better, that you have learned over your startup journey?

George: When we started Fivetran, we were too early for what we would ultimately do, and we solved that problem by waiting, so timing is incredibly important, and you don’t control it. That is a big challenge for every startup. Are you too early, or are you too late? And if so, what are you going to do about it?

Sabrina: And then last, just fun question, why the company name — Fivetran — maybe it’s a play on words to Fourtran, but just curious why, why the company name?

George: Fivetran is a pun on Fortran. That goes all the way back to the original, original idea for Fivetran, which did not last very long at all, which was to make a vertically integrated data analysis tool for scientists. You know, way back, Fortran was how most scientists would write their data analysis code. So, it was a short-lived idea, but that’s where the name comes from. And, you know, we changed the idea and never changed the name, but it has turned out to be a very good name. It is reasonably memorable, and it is unique. If someone types Fivetran into Google, then they’re looking for us. And that has allowed us to measure the growth and awareness of our product using Google Trends, which has been incredibly helpful. And so, I always recommend it to founders. If you’re doing a B2B company where the name maybe isn’t that important, make sure you have something that registers a zero in Google Trends.

Sabrina: Yeah, it’s incredibly difficult now these days with all the startup companies — people have gotten pretty unique in the company name. And it’s challenging when you pick a name that’s an adjective or noun or something that is already a word. I’ve seen some interesting ones.

George: You want to know something really funny, and not a lot of people know this, but in the old days of Y Combinator, when Paul Graham was still there. Paula Graham was the master of coming up with names. And anytime a company had a name that was a problem, and they couldn’t get the domain they needed, or they discovered it conflicted with someone else’s name, they would send them to him. And then they would sit there in his office and figure out a new name. And he was so good at it. It’s like his secret talent. It was not needed for us, but there were some other companies in our batch that were marched off to go figure out a new name with PG.

Sabrina: That’s awesome. Coming up with that company name is one of the most challenging things. Well, thanks George for being with us here today. It’s been a lot of fun, and I appreciate you joining us and spending some time with us today.

George: Nice to be with you.

Coral: Thank you for listening to this week’s IA40 Spotlight episode of Founded & Funded. To learn more about Fivetran, visit Fivetran.com. That’s F-I-V-E-T-R-A-N.com. Thank you again for listening, and tune in in a couple of weeks for our next episode of Founded & Funded with Snowflake’s Bob Muglia.

Stack Co-Founder Will Rush on Teen Crypto Investing

This week, Investor Aseem Datar is talking with Will Rush, co-founder and CEO of Stack, a teen crypto platform to educate a young crypto-curious generation — and their parents — about responsible investing. After working at a company, building a banking app for teens, Will took his decade-long experience in securities and finance and applied it to crypto and Web3. He saw the excitement and curiosity that teens had for crypto and knew he could apply his experience to create a world of responsible teen crypto investing.

Stack has managed to balance education and access for both parents and their teens in a way that the younger generation is actually appreciating and connecting with. And Will is maniacally focused on the education portion. Not only because he is a soon-to-be parent himself, but because in what he calls the Wild West of Web3 and crypto, he says somebody needs to be the good guy. To help continue that project, Stack just landed $2.7 million in funding to continue developing its platform. And Will’s advice for every founder — “You need to have slime on your face” — a reference most of us millennials will understand, but you’ll have to listen to see how Double Dare relates to launching a startup.

This transcript was automatically generated and edited for clarity.

Aseem: Hi, everybody. My name is Aseem Datar, I’m a partner at Madrona Ventures, and I’m excited to have Will Rush, the CEO of TryStack.io. Will, welcome to the show, and I know that congratulations are in order.

Will: Thanks so much for having me, Aseem. I’m really excited to be here. It’s been amazing working with you guys and the Madrona Venture Labs team as well. We’re very fortunate to have you in our corner.

Aseem: I’m excited to talk a little bit more about Stack and make people aware of what you’re building. I’m very excited, and it’s amazing to partner with founders like yourselves who have a big, bold vision. But before we get into Stack, I wanted to understand a little bit about your background and where you are coming from. Tell us a little bit about your story.

Will: you know, I’ve been in securities and finance at some level for over a decade. In the early part of my career, I worked with companies like Charles Schwab, E-Trade, TD Ameritrade, and a lot of the old brokerages and traditional finance guard. And then I reached that point in my career that I think a lot of people do where I’d been doing one thing for a long time, and I wanted to lean a little bit more into the early side of things and startups. So, I went back to school. I got a master’s degree up here at UW. And while I was getting my master’s degree, I worked part-time at another venture firm now called Fuse Venture Partners — at the time, it was still Ignition Partners. And that was a really fun company and environment to work with — and all of their portfolio companies and founders were a great way to get my feet wet with this startup world. And then, at some point, I met who would become one of my favorite mentors ever in my professional life, which was Eddie Behringer. He was coming off of a recent win with Snap! Raise, which had just done its private equity exit. And he just started Copper Banking — I think they had three or four team members at that point. It was himself and his co-founder from Snap! Raise and one or two others. But he was also thinking, at that time, what it would be like to build a brokerage and stock product for teenagers. The thesis of Copper was to build the finance and banking app for teenagers that was built for them instead of their parents or somebody else. And so, it was really fun. It was a great product to be a part of, and I learned so much working directly under him. And then eventually discovered this thesis for Stack.

Aseem: You know, this leads us to the obvious next question, which is the inception of the idea around Stack and really trying to understand what patterns you saw while at Copper while being at the VC firm. I want to dig deep into understanding how that idea came to you. What are the macros in the world that you saw? I want to dig into “your why,” as they call it. Why did you build Stack?

Will: Oh, man. I mean, I think it really started from understanding the last 10 years in finance and FinTech. We saw companies like Robinhood outside of the 2008 financial crisis do an amazing job of democratizing access. And they did that by allowing you to trade $1 of any stock you wanted with fractional shares and do it commission free. And so, of course, that introduced a lot of new people to the stock market. But with democratized access, I think there was a huge lag in education. And so, being at Copper, being able to impact young people who were at the very start of their financial journey, the impact that you can make and the habits that people form at that age, you know, they absorb things like a sponge, and it was cool to see and be a part of those stories. While I was at Copper and I was researching our stock product, it became abundantly clear to me just through some of the AB tests that we would do where we would literally change one word “stock” to “crypto,” and all of a sudden, our engagement on things like Instagram would just fly off the radar. And so, I think there was a story there. There was a story about this zeitgeist behind crypto, this excitement, this curiosity with the youngest generation. And could you be the good guy in that world?

That was really like, where the thesis for Stack started and how we got to do what we’re doing now. I think there’s so much to unpack, which is how you educate successfully. I think a lot of parents hear teen crypto, and their first thought is, “Whoa! My teen doesn’t even have a stock account.” Or, ” I don’t know if I want to get my teenager involved in Web3 or crypto.” But the reality is that a lot of the teenagers we’ve found are hacking their way into crypto. They’re using their parent’s driver’s licenses to get a Coinbase account. They’re going over the law in a lot of ways to do this. And if we could create a bumper lane, if you will, that to us was a really compelling solution.

Aseem: Three things that you said stood out for me. One is this whole notion of democratizing access, right? If you go back a few decades, not everybody was trading in securities. Not everybody understood what it meant to be, for lack of a better term, owner in a company and bet on the growth of that company or that enterprise. And that’s changed over, I would say, even the past couple of decades. I think the second thing that you really mentioned, which was powerful, was this wave of learning and educated investing and guidance. And in the world of crypto, I think it’s more true than ever that people are just trying to figure this out. And especially teens, who want to latch onto this wave, but at the same time, kind of don’t know where to go. They’re discovering it as most people are. It’s fascinating that you are the on-ramp or the guardrail like you mentioned, to educated investing. Because this is going to happen with or without, I would say guides or mentors. And the third thing that you mentioned, which is fascinating to me, is even parents are learning. This is where I love the theory and the thesis behind what you guys are building, which is educated access, educated investing, and providing a friction-free on ramp to growth. So, tell us a little about what’s on offer today with Stack and where people can go to try it out.

Will: Well said, on so many fronts, there is this huge opportunity with what we’re building to, I think, tie two wants of our two users. There’s the parent user, and the want is education. The other user is a teenager, and the want is access. And one is hacking their way, and the parent who wants both themselves and their teenager to be educated really doesn’t have a lot of places to go right now. Because there really just isn’t that much education in crypto in general. We’re really living on the edge of the most cutting-edge area of the financial sector. The offering that we have now — our app is live on Google Play — it is set up so that a teenager opens a UTMA account, which is the Uniform Transfer to Minors Act. That requires a parent to be a cosigner on the account. And it allows teenagers to have legal access because if they access Coinbase or Robinhood or any of those other platforms that are out there right now, they’re actually living above the wall, meaning they only allow 18 or older users. But we allow legal access for teens. And then there are a lot of other really cool things about the app. So, for one, a parent can set approval limits. That means they can say, “I want to review everything,” “I want to review trades that are above $50 or a hundred dollars,” or “I want to give my teen the keys, and I trust them to go make good decisions.”

The second thing that we do a lot of is, like we’ve talked about a lot — education. How do you balance the education element and teen who is on TikTok and a lot of trends that they see are evolving in a matter of minutes or hours. How do you get their attention? How do you actually win in this education world that obviously very few people in finance have been successful with? And I think the way that we have chosen to win and really what we’ve learned about teenagers over the last 18 months is — it has to be bite size. It has to be tied to just-in-time learning. So that means, if you’re about to buy Bitcoin for the first time, you want to know about Bitcoin right then, and how can we win that moment? And then there’s the third piece of it that has proven successful in a few other startups, which is the learn-to-earn model. And that means you actually get benefits, and for us, you get fractional amounts of crypto if you teach yourself about it.

To a parent user, I think that third element is really important because we are doubling down on education from day one — by saying, we will give you free benefits, rewards, whatever you want to call it, via crypto, just for educating yourselves. There is a new offering that we’re going to release later this fall that I think will be by far the most exciting offering that we have to date. And it really plays on both a parent wanting education and a teen wanting access, and really how to balance the two of those as thoughtfully as possible. And also from a lot of the early engagement statistics that we’ve seen from our user base on our app.

Aseem: I think one of the things that stands out for me is the UTMA license you guys were able to get, and that’s really the foundation of how you’re approaching responsible investing. That’s awesome because it’s all about providing that guided education path for somebody to take control of their own destiny in a responsible way. I was curious what are you hearing from the teens — or, as I call it, the entrepreneurial generation — what are you hearing as they’re using your platform?

Will: We’ve learned an immense amount from teens working with them. I mean, we literally work side by side with them and in a lot of capacities — we’ve physically shown up to high schools. We’ve physically sponsored events. We’ve digitally sponsored events. What they’ve taught us over that period is you’re only going to command a very short period of time, and that includes education. That includes even if you reward them through something. And so, how can you win small moments that have a big impact? So, we’ve built that into our education content. We expect our team users to be spending an hour between 30 seconds and 90 seconds on the educational module of our app. But if we can do that consistently a few days a week or even every day of the week, I think that’s where you win.

The second thing that we’ve learned from teens is, in this world of technology, they’re highly capable. And I think many products built for kids and teens infantilize them a little bit, and this generation is different. As you said, they’re the entrepreneurial generation. They identify as entrepreneurs. A lot of them have side hustles. High school is different, and we need to recognize that, and we need to lean into that because they’re highly capable. And if you give them the right tools and the right guardrails, I think they’ll shock the heck out of you with what they’re capable of doing.

Aseem: Which is amazing. I think there’s so much to learn with this new way of consuming content, consuming education. You’re kind of on the bleeding edge of constant evolution from the product side of things. Shifting gears a little bit Will, tell us a little bit about the recent economic changes and the impacts that the markets are having. Have you seen any changes in terms of how people are interacting with Stack, and how they’re thinking about it? I mean, you guys just launched, but I was curious about how that’s playing into the minds of your customer?

Will: Well, I’ll say this, A) we’re incredibly fortunate to have launched. And we did because we launched after the down cycle. If you believe in the thesis that crypto is going to go back up, which I think, you know, anybody that’s getting involved in it likely does. There’s a good chance that our user base is getting in closer to the bottom of the market. I mean, I look at somebody like Robinhood, that was born in the shadow of 2008. And what Robinhood did well was they built with a diehard user base. And then, when the market started to catch fire again, that’s when you saw their user base take off. Not saying that we’re waiting around for the market to catch fire again. I think there will be another one of those natural upswing moments when there’s a lot of curiosity, crypto’s back in the news all the time, and people are talking about new coins, and they’re talking about Bitcoin or Ethereum and everything else. But in between now and then, we are really living and breathing the customers that want to be doing crypto right now. And they want to do crypto for, I think, a few reasons. Number one, they know that not only is there obviously crypto the investing product, but there’s the blockchain, and there’s the technology behind crypto. And there are so many other use cases, so many other industries and companies that are building on the blockchain as a technology that can be learned on our platform and can be learned through crypto. Because crypto is the currency of this technology. So, I think we’re really leaning into that. That user base tends to be gamers or highly tech-oriented. They certainly have a certain customer profile that we found over the past few months, but that’s really kind of where we’re living and breathing right now.

Aseem: Right. That’s so awesome on so many levels. Wanted to ask you a little bit more about the product itself. So, what can teens do with Stack today that no other platform offers them?

Will: So, number one is just legal and safe access for teens and their parents. I mean, we are one of the very few investing platforms — even if you open this up to stock products as well, it’s a small niche game, the under-18 finance and mobile app game. And we were the first ones to open in this under-18 arena specific to crypto and Web3. Number two, something that you get out of it just indirectly through a UTMA account is you get tax advantages. You can earn up to $2,300 tax-free on our platform because you have a UTMA account. Whereas you go earn on Coinbase under your parent’s account, and you’re going to get charged 30% or whatever their tax rate is. And then lastly, it goes down to a product built specifically for teen crypto rather than a Coinbase or a Robinhood. What we think about there is we limit the coins on our platform. We do a lot of vetting of what currencies are on there. We vet based on market capitalization, we vet based on trading volume, we vet based on a lot of characteristics and nefarious activity. And so, we’re tracking so that the top-of-the-funnel decisions we make about our product and app is making it safer to trade in. And then lastly, we also don’t do crypto on and off ramps, and I think that is an essential decision for us. Crypto on and off ramps is where all the fraud and scams happen. It is somebody tricking you into or hacking your wallet password and transferring assets on an immutable ledger that you’ll never get back. So just by disabling that, I mean, there’s no reason for our users to be sending crypto assets off platform right now in our use cases. And so, we can just guarantee safety there. I think that’s obviously important.

Aseem: I mean, I remember the days when, when you first got a bank account, when you first got a credit card, and like the world opened up. Right. And with that comes a lot of nefarious activity and risks. What’s amazing, as I’ve learned working with you, is you guys are trying to minimize all risk that there is out there from a fraudulent activity perspective. Now, yes, there’s always risk in trading, but at the same time, you’re giving them the tools and the platform to do it in a responsible manner.

Will: Totally. It is the Wild West, but it’s in need of a good guy. And we hope to be one of those good guys that can create a safe place for you to trade. And for you to learn.

Aseem: So, shifting gears a little bit, tell us a little bit about how you’re reaching teens. I mean, so much of what teens do is driven by social proof, right? I mean, yeah, if my friends do it, then I’m going to latch onto it. I’m going to learn how to do it. How are you approaching the community angle of your focus — is there a community angle?

Will: Oh my gosh. It is essential it’s everything that we do. We have an ambassador program, which you’ll see right on our website. And that ambassador program now has a little over 200, 250 teens representing 200, 250 high schools. Most often, they are the president of their finance or investing club at their school. And what they do is they work directly with our team, and there are two aspects to it. One is we come in and do a financial literacy workshop with them, which is incredibly powerful for us, whose mission is to educate this next generation of kids. Meanwhile, the curriculum in their own high school certainly cannot keep up with crypto and digital assets in this world.

And so, we can do a lot of cool education there through this extracurricular environment. And then the second thing that we do with them is give them opportunities to earn money on the app. And they can do it in a lot of ways. So, they create some of our TikTok content. We did a challenge where we sponsored a group of teens’ side hustles for the summer. And so, we had teenagers that created designs for iPhone cases and sold them on eBay. And we had teenagers that very entrepreneurial collected golf balls, you know, they lived on a golf course, and packaged them and sold them. And so, there were just a lot of cool stories that came out of that. And they video blogged the entire thing. Just creating those powerful stories of this teen community so that teens can see their peers, see the amazing things they’re doing, and understand that Stack, as a brand and a platform, is a place that is celebrating that. And I think that’s fundamental to who we are.

Aseem: Yeah, that’s so cool on so many levels this ambassador program can just be the beachhead of what you’re trying to achieve. And I think with that comes social proof and with that comes interest and awareness. It’s so cool on so many levels. You know, as a parent of a 9 year old, soon to be entering teenage years. And it’s almost scary to think of. So tell us what’s on the mind of every parent, tell us more about what your journey has been, how you’re discovering that. And frankly, is that going into how you’re thinking about product?

Will: I’ll admit right now that we have a lot of work to do with parents. We are starting to be good listeners of parents. I’m actually entering the parenting arena in a few weeks myself.

Aseem: Yeah, congratulations!

Will: Thank you. Thank you. I’m constantly thinking about what type of world I want to create for my own children. And I know that’s on every parent’s mind. So being the good guys and sharing the message that we are the good guys that, we’ve taken a lot of steps to create the best place for a teen and a parent to go be a part of this kind of crazy world of crypto and Web3, I think is a huge message to carry. We have started doing some more bespoke programs similar to our ambassador program but for parents. And then the second place that I think we’re spending a lot of time, which I think is just as important as parents and carrying the baton as teachers. Educators can be, I think, a really interesting part of our strategy.

I’ll say this, we didn’t really hit this light bulb until recently, but we had probably, I’m going to say 10 to 12 educators specifically send our website’s email to reach out about us educating on crypto and whether they could get their class involved in our platform and wanting to know how it worked. And from that, we’ve realized that there really is this cool opportunity to share stories through the educational mode of the world to parents because who do parents trust the most? They trust teachers. And so, if we can find a way to create some really cool storytelling of teachers being a part of our platform. And using it to educate kids in a place that curriculum just can’t, I think that could be a powerful way to celebrate parents and their needs and wants, which obviously fall into education.

Aseem: Yeah, I really like it. I mean, I really like the use of the word curriculum. Because at the end of the day, your kind of giving them a very curated set of learnings that you can then apply to real-world scenarios and start trading. And, you know, you’re bang on when you talk about teachers and in some ways, you know, parents are teachers, but in, in this scenario and in, in this new world, parents are also on the educational journey, and they’re learning alongside. Talking about learning, your first-time founder, you’ve had amazing experiences at a different company, you’ve been at a VC firm — what’s been different so far as an entrepreneur? What have you learned? And I love asking this question — what has been the “aha moment” — if there is one?

Will: Oh my gosh. I mean the founder journey, I tell, friends and, and even like early founders as they’re starting their own journeys — I say, I think being a founder either spits you right back out. Or just lets you fall into this ocean of loving every single day of what you do. And it, and it really takes, a certain set of wants and needs out of the founder journey to really embrace it and love the job. It has made my career come alive in so many ways. The six months that I both created every strategy and then executed that strategy, I think, is one of those unique moments in your career because we all don’t get enough time to just spend on ourselves, especially when you work at bigger companies and you’re part of the machine in a lot of ways. And so, that six months, for me, to really go back and be honest with myself and not tell myself any stories, say, “what are you great at?” And “what do you need other team members to come and do a really great job of?” It tells you lessons about yourselves, you know, just in that honesty that I think is beneficial, not only to your career, obviously, but just to me as a person. I find myself grateful for a lot of those lessons early on and celebrating a lot of those things, the bigger we get and the more people we add to the team and all of those good things.

And, and shout out to, you know, my two co-founders who round out my skill sets incredibly well. We had a discussion earlier today, in fact, about some areas that each of us feels particularly strong in and how we can continue to celebrate those in all of the strategies that we’re running.

Aseem: We’ve had the fortune of working with, you know, both Natalie and Angela as well, and I think we can see the team coming together and the sum of parts making the whole so much better. Right? Because at the end of the day, I think you’re complementing each other well. You know, you’ve got your strengths, and the team has theirs, and I think it’s so amazing to see the humbleness, the drive, and frankly, the passion for the space all get married with your skills that then take you along the journey of achieving something really, really great. The common knowledge around talking to founders is that there’s always one thing on their mind that they’re maniacally focused on — what is it for you when it comes to Stack?

Will: The number one thing, which I’ll just reiterate like a thousand times probably, is how can we more meaningfully educate? And so, we’re constantly obsessed. I mean, where my skillset falls, a lot of the time is actually in our product and designing it thoughtfully and listening to the data and listening to users and, and really celebrating those users.

We had a fun conversation about our marketing approach right now. And we talked about how we need to create the Stack feed to mirror the exact profile of our user. And how do we make the Stack feed look like a 16 year old that’s curious about finance and has certain behaviors and patterns so we can really live and breathe the content that they’re seeing and create meaningful educational content, create meaningful marketing content, create meaningful product content, all of that stuff. I think just celebrating a lot of that in high-quality content where I think a lot of finance apps send you to a blog or send you, you know, off app to something else. We can do a lot of good stuff there. So that’s the one laser focus that I have is winning that specific space of our app.

Aseem: And so much of what you’re seeing is actually reflected in the approach that you’re taking. The way different people consume content has changed so much over the years. Like we’ve gone from news feeds to RSS feeds to blogs to articles to Twitter to TikTok now, and I think it’s amazing, you know, how meeting people where they are is the approach that you’ve taken. It’s the natural way of how teens will learn. It’s exciting to have seen the work the team has done and in working closely with you seeing how much we’ve learned as a firm in terms of the approach you’ve got to take and you’ve got to change. It’s both enlightening and fascinating at the same.

So, kudos to you and your team for always being hungry and always being on the lookout for what’s around the corner and how you can make it better and how you can strive to achieve that curated approach in a way that is very natural.

Will: I appreciate that. It means so much.

Aseem: Yeah. Advice for young founders, Will. Like a lot of people who are in big companies, have ideas, you know, going after a bold vision, thinking about solving it in a meaningful way — what advice do you have for them, having just walked that journey and, and still walking that journey.

Will: Well, number one, I would say is the metaphor I’ve used from time to time. It’s an old show I watched in the ‘90s is called “Double Dare 3000,” and there’s a part of that show where you are going through this obstacle course. You’re given no instructions. And in each obstacle, you have to find a flag, and it’s like stuck in slime sometimes, or it’s in the middle of a slide, or it can be anywhere.

Aseem: It sounds very teenager focused.

Will: I mean, it was a great show. I loved watching it when I was a kid. And why I think it’s the perfect metaphor for early founders of a company is because you’re given very little instruction as a founder because you’re your own boss, all of a sudden. And you don’t have a lot of structure. And all you’re trying to do is find the flag at every obstacle. And that changes every day. Your job changes every day. One day, you’re trying to find money. The next day, you’re trying to find product-market fit. The next day, you’re trying to interview customers. The next day, you’re trying to keep your vendor expenses down. It is a new and different challenge every day that you enter the game. For founders who love it, that’s what they love about the job. But you need to be finding a way to just find the flag. The quote that I throw out there is, “You need to have slime on your face.” You just need to go for it. You’ll be told a thousand times that you’re not going to make it. You’ll get told “No” a thousand times. And to be resilient enough to get through that and to find it in yourself, to get to the next obstacle. I think that’s the biggest thing.

Aseem: I will tell you this, Will — in the context of “slime and your face,” we were enamored by your vision. We are enamored by your tenacity, your passion, and I don’t think that there was ever a question of “No” from our side. You know, without further ado, any fun fact or any fun story that you want to share with our listeners as we bring this to a commencement,

Will: Oh, man. I mean, there’s so many things I, I think there was a moment in the second month of being a founder — and this is when I had taken the plunge, this is my full-time job, you know, I was fully locked in — and I had one of those days where I got a lot of “no,” you know, I was getting a lot of doors closed in my face. And I had sat in my chair for a long enough time that my screen had went black, which meant it had been 15 or 20 minutes or something. And I was staring at my own reflection in my computer, and I just looked at myself, and I said, “oh my God, what are you doing?”

Aseem: Yeah.

Will: And I think to pick yourself up from those moments, which every founder has them. And, you know, one of my favorite books is “The Hard Thing About Hard Things” because it talks a lot about those moments that he talks about the struggle in that book and how every founder has been through the struggle. I think there’s so much knowledge, and just knowing that others have gone through it, and talk to a good founder, have a coffee with a founder that’s a step ahead of you. The amount of knowledge that you’ll learn and the empowerment that you’ll get. I mean, every time I have one of those conversations, I rip off the warmups, and I get back in the game. And so, I think that’s incredibly powerful, and I’m happy to be that for, for any entrepreneurs out there listening.

Aseem: That’s awesome. Hey, will I really want to, you know, congratulate you on the announcement and on the raises and, it’s fascinating to be able to back someone like yourselves and partner with you and the team in, in really going after a big, bold vision. Because I think this is truly transformative. If you think of it like 20 years down the line, but looking back and saying, “Gosh, we wrote the first line of code and had the first product on the market that actually helped teens invest in a responsible way. And that really created not just good habits, but it created futures.” I think it’s just fascinating that there is so much out there that we could be enabling in a responsible way. And we are fortunate at Madrona to be in this journey alongside you and to continue building or laying the foundational elements of this. So, thank you for your partnership, and I’m even more excited about doubling down and getting to work because the real work starts now in, in trying to scale the product and, you know, deliver a stellar experience.

So, thanks for being on the show and good luck in the future, and I’m sure we’ll be looking back and saying, wow, that that first line occurred, that first staring at the screen that moment was surreal.

Will: I love it. I thank you so much for having me, Aseem. I’m humbled and honored to be a part of the amazing Madrona portfolio. And I know my team is incredibly fired up to go solve this problem. And, as you said, the hard work starts now. And I think we’re really excited to be a part of it.

Aseem: Awesome. Thanks. We’ll talk to you soon.

Will: Thanks, Aseem.

Coral: Thank you for listening to this week’s episode of Founded and funded. If you’re interested in learning more about Stack, please visit TryStack.io. Please tune in in a couple of weeks for our next episode of Founded and Funded with FiveTran CEO George Fraser.

Battlesnake Founder Brad Van Vugt on Creating Community Through Programming Competitions

Welcome to Founded and Funded. My name is Coral Garnick Ducken, and I’m the Digital Editor here at Madrona Venture Group. This week, Investor Maria Gilfoyle talks to Brad Van Vugt, founder and CEO of Battlesnake, a multiplayer programming game for experienced web developers where your code is your controller. Battlesnake builds games for programmers that encourage self-directed learning and are challenging to master. In this episode, Maria and Brad dive into where the idea for the game came from, how they get the developer community so involved, and how they’re able to combine aspects of gaming, eSports, and traditional sports to create an engaging experience not just for developers, but for anyone to watch and enjoy. You won’t want to miss Brad’s stories and advice in this one, so with that – I’ll hand it over to maria to kick it off.

This transcript was automatically generated and edited for clarity.

Maria: Hi everyone. I’m Maria. I’m an investor at Madrona. I am honored to be here today with Brad, the founder and CEO of Battlesnake, one of our portfolio companies. Brad, I’m excited to be here with you today.

Brad: Hi Maria. It’s good to be here.

Maria: So, I thought we could start with the story of how Battlesnake got started. You have this incredibly engaged community with over 800 developers in a Discord channel, actively playing and coding games on Battlesnake. What was the initial vision, and how has that evolved from where it is today?

Brad: It’s a good question. It’s an interesting story. Battlesnake started a few years back primarily as a developer recruiting event. I had co-founded another tech startup, and we were at a stage where we needed to hire lots of developers. We were like, okay, let’s do something interesting, specifically for intermediate, senior developers, which are historically challenging to retain, challenging to recruit, and we were like, let’s do something really interesting. Let’s see what we can do to maybe make some buzz locally.

And so, we wanted to hold the developer event, and we wanted to do something different than what you’d normally see. And at the time, hackathons were really cool. It was getting all your friends together, staying awake for 48 hours, programming on our laptops, drinking lots of coffee and energy drinks, and seeing what you could make. We thought that hackathons were fun, but they’re incredibly accessible to students or younger developers or folks that have free time on their hands. But hackathons are inaccessible when you start thinking about anyone with kids, anyone with full-time jobs, and other commitments outside of just coding. And so, we wanted to do something different from that and hold a developer event that felt different. We wanted to accomplish two goals with it. The first one was to have everyone work on the same problem. Hackathons generally — everyone goes off in their own little silos and corners and builds something, and then everyone presents on stage, and nobody cares what’s going on. But what if everyone worked on the same problem? What does that look like? And does that encourage collaboration? But then also, can we make it really fun for non-participating folks to show up and watch? And so, can we hold some sort of tournament, show, or challenge at the end that would be engaging and fun to watch? And we came up with the idea of Battlesnake. The core premise was to spend some time building a web server that plays a game autonomously on your behalf, and then we’ll hold a challenge or a competition at the end and see who wins, and we’ll celebrate this. And it took off in an interesting way — to a point where we had thousands of developers show up and try to participate and win first place.

We had hundreds of parents, kids, grandparents, and colleagues show up just to watch the tournament. And that triggered something for us where we were like, okay, this is really interesting. We haven’t seen anything like this before. We started to get inbound interest from much larger tech companies that were struggling to recruit developer audiences that were more senior and more experienced. And that pushed us over the edge of like, okay, let’s see what we can do in the space. Let’s see if we can grow this and see what that would look like. That was a decision we made in 2020, and we started working on Battlesnake full-time. And now, we consider ourselves a global game platform. We have developers all over the world. We have more than 20,000 developers that have played Battlesnake at this point. We host monthly competitions and challenges, and we do a bunch of different stuff with a bunch of different developers, but that was how we got started in the sort of humble beginnings of let’s try to do something that was better for more experienced developers specifically.

Maria: You have this incredible story of being the founder of another company, seeing a problem internally and then trying to develop the solution, which became your next startup, Battlesnake, which is such a cool story. Is there anything you learned from being a founder of a prior company that you’ve taken with you as a second-time founder?

Brad: Yeah, there are a couple of things. So, we were a B2B SaaS company. We required an API integration, so a lot of our product engineering went into like API design and being thoughtful around how the API was presented and documented. So, we learned a lot about how to speak to the developers, how to engage more senior developers, and how to build an interesting developer experience, but also like no developer really wants to integrate with a SaaS product, so it was like, okay, how do we make this as quick as possible? Those learnings led to, okay, how do we grow Battlesnake in the early stages? Like how do we build an interesting developer experience? How do we get developers to fund fast, to use the cliche term?

But there’s also an interesting number of things that didn’t transfer to the developer gaming space. Fixed roadmaps are a big one. When you’re developing for a B2B SaaS, there is a problem your solving, you have phenomenal ideas for how to solve it, and that’s what you are going to do. That’s what you’re going to build. But, for consumers or gaming spaces, you have to be much more open to your audience and the community. And this is something that we learned early on, which was like, okay, it’s not just talking to the developers, but it’s listening to their feedback. It’s engaging with them directly. What ideas do you have? What would make this more interesting for you? How could we take the platform to the next level? Where do you see Battlesnake in the next five years? And how do we help you get there? That was, I don’t want to say, painful, but it was a bumpy shift in mindset between enterprise SaaS to developer-facing consumer gaming product. The other thing that helped is I partnered with a really strong CTO who has done lots of stuff in consumer gaming. He helps balance out that background and that previous knowledge, that previous experience with how we need to think about engagement on a daily basis or a weekly basis. And he helps a lot in that regard.

Maria: You’ve been incredible at listening to your customer and keeping them engaged. But before we dive into that, I would love to dive into how you think about the journey of the user in Battlesnake. So, you started with this new version of a hackathon, and it’s now evolved into this platform where anyone from anywhere in the world can log on and participate in Battlesnake. You’ve thought a lot about how you should focus on building an open-source community with extreme flexibility. So, anyone can participate with any programming language, any cloud provider. How do you think about that flexibility and user experience from the first time someone goes to the Battlesnake website to participating in a tournament?

Brad: I think it’s really challenging. And it’s something that we’ve worked very hard to improve. And I think we’ve done some great things in that regard, but there’s always more space for improvement. Battlesnake as a platform is all about exploring the technology on your own terms, and letting that mean whatever you want that to mean to you is good for us. And we want to support you in that. A lot of developers that get involved in Battlesnake, especially more experienced developers, are coming to Battlesnake already with an idea in their mind of something they want to do — they read a blog post six months ago, they heard a podcast about this new stack or this new technology or this new cloud platform. And it’s something that’s been in the back of their mind as like, “Oh, I’d really love to learn Rust,” for example. I use Rust, for example, because a lot of our players are using Battlesnake right now as an onboard ramp to learn Rust specifically. But if you’d speak to most experienced developers, they have a laundry list of things that they would like to explore more and things that they would like to try. And really, that’s what we’ve learned to latch on to. When you come to Battlesnake, we’re not going to teach you AI. We’re not going to walk you through AI. It’s not an ML competition. That’s not what this is. This is about giving you an interesting way to finally learn that thing you’ve wanted to learn forever. And most developers, especially experienced developers, have that list already. So, it’s about tapping into that and speaking to that directly.

The other interesting thing is — and this is something that we observed prior to making the jump to work on Battlesnake full time — there’s not a lot of opportunity for developers to go deep on specific technologies. If you are working professionally as a developer, the scope of things you get to work on is very small. You might be able to go deep on something that’s very specific, very siloed, but you don’t have a lot of say in how you explore outside of that or beyond that. What attracts senior developers to Battlesnake specifically is the ability to explore that over long periods of time. We’ve had developers play Battlesnake for multiple years now, and they’ve used it as a jumping-off platform to learn new languages, tech stacks, and cloud platforms. We’ll have an elite competitor do well in one particular tournament and then show up the next tournament with a snake that’s completely rewritten in a different tech stack of “Hey, I really wanted to try it this way, this time and see what that was like.” And that started to happen early on without our involvement, and that’s the core piece of growth, and that’s what keeps developers coming back.

Maria: That’s awesome. And how would you describe the profile of a super user on Battlesnake — the person you’re trying to target? You’re open to a lot of different profiles, but who ends up being the most engaged?

Brad: The most engaged tend to be senior developers with ideas about things they want to learn. But don’t have the time for a side project or are sick and tired of being told to do side projects. A lot of developers get told, “You want to learn React, or you want to learn Rust, or you want to learn this new technology, go do a side project on your own or go join open source.” And both of those things are very like lonely and intimidating, with huge barriers to entry. And our long-term core users right now — our power users — are folks that have these lists of technologies and things that they’d want to learn and things that they’d want to explore, and they just haven’t found a venue to do that yet. And those are the ones that stick around for a long time, and they help the community, and they get involved and continue playing for quite a while.

Maria: So, you’ve built this engaged community, and you’re great at listening to your users, and there are people from all over the world that are tuning into Battlesnake tournaments. How do you think about managing that community and growing it, and how the concept of community contributes to the overall growth of Battlesnake as a company?

Brad: I think it’s challenging. It’s hard to do, and we’re constantly learning. We’re constantly listening, we’re constantly learning, and we’re pretty good at acknowledging what we don’t know. But also, more recently, we’re learning that multiple channels are incredibly important — like highly engaged, multiple channels. So, it’s not enough to have a Discord. It’s not enough to have a GitHub discussion board. It’s not enough to be on Twitch. It’s all of those and more. One of the things that has worked out well for us is being on Twitch regularly. It puts real people behind Battlesnake. You can see me, or you can see someone on the team talking about how we think about the game, how we want to extend the game, the problems that we see, and what we think we’re hearing the community say. But then it also gives incredibly real-time and incredibly interactive opportunities to community members.

It’s a lower barrier for someone to show up on a Twitch stream and ask a question in real time. And I can answer right now. And that has been incredibly valuable early on and continues to be valuable even as we expand across other channels. I think that the idea of developer brands doing more live streaming or live engagement — it’s incredibly undervalued in the industry just in general. And it’s been one of our core advantages in growing and managing the community early on.

Maria: Is there anything that surprised you about growing and managing this community besides the importance of Twitch that you didn’t realize at the beginning? Or you’re continuing to explore as you build the community out.

Brad: Yeah. Developers as a community are going to do what they want, whether you give them permission or not. That’s the nature of this. Because we do so much open source, many developers will, if they have an idea, just act on it. And they’ll self-organize, and they’ll start building communities around this. A good example of this is that we didn’t have a Discord early on. We just hadn’t thought of it. I think we had a public Slack or something. And it wasn’t working, and we didn’t pay attention to it, and nobody joined it. And then what happened was someone tipped us off that a Battlesnake Discord had been started. And we joined, and there were like a hundred people in it, and they were talking about Battlesnake all the time. They just did it, they just self-organized, and they just did it.

Another good example this is more technically specific, but like, we didn’t have a CLI. There was no Battlesnake CLI to run games or run your own commands in a shell. And someone just built it and showed up on Discord one day and said, “Hey, I built the CLI.” And suddenly, hundreds of other developers started using it. We had no plans to build a CLI. We didn’t intend for that to happen. We didn’t think that was a thing we needed to work on, but the community just did it. And so now it’s like, do we fight that, or do we encourage that and engage with that? And obviously, the answer is the latter. And that’s surprising, but we’re working with makers, we’re working with builders, and it’s going to happen. And there’s a lot of lessons that we’ve learned around — rather than show a roadmap of where we want to go, or rather than build a feature and think this is the thing we need to exist. Our community’s going to build for Battlesnake whether we like it or not. So how do we encourage that? How do we leverage that and use that going forward? And we’ve got a good sense of that now, but we’re still very much learning how to treat the community like a living organism as we grow.

Maria: That’s incredible. It’s almost like you built this base platform and product, but then your communities decided the product roadmap versus you as the founder, which I think is a big difference between often consumer and enterprise companies — you have a bigger focus on listening to your community and then building the product with them. And so that leads me to your focus on building in public. So Battlesnake is great at building in public. What does open-source development contribute to the growth of Battlesnake? And how do you think about the focus on open source?

Brad: Open source is really important to us. We made a very conscious decision early on to do as much in public as we possibly can. The entire game engine is open source. The visualizations we show during streams and that you’re seeing during competitions are all open source so that people can extend those. And also, we provide a lot of onboarding content through open source. For example, if someone wants to learn Rust or AWS SageMaker, we provide some code to get them started. And we can provide a lot of jumping-off points. But it initially served two purposes for us. One was like the game itself is technical, and the mechanics are interesting, so we had a lot of community members that had interesting and great questions around how the core game mechanics worked. Like, why did I lose in this particular situation? Or how does turn resolution work in this case? Or I thought of this edge case; what happens here? And so, we found ourselves fielding these questions regularly and thought, what if we just open sourced the entire game engine? And then the conversation becomes not — here’s our justification for it behaving this way. It’s here’s the code that runs your games. Here’s the code that runs your turn resolution; go check it out and explore it. And that became part of the early onboarding experience for most developers. It’s not just playing the game; it’s exploring how the engine works. It’s exploring how it’s deployed. It’s exploring how timeouts are calculated. It’s exploring how turn resolution happens. And you’re doing that through open-source projects on GitHub. You’re browsing the code. You’re compiling the code. You’re making changes. The other major way that open source has given us an advantage is obviously contributions back. And I want to be very clear because it’s interesting how this has evolved. It’s not like fixing bugs. We’re not like, “Oh, can you please fix this bug?” Or “Can you increase the documentation on this repo?” It really is like, — how can we extend the game to make it more interesting? How can we do more things with Battlesnake? My CLI example, previously being a good example of this, right? Because everything is open source, someone was able to develop this whole other way to engage with Battlesnake through a terminal that didn’t exist before. And that was because the game engine was open source. And now we’re starting to see developers build modifications and extensions and their own game maps on top of the engine itself. We see open-source contributions as the pinnacle of our power users being engaged. They’re going to get involved. They’re going to have ideas. If we’re doing this right, they’re going to want to give back to the community. And they’re starting to do that now through open source specifically. So that’s something we really had to figure out how to lean into and encourage more. And there’s a lot of stuff we can continue to do there as well.

Maria: And as developers use the open-source opportunity to build game engines on top of Battlesnake, how does that impact your product roadmap, and where do you see Battlesnake evolving in the future?

Brad: We’ve learned that our role is not necessarily to build for the players. Our role is to build for the developers and to encourage them to contribute and be engaged. Our players want that. Our players want to give back. They want to build modifications; they want to build extensions. And so rather than us being like, okay, this game mechanic needs to exist. Let’s build an engine for players to create and release their own game mechanics, right? That’s the mental shift that’s gone on, and that’s the impact that that open-source development, that’s the impact that the community has had on how we think about building the game and building the product. And I’m not sure of many other products or games that are built that way — where our core goal as a dev team, especially long term, is enablement. Rather than what can I deploy today that’s cool. It’s what can I deploy today that will let someone else make something cool six months from now. And that requires a very concerted effort to make that happen. But that’s where we’re at right now. And I think that’s incredibly compelling.

Maria: You’ve been so great as a founder about listening to your community of developers that are participating in Battlesnake. But you have a whole other customer that we haven’t even talked about yet, which is your partnerships with companies like New Relic and AWS, who are partnering to help engage their developers at the company but also recruit developers into those companies. How do you think about these partnerships in satisfying those customers as well?

Brad: I think that right now, our core focus as a company, as a team, is our player base. It’s experienced developers. It’s getting them engaged. It’s keeping them engaged. It’s doing things that are fun and interesting — things that allow them to include their friends and their family, and their colleagues. On the partner side, we’re specifically working with large brands that understand that — that understand what developer marketing looks like. What do developer relations look like? What it means to recruit long term. If you’re DigitalOcean, you might be trying to make some hires this month, but really what DigitalOcean is trying to do is increase platform usage, increase customer base and make hires for the next three years. And that’s a much different play than, say, traditional recruiting, so we work with them because they understand our longer-term vision. They understand how we’re able to attract and retain players and more experienced developers. And they’re willing to work with us to figure out how to make that scale. One of the challenges, when you’re working with developers specifically, is you have to think long term. This works for recruiting but also for product usage. If you want someone to adopt your technology, they’re not going to show up one day and then just start using your API. You have to think long term, it has to be, you know, a 12-month onboarding experience or more, and you also have to be authentic. Developers are incredibly good at seeing through marketing tactics. That doesn’t mean you can’t market to them. It just means you have to be really authentic in how you do it. We’re able to work with a handful of really great tech brands that understand the long-term value of that. And are willing to work with us as we build the developer-facing side of this game.

Maria: So, if we think about this category, you’re building at the intersection of a lot of different spaces. You’re building at the intersection of ed tech in a way that there’s an education component to it. Gaming and eSports because of the community around it and the way you engage Twitch creators. And you’re also building up the intersection of dev tools, and you’re defining this new category. It’s a dev recruiting tool for companies like DigitalOcean, but at the same time, you’re helping developers explore new cloud providers and coding languages that they haven’t explored before. And you’re also targeting not just new developers but experienced developers. How do you think about this category and how you’re defining it, and how this kind of niche between these different spaces will continue to evolve?

Brad: I think we’re very early in this space. And my best go-to example of this is that Twitch just created a software development category this year. And there are thousands of folks that are live coding and building games and interacting with developer audiences on Twitch, but it’s just starting to get large enough now that folks are starting to notice. In terms of how we think about this intersection. We think about it from a bunch of different angles. We think about it from the eSports angle, from the traditional sports angle as well, but also from the gaming angle. Something that’s core to our mission and beliefs as we approach this space is making something that is innately incredibly technical and challenging but also incredibly accessible to most people. And I don’t know if that comes through, but an example is, say you’re watching competitive StarCraft, StarCraft being a very large eSport. Most folks watching a StarCraft game, especially if you play it at a very high level, have absolutely no idea what’s going on. You’re not going to casually watch competitive StarCraft. You have to be a player. You have to understand the strategy that happens at a high level, and you have to be available at that time in order to view that. And I think that needs to change. Gaming is kind of figuring out different ways to do that by adding different spectator modes and adding different on-ramps to different things.

But if you look at more traditional sports — most people can watch professional basketball. And they might not understand what’s going on in the strategy, but they can go home, or they can go outside and play basketball. They can try it, and they can understand what’s going on. And it gives them a sense of, when that shot is made, or that play is made, that was really hard to do. And that was impressive. And that was fun to watch as a result of that. And what we’re trying to do is how do we bring that spectator angle? How do we bring that accessibility to something that is more developer-focused or something that is more gaming-focused or eSports-focused. And this really leans into the game itself. The way that we’re building the game is universally recognizable to most people. I can spend time building an incredibly complex, incredibly competitive Battlesnake, and then when I go to play competitively, my parents can watch, and they can understand it’s just a game of snake — my options are to move around the board and try to outmaneuver my opponents. Or my kids can watch with me, and they can cheer, and they can understand what’s going on. If I’m live coding or if I’m playing StarCraft at a high level, no one’s watching me. I’m not bringing anyone along for the ride on that.

I think that the sort of intersection of the accessibility of traditional sports and the deep complexity of eSports — we work hard to combine those in an interesting way. And I think that’s where this industry is going for sure.

Maria: Let’s dive further into this focus on accessibility. How did your creative vision in terms of the visual parts of Battlesnake and this concept of using a snake? People know battle and game and snakes are understandable to any user. How do you think about the visual components of what the snake should look like? What the user experience should look like that makes Battlesnake so fun, visually appealing, and accessible at the same time?

Brad: Part of the choices around snake and the, especially the visual aspect of snake, we got lucky early on. We didn’t set out to build competitive multiplayer snake — that wasn’t the goal. The goal was to do something for developers that was fun. And the sort of core game mechanic was just chosen at random. And then we learned that it was universally recognizable. The way that we learned that was — like I mentioned, early on, Battlesnake started as this recruiting event. But people started to bring their kids. We have photos early on of 2,500 people watching this live Shoutcast Battlesnake game, and there are kids in the crowds that are cheering, and there are parents that are standing in the back, and they’re clapping, and they don’t understand how these things are built, but they understand that someone is doing well. And that’s impressive because they’re playing a game that they’ve played before at a much higher level than they’re able to play it. And that really tipped the scale for us. You know, we sort of have a third user that we pay attention to, which is the spectator. Someone who is not necessarily going to build a snake or isn’t interested or isn’t capable of building an incredibly competitive snake but still has a lot of fun watching and wants to follow the storylines and wants to cheer for their favorite.

I guess the other angle of that is we look to more traditional sportscasts, and we also bring an element of analysis and Shoutcasting and live entertainment that you wouldn’t necessarily see it at a developer event. And the way that we approach speaking about the game at a very technical level, at a high level. We try to be very accessible with that. Our target audience is roughly a 16-year-old that might be watching and might be interested in what’s happening. And we make a very focused effort to make this more interesting and tell storylines that sort of like overarch the tech itself.

Maria: How do you think about converting that spectator into someone that ends up coding in Battlesnake?

Brad: Oh, this is awesome. And this is happening already. I’ll go back to the basketball example. So, let’s say you’ve never heard of basketball. You’ve never watched the game. You watch a game for the first time, and then your friends are like, “Hey, you want to go try that?” It’s incredibly accessible for you to just go play. How do we enable that for programming? Like, how do we get to a point where you can watch this game? You can understand that someone is doing well. You can understand what it means to have an interesting strategy. How do we capture that interest and be like, try it, go home and try it, just try it right now and see what we can do? And like enter a beginner league or enter a beginner ladder and see how well you do. Our goal isn’t to build you into a competitive Battlesnake player. Our goal is to introduce you to programming — introduce you to the core concepts of what’s happening. And again, sort of marrying these two concepts of like traditional sports has this incredible accessibility to it that programming typically doesn’t, and so how do we bring those two things together?

Maria: I love the sports analogy because Battlesnake fills two things that are more native to traditional sports like basketball versus coding, which is that it’s accessible, you can watch it, you can then try it. And in Battlesnake, someone could watch and then decide to try learning to code and coding their own snake. But you could also become a professional basketball player, and you could play at a very high-level Battlesnake also great and appealing for someone who is an experienced developer but wants to continue to improve their skills. And so, there’s this broad range of users and ways that people can engage with Battlesnake.

Brad: Yeah. And I think it’s important that we acknowledge and serve both of those personas as we build. Our focus right now is on experienced developers. Like how do we get high, complex, strategically interesting games that we can watch that we can analyze because that gives us content to show on Twitch, to have on YouTube, to do live casts around, to do live analysis around — that can then expose many more folks down the road to what we’re doing and get them involved in the game itself. But it very much is — let’s tell the stories of these programmers and make it interesting to make it really compelling for anyone to watch.

Maria: So, you’ve built these different levels within Battlesnake, but you’ve also mentioned potentially another game is on the horizon. So, what are you most excited about in Battlesnake’s future?

Brad: I think that the thing that we’re most excited about is the community contributions back to the core engine. And going back to what we were speaking about before and our primary avenue for growth, we see the pinnacle of power user engagement is actually building your own game or game mode or game engine on top of Battlesnake itself. And snake being one implementation of what we built, but like what else could we do with it? I see our role in that as not necessarily becoming a game studio and being like, here’s the next iteration of Battlesnake. It’s more like, how do we enable the community to do interesting things and build their own renditions and build their own modifications and build their own communities around that. We look a lot to Minecraft. We look a lot to Roblox and these sorts of larger, contribution-based communities. When I was growing up, I was heavily involved in the early Counter-Strike scene, and I produced mods and got communities built and working behind those. I love that sort of natural extension to gaming in general of, you know, great we’ve we built a community rather than let’s go build a second community, how can we inspire folks to start their own communities?

How do we show core values around accessibility? How do we show core values around learning and collaboration and open source? How do we push that out through the communities rather than try to have a heavy hand and just dictate from the top? Let’s build a series of sub-communities and enable developers to do their own things and spread these values organically.

Maria: That leads me to the next question, which is, as a former founder and going into building Battlesnake and continuing to build Battlesnake and seeing where the future may go, what has inspired you that is dictating where you want the product to evolve to in the future?

Brad: We look to a couple of different places for inspiration. But the largest one above and beyond is the community. It’s listening to their ideas. Being active, being engaged, giving feedback, working on enablement rather than features. We also look to traditional sports. We look to things like basketball, or Formula 1 is another place that we look to regularly. Also, we look at other communities that are doing this sort of in a more niche sense. Kaggle is an example of very AI, very ML-centric, very monetarily driven developer communities. But I think they’re doing a lot of interesting things in terms of community growth. And we look at what they do and like, how do we do that bigger? How do we do that at a much broader scale at a wider spectrum of technologies? We also look at products like DeepRacer. They have a very Shoutcasty sort of live analysis, live show angle to it. And then we also looked at eSports very much so in like League of Legends and Overwatch League and MTGA (Magic: The Gathering Arena) and all this sort of stuff.

Maria: We have other early-stage founders that listen to this podcast for inspiration. So as a founder of an early-stage company, what do you wish you knew sooner or had implemented at an earlier date?

Brad: Oh, geez. We should have made our own Discord a lot sooner. We should have started streaming on Twitch a lot sooner. I talked about this before, but I cannot emphasize this enough. It’s not about live streaming. It’s not about content production. It’s about live interaction with your users — in our case, our players. Finding interesting ways to engage with them live and put a face behind it. Like it’s way different to have, you know, me write a blog post about where I think we’re headed versus see me answer questions live in real time on stream and be like, “Oh, that’s Brad” or “That’s the other member of the Battlesnake team. And this is what they think about this. And they’re a real person, and they’re incredibly accessible.” I say Twitch, but it doesn’t have to be Twitch. Obviously, go where your players are, or your users are. But I think live engagement is incredibly underutilized and undervalued by most early-stage companies, especially with developers.

Maria: Yeah. And I think that can be transferred in any consumer company, which is the importance of interacting with your users, like face to face, as early as possible and seeing where they are, learning from them, connecting with them. But also, this focus on, maybe it’s not creating a Discord channel right away, but it’s just testing different platforms that users may be engaging and getting involved, and creating a channel and seeing how people interact within it. And is it a place that you should buckle down and prioritize, or is there another space, like a Slack channel, better for your customer?

Brad: I think that’s a really good insight and a good clarification. It’s not about creating a Discord channel and being like, “All engagement will now happen on Discord. Please do so in real time with your real name attached, such that we can have an engaged community.” It’s about finding natural feedback channels, natural congregation points for your community, especially in consumer-facing, obviously. And also being open to the solutions being things you haven’t thought of. Again, using Discord as a very small or specific example of that. But like we had a Slack, and turns out more people were talking about Battlesnake on Discord behind our backs than we realized. And we could’ve just been like, “Please come to Slack.” But okay, how do we make this work? How do we not adopt this? How do we engage with it? We still don’t own the Discord server. Like it’s some community member that admins it and monitors it.

Maria: And so, speaking to that community engagement, as we wrap up, one of my favorite things about your email updates to investors is you always have these community highlights of someone talked about Battlesnake during their job interview with Google or someone got a job through participating in a Battlesnake tournament. Do you have any favorite community stories you want to highlight?

Brad: Oh yeah. Oh, so many. Okay. So, I think this happened earlier this year in the competitive spring play. We had — I’m not going to say their name because I wouldn’t want to draw unwanted attention to this particular player — but they had done incredibly well. It was like their first-ever competition, and they were just figuring things out, and they’d realized a unique strategy. And their partner baked them a Battlesnake-shaped cake. And the cake was their customized Battlesnake color and like their head and their tail. And there were like little cupcakes that were the food on the grid. And had this viewing party to celebrate the success that this one developer had in this competition. And again, that speaks to the accessibility of it and the fun behind it and that third sort of spectator persona. But when you see that kind of thing, like that just blows our mind. That is awesome. How do we do more of that? How do we encourage more of that? We want more of that to happen. That’s incredible. I could go on with community examples for hours.

Maria: That’s an incredible example of just how much your users love you to a point that they’re baking a cake around it, and they’re getting their friends and family involved, and it’s this significant part of their lives. And people are making friends through it, getting jobs as a result of Battlesnake, and developing new skills. There’re so many great outcomes. Brad, this has been so awesome. As we wrap up, where can people find Battlesnake, and how can they get involved in a tournament?

Brad: Everything you need to know is at Play.Battlesnake.com. You can also get involved on Twitter. You can get involved in GitHub. You can join our Discord channel, and multiple people will be happy to help you and answer any questions you might have. If you are a developer looking to get started, check it out. If you’re interested in just watching some Battlesnake games and seeing what this is about, our YouTube channel or our Twitch channel has a lot of great videos of what competitive Battlesnake looks like in the fun we have during more of the live tournaments.

Maria: Awesome. Thank you so much for being here today.

Brad: Yeah. Thank you for having me.

Coral: Thank you for listening to Founded & Funded. Like Brad said, if you’re interested in learning more, visit play.battlesnake.com. Thank you again for listening, and tune in for our next episode in a couple of weeks with Stack Co-founder Will Rush.

Tesorio Founders Carlos Vega and Fabio Fleitas on Automating Accounts Receivable

Tesorio Founders Carlos Vega and Fabio Fleitas

In this IA40 spotlight episode, Managing Director Hope Cochran talks with Tesorio Co-founders Carlos Vega and Fabio Fleitas about getting finance teams out of the world of manual, error-prone and inefficient spreadsheets and equipping them with intelligent applications more common in other parts of a company. That’s where Tesorio comes in — they offer automation solutions designed to help companies manage accounts receivable — in other words, they help companies turn their revenue into cash. The platform replaces that tedious and manual collections processes with accurate, real-time predictions, optimized workflows, and actionable insights based on behavioral trends. Tesorio raised a $17M Series B in July to expand its go-to-market efforts and last year landed on Madrona’s list of the country’s top 40 intelligent applications, a list we launched to recognize companies applying machine learning to solve business problems better than ever before. We think these intelligent applications will define the next generation of innovation and shift the SaaS technology landscape into application intelligence.

In this episode, Hope, Carlos, and Fabio dive into where the idea for Tesorio came from, how the company pivoted from the original idea, how these two met, the hard conversations any co-founders should have before deciding to launch a company together, and so much more.

This transcript was automatically generated and edited for clarity.

Hope: Hello, everyone. I am Hope Cochran, I’m a Managing Director at Madrona Venture Group. I am excited today to be with Carlos Vega, the CEO and co-founder of Tesorio and Fabio Fleitas the co-founder and CTO of Tesorio. You know, When I think back to when I met these two fun friends, I was excited by the fact that they were all about solving the problem of forecasting cash flow. I am a recovering CFO for those of you that don’t know me — I have spent many, many hours of my life in spreadsheets trying to forecast cash flow and often getting it wrong, and often being an area where there was a lot of errors. There’s so many pieces that go into forecasting cash flow, whether it be the AR ,the working capital, the AP, that all amounts to what is your ending cash balance going to be. So when I met these two, and that was their vision to solve, I immediately identified with the problem, and we were off to the races. So we’ve been on quite a journey together, and I just welcome you two to this podcast today. Thank you, Carlos and Fabio.

Carlos: Yeah, thank you so much, Hope. I’m really excited to be here.

Fabio: Thank you.

Hope: I know the moment I met you all, and that’s when I got to be a part of your journey, but let’s start with where you all came up with the idea for Tesorio and solving this problem.

Carlos: Yeah, thanks. This is Carlos — thanks so much, Hope. Before beginning to Tesorio, I spent about a decade working in finance. Most recently, I spent a couple of years working at Lizard doing investment banking in Latin America, and while I was there, I actually co-founded a factoring business. Factoring for those who are not aware is purchasing of receivables at a discount so that people can get their cash flow now instead of waiting to be paid. You know, what we were trying to do is say, “Hey, look, let us help you with your cash flow and model it out, and then wean you off a factor and get you a proper line of credit at a bank.” But folks weren’t really biting. The way it ended up feeling is almost like payday lending for business. Where we’re providing those discounts, providing people the money up front, but they weren’t really taking the advantage of a better way of doing things.

When I went to business school, I knew there had to be a better way, and that’s what I was out to solve. So, we started with accounts receivable because, given that experience with factoring and other things along the way, what we realized was what people really needed around cash flow was predictability. And the most volatile part of cash flow that you don’t control is your cash inflows because any money going out the door, you have agency over, right? You can choose not to mail a check. You can choose to slow down your hiring. But you can’t really force someone to pay you. And one of our customers said it best — Steven Odell, who was at Slack at the time, said, “Revenue’s not real until you get paid.” So, when we start thinking about that, it’s like, all right, what does that mean? At the end of the day, it means that you grow the business. You have this revenue, but in order to generate value, you have to have the cash to pay for your expenses, provide returns to your shareholders, and fund future investments. When we started looking at what we could do we said, look, can we provide software that helps folks manage the day-to-day so that they’re not stuck in spreadsheets? And also give them that predictability they need so they can plan for future growth. And at the end of the day, you know, that’s what we have here with Tesorio. It was an important problem for every business to fund their growth with their cash flow. And it was a problem that we discovered a lot of folks had that we could solve.

Hope: I love that concept because, really, it’s so basic and yet, so true that revenue is not real until you get paid. Truly we know that we need the cash in our bank to pay the expenses, the most basic concept out there. And yet, somehow, it’s such a challenge to not only forecast when it’s going to come in, but know it’s going to come in, have that certainty. And so, you all do a fabulous job of looking at patterns and ensuring that we can approach those payees at the right time and ensure those payments and also help with that predictability. So again, “Cash is king” is the mantra here, and how can we help businesses maximize that?

Carlos: Right. And you know, what’s a funny part about it? How many times have you not gone out with some friends and spotted someone a couple of bucks, and you’re like, “You know what, don’t worry about it.” Cause it’s kind of awkward to tell your friend, “Hey, remember I spotted you $20 bucks last time? Can you give me $20 bucks back?” You just forget it. And you go on. It’s an awkward conversation, even personally. And in business, if you think about it, a lot of things happen, and you close a contract, you sign it. That’s perfect. But then going to have that conversation or remind someone, “Hey, remember we closed this contract, and we’ve been doing business for the last three months. You still owe me some money.” It’s not comfortable for any of us. Yet, folks were still doing this in spreadsheets. And what would you do with a BDR that took your entire database and just blasted the same message to everyone? What would you do with a sales team that didn’t even have a CRM if you’re looking at investing at this company? Well, that’s actually what finance teams are living with. A lot of companies we’re finding are sending the same message to everyone. And then, not using that information the right ways, as you were saying, as inputs to forecast cash. Every little bit of information about who is trustworthy when they say “I’m going to pay you by next Friday?” Who says they’re going to do it, but they don’t pay that? Or who consistently pays late or has a certain pattern? All these things can be discovered with algorithms. And then you can use that to make your cashflow more predictable, as you’re saying, not only to anticipate when you’re going to get paid but also to know when you should follow up with someone and do that the right way. It’s kind of interesting, everyone was doing this in spreadsheets when we came along.

Hope: I attest to that. Everyone does this in spreadsheets before Tesorio. I did that myself, and I experienced it many times. I think many people are still amazed by how messy and manual the back office is. You made the comment that the BDRs, the sales team, they have lots of CRM tools or different tools to help them in the sales world as people are focused on getting the revenue in the door. But then the finance team that’s trying to get the cash in the door is really based on messy workflows and complicated spreadsheets that often break. I often bring this to my friends and peers about how messy the back office still is, and they’re always surprised. But I lived it, and I know it, and I have the scars to show for it. And I love the fact that you all are bringing that solution to bear.

One of the things that I want to explore with the two of you, since I’m so fortunate to have both of you on this with me, is when starting a company, finding that partner or co-founder is difficult and challenging and yet so vital. I often say that the co-founder relationship or the founder relationship is harder than marriage. There are so many nuances, your lives are so intertwined. You guys have been at this now for a while, and I’ve really enjoyed working with both of you and your partnership. I’d love to hear how you found each other, what you feel was complementary in skills, etc.

Fabio: So, Carlos and I met actually, while we were both in college. I happened to be an undergrad in computer science at the University of Pennsylvania, and Carlos was in business school over at Wharton. We were both independently involved in tech entrepreneurship in Philly / Penn. I had at the time co-founded a fellowship program that got funded by the city of Philadelphia to get students from all around the world to come work at Philly-based tech startups. And so, I was getting really involved with the tech community there. Carlos was running a group at Penn called Founders Club that was helping other like-minded students that are interested in entrepreneurship or founding a company to work with each other. How we ended up meeting was because of a professor. He was starting a brand new class that was focused on tech entrepreneurship, and he kind of recruited Carlos and I independently to get students to join his class. He wanted both business students and computer science students at the time, which was a very unusual mixture in school usually. And from there, I remember still meeting Carlos in one of the sessions with talking with the professor he had applied to Wharton with an idea of Tesorio. So, we met there and started working together. Carlos is originally from Panama, I’m actually originally from Cuba. We’re both native Spanish speakers — we both immigrated to the U.S. as kids. So, we had that connection between us. And then, before actually making it an official co-founder relationship, Carlos and I both actually worked together for about a year. And then spent another nine months or so before getting into YCombinator. So, for us, it was actually very important to work together. And Hope, as you said, it’s a little bit like marriage. This time that we spent together is basically almost like we were dating before we decided, “Hey, we have a good relationship together, we can work together long term.” And at that point, obviously, it gets to become a very serious thing. And so we had the opportunity to work together before making it official.

Hope: I love that — definitely understanding each other’s working styles, knowing what each other’s strengths and weaknesses are, is so important to going into this. And, just having really honest, and I want to say hard conversations — don’t know if you both did that. But I really encourage my founders to have those: What does your life look like? What are the things that work in your life and don’t work? I’m curious. Did you all explore that together so you would know that you had the same values going into starting a company?

Carlos: Yeah, totally. I would say that you’re spot on, Hope. Making sure that you have the value alignment just in life generally is so critical just because when you are starting a company, your core values are so key to the success of the culture, and culture is everything, especially once you get 50 people or so. And that, I’d say, is one of the key things we aligned on. And then the other one — talking about hard conversations, which we had a couple of times. But figuring out how you are going to split the work is something founders sometimes avoid in the early days, but you have to have that conversation. And then also, “How are we going to split the equity?” That’s a really basic conversation that could lead to a lot of awkward situations down the line if you don’t have it early on. To anyone who is getting into a co-founder relationship, you can’t avoid those.

Fabio: To add to that. I love to say that Carlos and have a really great working relationship. I think we respect one another. We know what we are good at, and what we’re bad at. And with that, we can support one another and go through all of this journey of building a company together. And I think again, having a great co-founder is arguably one of the most important things for the success of a company. And although it is difficult, it is one of the most important early decisions you’ll make. And finding that right person that you can gel with, that you can have the right values with, and work together and see a long-term relationship and success with is really important.

Hope: Yeah. You mentioned knowing your strengths and weaknesses. I often find that we’re attracted to people that are similar to us, and yet that’s not what you want as a co-founder. You want someone who’s good at the things you’re bad at, and that’s a little bit of a stretch — sometimes it shouldn’t be your best friend who is exactly like you. Can you guys talk a little bit about some of the ways you complement each other?

Carlos: That’s a great point. Right? And it was one of the reasons, like Fabio mentioned, this professor was putting together people from the business school and the engineering school and the design school. Because most of what was happening at the time on Penn’s campus was, business school students would go try and start something together and engineers would go and start something together. And people weren’t really mixing, and Fabio and I were very fortunate to meet. From a skill perspective, Fabio is an engineer and I’m not. I can’t do what he does. And I’ve got the finance background, and I love product and sales. Where we overlap is that he likes product, but he can actually build product. Then also, just more broadly, it’s interesting from a personality standpoint, it’s good to have a balance, right? Like I’m more passionate, more excitable, you know, I have more highs and lows, and I live with the passion and energy of everything that’s going on. And Fabio’s just even and steady the whole way. And those types of things are really valuable as well. Because it’s good to have both and have that complementarity. And then, from a pure skills perspective, I really admire Fabio’s ability to just work on a process and be extremely organized. He can’t live without his to-do lists. We all joke at the company that if Todoist were to go down, I think Fabio would stop breathing or something because everything goes on a Todoist.

Fabio: It’s pretty true.

Hope: Well, let’s jump into what Tesorio does. And I always like to look at companies from the lens of the customers. You guys have a tremendous list of customers — really amazing logos and names.o name a few, we’ve got Twilio and Slack and Couchbase, Smartsheet and many, many others. What do your customers give you feedback on what they love about Tesorio?

Carlos: Accounts receivable automation is like the core of how we started. That’s the workflow bit. For those who aren’t as familiar with the back office as you were mentioning, Hope, everyone knows there’s big sales teams out there closing a lot of business, but then in the back office in finance, you’ve got maybe a handful of people. At a company as big as Veeva, you’re talking about 15 people. Slack when they got acquired for $27 billion, only had two or three people in the back office doing this. And what these folks are doing when I say, “doing this,” they’re following up with your customers to make sure you get paid. So, what the customers tell us all the time that they like is, “Hey, your product feels like it was built by a collector — like one of us built it.” And so that’s pretty exciting to see. And then when you look at the stats — our DAU/MAU, the daily active user over monthly active user, is actually almost 20% higher than Slack’s. So, if you use Slack a lot, which we all do every day, or some of us use Teams — imagine something that gets used 20% more by the teams that use it. Like literally doing your job is using this tool. Again, what people say and what they love is like, “Hey, this feels like it was built by one of us,” and then the stats back that up because it’s what they need to do their job.

Hope: One of the things I loved when I met you both was the fact that you talk in DAUs over MAUs, meaning how many daily active users versus monthly active users that is not a common KPI for a SaaS company. And yet it shows the engagement and the amount of time that your users are in your application. I think I’ve also heard you say, Carlos, that you want it to be the coffee mug experience.

Carlos: When we talk about that is, what we want, what we strive for is that this is the first thing you look at in the morning if you’re in finance. And for a lot of our customers, I kid you not, it’s one of their default tabs in Chrome. So, every time they open up Chrome, Tesorio, next to Salesforce, next to their ERP is one of the things that open up. The team started calling it the coffee mug experience because every morning you get your cup of coffee, you sit down and look to see what’s going on with the business. How much cash do I have? What’s going to happen? What’s going to come in? What’s going to go out? And if you can have that in one place, that changes your day, instead of having to look everything up in Excel. And that was really critical. I started earlier by saying that people use a product daily, and they feel it’s created by a collector. But that comes from a lesson we had — we pivoted to what we do today. We knew that there was a problem with cash flow. But we pivoted to what we do today in focusing on accounts receivable because we learned two things. First off, if you want to do something a little bit more strategic, you have to earn the right to do that. And by that, I mean originally, we started focusing on supply chain financing, given my factoring background. But what we realized is that what people really needed was a solution to their hair-on-fire problems. The strategic day two problems of how am I going to finance my problem takes a second seat if you don’t even know when you’re going to get paid, how are you going get paid, and you don’t know how to follow up with your customers. And so, when we were building Tesorio, I literally worked out of Veeva’s office for three months next to their AR team to see how they did their job and what they needed to solve their day one problems. And then, after that, now we’re getting to the place, right Hope, that’s part of the vision, where we can start forecasting your cash flow. And then part of the longer-term vision is then now that you are managing your cash flow day to day with this tool, then you’re forecasting what’s going to happen. Then you can get back to where we started, which is how do I finance it? How do I do things down the road that are going to allow me to grow the business in a longer-term lens? So interesting stuff, a journey that feels like we’ve come full circle sometimes. It’s been exciting

Hope: I love that you put a lot of good points in that. Number one, you guys have been maniacally customer focused, and that shows in your NPS scores, which are extraordinarily high for a SaaS software company, which is very impressive. The other thing is, you mentioned Carlos, how you need to solve the burning issue in order to get in. And then we’re going to move up the chain to the broader strategic issue. And I think that burning issue is also where you’re getting that strong engagement — the DAU vs. MAU — they’re loving your product, and they’re using it every day. One of the things that I observe in both of you is that while you are maniacally customer focused, you’re also really good at stepping back and not just responding to exactly what that customer is telling you they want — different customizations — but you are able to look across all of your customers and decide what would be useful for all of them, so you’re not just focused on one. Those are hard choices. Can you guys talk a little bit about moments in time where you’ve had to really focus your product roadmap on things that apply to all versus maybe responding to one request here and there.

Carlos: Yeah, definitely. Gary Wiessinger, who’s the head of product at NetSuite, once told me, “You can measure a product manager by how many times they say ‘No,’ more than how many times they say ‘Yes.’ And that ratio is really important. And that’s hard as a founder because you’re so passionate about building things, and you want to get your vision out there. And when you see people responding to it, you almost want to say “Yes,” “Yes,” “Yes,” all the time. There there’s been a couple of things. In the early days, one of our very earliest customers was Spotify, and they were very large. And they wanted a bunch of features that would’ve brought us toward almost like building a treasury management system. And one of the key things for us from the beginning was, again, learnings from having pivoted and just along the journey, was we just simplified as “Insights to action.” One of the core things we’re trying to do from an intelligent applications perspective is tie the insights that you get to the actions that you actually take every single day. So, building a TMS or treasury management system would’ve required a whole bunch of work that’s almost like just purely data aggregation. Let me pull data from all of these different bank accounts, put it in one place, and then forecast out my cash flow. But what was really important for us was actually aggregating the transactional data before it happens. So that means going to the finance systems of record, like your ERPs, your CRM, you’re procure-to-pay tools, where you can see cash flow is going to happen — cash is going to flow, but it’s going to be because this customer’s going to pay me or I’m going to pay this bill. And so, for us, building integrations to those systems was more important than building a bunch of integrations to banks, into FX platforms and that sort of a thing. And so that was one where it was really hard, you can imagine, to walk away from our second customer, who we flew out to Sweden to spend time with, and you know, we’re still really close with their whole team to this day and say, “We’re not going to do this,” because customer number two might want this, but customer number one and then 3, 4, 5, 6, 7, 8, 9, 10 don’t, and it doesn’t align with our vision. I still think back to how painful it was. True story — we were curling with the treasurer of Spotify the day they went public in Sweden. Like we were very close with them. But to say no to them was really difficult and it’s hard. But back, similar to your hard conversations with founders, there’s just a lot of hard choices you have to make along the journey. That’s probably one of the toughest — sticking to your vision in the right ways.

Fabio: And to add on to that, another thing that we had to do alongside making those tough product decisions is we still had to build the product in a way that would allow configurability within it. So, one kind of core product philosophy we have is configuration over customization, especially when we’re dealing with the types of large businesses that we’re working with. Being able to support them and their slightly different workflows and slightly different use cases in a way that is not just a bunch of customization has been something that we had to do from very early on. And it allows us to adapt to these types of larger, mid to large-size companies. And I think that was another key thing that we had to make a decision on pretty early on is that we needed to support this type of configuration and continue to expand and support that as we grew.

Hope: Such good examples. And you guys are just reminding me that part of being leaders in a company and founders is just a series of difficult decisions. I do want to come back a little bit to the fact that here we are on the intelligent applications podcast, and what is an intelligent application? It’s something that is enabling a workflow or something using AI or machine learning and really helping make things more efficient in the back office as well as smarter. That’s been something you guys tackle from early on in your solution. And so, I’d love to hear about how machine learning and AI are incorporated in your offering.

Fabio: Definitely As we’ve talked about here, historically, the entire accounts receivable process has been driven by tribal knowledge and spreadsheets within the accounting team. They know based on personal experience that a certain customer always pays 10 days late, five days late, while another customer is often promising to pay by a certain day, but then they can’t be relied on versus other ones can be relied on. Right? All that information is all tribal. It’s all just within the accounting, maybe even just within an individual. So, if someone leaves that company or is on vacation, effectively, that data is lost. And so, what we’re able to do, is take all that data and actually incorporate it into the product, so it’s not just siloed within individual people or individual departments. Our models are able to look across all of the customer’s payment history and determine, without human biases, when will they pay and also what will they do. Our models are trained across over 50 data points of anonymized invoice history. We’re covering billions in transactional volume to further refine and improve that forecasting accuracy. The product is able to learn from all these data inputs, both from a financial perspective and a behavioral perspective. We consolidate that all into our product and tying back to our integration strategy — which is that our system can connect to various different data sources from ERPs to billing systems, CRMs, emails, and everything like that — we’re able to consolidate all of that, bring all of the actionability and insights into one single place, learn from all of that data and then bring it so that users can actually take action. Cause one of the core things about our product is it’s not just providing insights, but it’s always tying it back to action, and what can they do about it? What can they do if their cash flow isn’t the way they expect it to or if the customer’s not paying them the way that they usually tend to pay? What can they do to affect their workflows affect their cash flows? And that’s been something that from pretty early on, we noticed was a problem with our customers, and we went out to solve that.

Hope: I love this phrase that Carlos talked about earlier, which is “Insights to actions.” So often in systems, you’re either a system of record — where it’s the system where you’ve got the data, and you’re doing the thing — and then you’ve got the analytics of that system of record. Very rarely do you find an application or software that allows you actually to do both? Where you can get not only insights but you can actually take the action there as well. And I think that’s really unique to your solution.

Carlos: That’s a good observation. Even databases are either transactional or analytical. And so that’s from a technology standpoint, that’s one of the things that’s been a fun challenge is figuring out how we have both — the analytical aspect tied to the transactional day-to-day aspect from a tech stack perspective.

And then, interestingly, just before we move off the subject, if I were a founder listening here, a little piece of advice I’d share is, when you’re building intelligent applications, there’s no like blanket way to do it. I think it’s really important to have the context of the culture of your customer base that you’re planning to address and the cost of being wrong. So that’s something that’s really interesting, like for us, we’re proud of our analytical skills, right? We’re finance people, Fabio jokes, but every single meeting — I think in 95% of meetings, I’ll open up Excel and start doing something right. And people joke, but it’s the way we like it. So, if we’re building an intelligent application for people who like analytics, you have to take that into account, and you can’t get cash wrong. So, for us, when we think about machine learning, AI, and all of that, we think about it in our world, at least, more as the supporting actor. The lead, the hero, is the user. And so, for us, that leads us to think, okay, more than here is your cash flow forecast, or here is how much we’re going to collect, it’s how do we pre-process the data so that you can go and make a decision. The really key thing is making sure that we expose enough levers for the customer so that they have ownership of the output.

And that’s something we even got wrong at one point. We thought we should forecast out the cash flow using machine learning, but it felt too black box. That was a really key learning for us — you know, having that context, and for the culture of your customer base, the cost of being wrong are going to influence how you apply machine learning and AI tools.

Hope: So, you took the next question right out of which is great. No, that was exactly where I was going to go. Us finance people like to think we’re good at forecasting, and we like to be able to explain our forecasting and explain what the levers are and what’s impacting it. With machine learning, the truth is it’s probably more accurate than us, and yet we don’t really want to admit it, and we want to be able to explain it. We don’t want it to be a black box. So, you do have a hard customer to sell to, to utilize this type of technology. And you and I have had that conversation, which is why we both led to this topic, and you’ve really addressed that well with your customer base by giving them more transparency and allowing them to feel like they are the heroes. I love that phrasing.

Carlos: Yeah. It’s interesting. When you look at cash in the bank, we joke that if it already hit your bank ledger, cash already flowed. So, that’s why we say we have to get to the things before it leaves or comes in the door. And that’s why all those integrations we talked about earlier are so important. And that’s what allows you to give them the ownership, right? If they’re addressing the cash before it goes out the door and they make the decision on how it’s going to go out and how it’s going to come in, then they can own the forecast and have an influence on it.

Hope: I want to turn a little bit to the macro environment. I know that we’re all watching the capital markets and the macro environment and how it impacts us, whether it be the funding environment or how does it impact our revenue line and our customers. And so, as you think about your solution set, has it become more important to your customers? Is it something they’re cutting back on? How do you think this period of time is impacting the demand for what you’re offering?

Carlos: I guess I’d summarize that we’re cautiously optimistic because I think we’re seeing some tailwinds rather than headwinds. Which, if you think about this from a purely analytical perspective, it makes sense. With inflation the way it is, every 90 days, it’s more than 2% of devaluation. And so, where does cash typically get trapped on a balance sheet? As we talked about before, you control, when cash leaves the door, you don’t control when it comes in the door. Receivables is actually one of the biggest places where cash gets trapped.

And so, every 90 days, your receivables are late, that’s cash you didn’t put to work and just devalued by 2% in real terms. And on top of that, it’s kind of a double whammy with the cost of capital going up. So as interest rates are going up and the cost of capital is going up, the inverse of that, as we know, is your hurdle rate, and the rate of return your investors are looking for is going up. So that cash that you’re not putting to work, if you’re not getting it faster in the door and deploying it, the opportunity cost of that is also going up. And then the market just in general, as we all know, is no longer favoring growth at all costs, they want sustainable growth. For a long time there, it was so easy to go get cash from other sources, and now that’s not quite the case. So, what we’re seeing is that this is more of a pain killer than a vitamin in a lot of ways, and folks also need solutions fast. That’s been a really critical thing, at least for us, back to the theme of intelligent applications is how can you get these products deployed quickly? Because an intelligent application that’s going to take a year or two to get deployed might have great ROI someday in some spreadsheets, but it’s not going to help me achieve my goals now. And so, a solution like ours that can get in there quickly on average, 30 days to get live and 60 days to show ROI, that’s something that folks are really valuing and that you’re seeing today — folks need these solutions before their next earnings call, not by next year.

Hope: Yeah, I think we go back to something we said earlier in our conversation, which is cash is king. And when the economy gets tight, and tough cash becomes even more important. And therefore, the solution that you’re offering is paramount. I want to step back a little bit and talk about broader technologies in this space. And as you think about this space, what is a company or a startup or interesting technology out there that you two are both excited about?

Carlos: I’ll share one that changed my day-to-day. I think Clockwise was really cool because you just plug it, and it automatically starts allotting focus time. And you set rules around meetings and time between meetings and that sort of a thing. And it changed my life from just feeling exhausted at the end of the day of going back-to-back-to-back Zoom meetings, because we’re a distributed company, to actually having breathing room in between to get in the work that I need to get done.

Fabio, I know we’ve talked about another one. I’ll let you take the next one because it’s definitely more of a tech nerd out.

Fabio: Yeah. Yeah. Obviously, a lot of the IA companies out there are very CTO friendly, and the one I admire and I think is doing really cool work is Fivetran. Every company, as we already know, has a problem with getting data into a single place — it’s ETL, especially if you don’t have engineering resources. I found Fivetran is a really cool product that allows companies to actually connect all of their data streams and try to consolidate them into one place. And why I also think this company is cool is because it’s a little bit of a reflection of our product as well. We consolidate data from all these different financial, CRM, billing, email data sources for our customers to use, and Fivetran is doing similarly for their customers so that they can get their internal data together. It’s a really cool piece of tech and a pretty exciting company.

Hope: I love it. And then, so those are existing companies, as I think, five years out, what are some technologies that are coming to pass or things down the pike that you really think will disrupt how we do work today?

Fabio: You know, on my end, augmented reality, I think, is one of the biggest sources of the kind of technological disruption and innovation that’s going to come up soon. I’ve always felt that the same way smartphones changed the way we live and work, augmented reality is going to be that next big leap that’s going to really change the way we work and live.

Hope: So, we’ll end on lessons learned. And I know I certainly have a lot of them in my past history. But as we indicated before, a clear observation is that being co-founders, being CEO and leaders of a company is just hard. And I think it requires more persistence than anyone ever realizes — that ability to climb over any wall that’s put in front of you. I’d love if either one of you would be vulnerable enough to share some lessons learned with other founders and words of wisdom.

Carlos: Yeah, I think for me, the most important lesson just looking back is realizing that you’re never done. As a founder, you feel this extreme urgency. In the early days, someone once told me if you’re asking yourself if you’re moving fast enough, you’re not. But you know, at the sacrifice of what, right? Before being founders, we’re people. We’ve got families, or we’re in relationships. And sometimes I think for a very long time, in most of the early parts of the journey, or until recently, I kind of worked like there was no tomorrow, you know, working till every hour at the end of the day and at all times of night and giving up sleep and all of that. And then, eventually, it clicked. You never really de-risk the company, you just attain new levels of relatively higher stakes. So, even though you think you’re going to do this, and then you’re going to be all good, and you’re going to be done, and I have to do this now and forego a lot of things — I’m not going to go to the extreme of saying that you’re ever going to have good work-life balance as a founder. I don’t think that’s part of the job description at all — but realizing that there’s always going to be more to keep doing tomorrow is very critical. So, at the end of the day, I guess what I’m getting at is, to take care of your health, take care of your personal relationships, and remember that because it’s a long journey.

Hope: Yeah, it’s a marathon, not a sprint. and I think people go into startups thinking it’s going to be this sprint-like event. When really, when you look at the companies that have gotten to scale, it takes 10 years. It truly is a long road and a marathon. And you have to manage that in a healthy way. Fabio?

Fabio: The most important lesson I’ve learned throughout this entire startup journey is it, maybe it sounds a bit cheesy, to be honest, but I think it’s very true that — the people you work with matter the most. And I think it obviously starts with your co-founder and the relationship you have, but it quickly grows. It grows to everyone in the company, the board, the VCs you’re working with, everyone. And who you work with, I feel, has one of the biggest impacts on the success and outcomes of your startup. I believe that finding the right set of people, the early employees, your early investors, and your co-founder will have such a large impact on how things will go. And I have truly felt very fortunate to have this opportunity to work with such brilliant people. It’s ultimately what excites me most about the entire startup journey.

Hope: Those are great words to live by and great words to take to heart. Carlos and Fabio, thanks for spending this time with me together today. I always enjoy it when I get to have a conversation with both of you, and this was right in there, so thank you so much.

Fabio: Thank you.

Carlos: Thank you, Hope.

Coral: Thank you for joining us for this IA40 spotlight episode of Founded and Funded. If you’d like to learn more about Tesorio, they can be found at Tesorio.com – that’s T-E-S-O-R-I-O.com To learn more about the IA40, please visit IA40.com. Thanks again for joining us, and tune in in a couple of weeks for our next episode of Founded and Funded with Battlesnake Founder Brad Van Vugt. We’ll be spotlighting another IA40 winner next month.

Cresta Co-founder Zayd Enam on Using AI to Empower People to be More Productive

Cresta Co-founder Zayd Enam

In this episode of Founded & Funded, Investor Ishani Ummat talks with Zayd Enam, Co-founder and CEO of Cresta AI, one of our 2021 IA40 winners. The two dive into the important topic of how AI can be used to help empower people to be more productive, specifically in the context of call centers — or now more commonly referred to as contact centers — because they include much more than phones.

We hear the story of why Zayd dropped out of his Ph.D. program to pursue launching his own company based on what he explains as the “schlep blindness” of contact centers. He also discusses the unique way he landed his first customer, which happens to be Intuit, one of the largest financial software companies in the country, and the benefits of taking a modular approach versus a full rip and replace of a customer’s entire system.

This episode may make you crave a Costco hot dog, but you’ll have to listen to find out why.

This transcript was automatically generated and edited for clarity.

Ishani: Hi, everyone. I’m delighted to be here with Zayd Enam today, the CEO of Cresta AI. Cresta is a productivity suite for the modern contact center that leverages artificial intelligence to drive a better customer experience in real time. We’ve all struggled with contact center experiences and so we’re really excited to have Zayd here to talk about the unique angle that Cresta takes.

Cresta was selected as a top 40 intelligent application by over 50 judges across 40 venture capital firms in 2021. A quick moment on that. At Madrona, we define intelligent applications as the next generation of applications that harness the power of machine and artificial intelligence to create a continuously improving experience for the end user and solve a business problem better than ever before.

Zayd, we’re super delighted to have you with us today.

Zayd: Awesome. Thanks so much for having me, Ishani.

Ishani: Why don’t we start it back at the beginning. Cresta was formed out of Stanford, but I believe you dropped out of your Ph.D. program. Tell us a little about the work you were doing and how that led to the founding of Cresta.

Zayd: In the Ph.D., I was working on how artificial intelligence can be used to help empower and augment people and make them more effective in their day-to-day work? Originally, I was looking at applications of artificial intelligence for things like helping graders and teachers grade assignments more effectively and be able to give better feedback to students based on the most effective feedback and based on common mistakes. It was really a thread of a lot of the work that was done in the early ’80s at the Stanford AI Lab where this concept of intelligence augmentation, which is pioneered by a lot of the folks that started that lab. And it’s a continued thread of work in terms of understanding how humans can be bicycles of the mind and extensions of bicycles of the mind. What ended up happening is I built software for teachers and grading assistants, and I built software for email and both those directions of the project, ultimately, didn’t lead to success. With email, what happened is at six months after I built it and I got a bunch of people in the Stanford building using it, Google released their smart buy project.

The day Google released the project, like 20 people messaged me that link because they had this big PR announcement. It was clear that Google had a data advantage there in the sense that they have access to billions of emails to train these kinds of models on. So, then I pivoted to graders and teachers, and there, the tricky thing is that a lot of universities and schools aren’t ready to adopt software. It’s just a slower market to try to get traction in. I ended up working with a bunch of offices in the Bay Area. I’d go sit down with someone and just observe the kind of work they do on a day-to-day basis. The goal was to build small tools to help augment or help automate basic things in the workflow. I started working with these sales and support teams, and, just as a grad student, I could sit down with a sales and support team and basically build these systems that would understand the effective way to resolve an inquiry or the effective way to have a conversation and provide these real-time prompts that guides someone through the conversation. At the first company I worked with while I was a grad student, within a few weeks, we were generating $100,000 more of sales per month — that’s more than $1 million per year. It was clear that there was opportunity here from a business perspective. And so, through a whole process, I decided to drop out. Because there’s something core to this, where there’s a lot of value to be delivered, it turned into this overall vision of using artificial intelligence to help empower people to be more productive. And it felt like a great place to start. And that’s ultimately how I got there.

Ishani: So, in many ways you were able to do the super early stages of customer discovery while you were in your Ph.D. program, spending time with different kinds of customers and mitigating a couple of these issues that we see. You know, you and I were talking about GPT-3 earlier — lots of people have good applications of big models like that, that feel like solutions in search of a problem. And the way that you got to spend your time doing this early customer discovery and building smaller tools for them was starting to figure out, okay, where is there a problem where I can really apply a solution that I know how to build, and I can build in a small way and create a wedge. So, a couple of trends there where you need to figure out 1) what’s a real problem to go solve. And then 2) where do I have a unique advantage to go do that.

Zayd: Right. And that’s a philosophy of my co-founder and Ph.D. adviser at Stanford — a gentleman named Sebastian Thrun. He started the Google X project and Udacity and won the DARPA Grand Challenge in 2006 with the first self-driving car. And his philosophy and what he teaches in his labs is basically that in order to go build a self-driving car, you don’t sit in the lab and research the future of computer vision, you go out in the Mojave Desert and figure out how to get those kinds of systems to work and then come back to the lab. And you’ll actually realize that you’ve made some fundamental breakthroughs in the technology and the engineering systems associated with it. That’s the same thing that happened with Cresta in terms of working with companies and identifying how can we make this really work for the customer and then coming back, understanding what are the fundamental technological breakthroughs that happened in terms of making it really work for the customer.

Ishani: It feels related to this concept of customer obsession. Madrona was one of the earliest institutional backers of Amazon. I know you think and talk a lot about customer obsession. Take us along the journey. You leave the lab. You start Cresta. What drove the decision to focus on contact centers? Contact centers are amazing. Notoriously bad experiences, long wait times, low NPS. You’ve shifted from call center to contact center, and that means that you have digital as a new modality and email and all these other components, but still, lots of friction. And everyone interacts with a contact center, right? The vast majority of businesses have them. The vast majority of customers are talking to them and interacting with them in some capacity, but it’s not obvious, necessarily, that augmenting humans who work at contact centers is a business to then go build. So how did you zero in on that as a customer segment? How did you obsess over that? And then talk to us a little bit about that first customer journey you had.

Zayd: I mean, the thing is they’re not particularly sexy, right? So, it’s not like a Stanford Ph.D. says, ” Hey, I’m going to go focus on contact centers and understand how these technologies apply and drive tremendous value or transformation there.” There are a few secular trends happening in general in the last couple of years where folks are rearchitecting their systems from on-premise to cloud-based systems. And you have folks adopting these multi-channel experiences, whether it’s phone, chat, email — it’s a space that’s going through rapid transformation right now. Because NLP and deep learning have transformed so much and are progressing so quickly that what’s possible in software now is just dramatically different than what was possible just a few years ago. So, you have a lot of change happening in the space and you have a fundamentally new solution set with deep learning. And it is just an opportunity there. That’s an analytical answer. I think the more emotional answer actually just was that, so Paul Graham has this essay in Y Combinator about schlep blindness. He talks about when Patrick and John started Stripe, everyone was building these niche social networks and these niche travel websites, and no one was solving the payments problem on the internet because it felt like a lot of schlepping around. To do it, you’d have to go deal with legacy APIs of banks and deal with how to do partnerships with banks and these kinds of things. But every website in the world needs some way to take payments if they’re doing business on the internet, and the experience was terrible. And I felt the same way about contact centers. It felt like a lot of schlepping around. You’ve got to figure out how you integrate into all these systems. It’s not exactly the most exciting part of the business for a lot of people. But the thing is, every company in the world has some way to interact with their customers, and the experiences right now are terrible, right? Where the average employee NPS within a contact center is less than zero, average customer experiences are very poor in terms of the way that they interact with contact centers. So, everyone has something. No, one’s happy with it. And I have something where I could, within a few weeks, have an impact on a team. Even though it wasn’t the dream of the Stanford Ph.D. to go work in the contact center, it felt like a lot of schlep blindness in why people were avoiding the problem. And so, I was really excited to lean in and solve that problem.

Ishani: Yeah. And I mean, by the same token of Paul Graham and the Y Combinator reference, you know, every incubator will tell you to stay away from the enterprise. Right? No one will tell you to go and drop out of your Ph.D., start a company, and then go sell to the big enterprises at the get-go. How did you even begin that early customer journey of getting someone to sign on?

Zayd: Yeah. Another Y Combinator advice, which is, don’t do big deals. But I think one of the most important skill sets is figuring out what advice applies to your situation and what advice does not apply to your situation. So that one, I don’t think applies. For Cresta, the market for artificial intelligence makes a lot of sense to start an enterprise because that’s where you have these teams of contact center agents with more than 250 people. And you’re able to use artificial intelligence in a way that can capture repetitive patterns across the conversations that multiple people have, and that’s where you can provide the most value and the largest segment of the market on which to make an impact.

Usually, it’s hard to go to enterprise because they have a bunch of requirements to go engage in that business and have an impact there. So, people often start mid-market or SMB segments of the market. This is where I was slightly unconventional — I tried cold calling and prospecting in terms of getting our first customer, and it wasn’t getting much traction. But then, through Scott Cook, I cold-emailed him after a presentation, and I got this meeting with the CIO of Intuit. And I went down there to present Cresta and the results that we had in terms of my Ph.D. work and asked him, “Hey, I’m starting a company in this space, and I’d love to work with you as our first client.” He said, “This really ties into the Intuit strategy. This is what we’re trying to do from an AI perspective, and this is a really great project, but we can’t work with you because you’re a one-person company, and we’re Intuit, we’re the nation’s largest financial software company, And we can’t really work with a company like yourself. But if you want to sign up as an intern to my group, you can sign up as an intern for the summer. I took him up on the offer. Once I got in, I got access to their data systems and basically worked with them on the technology and deployed the first software to their group in Tempe, Arizona. And the first person to use it was actually one of the top salespeople there, and he loved it so much that he got the rest of the team to start using it. The whole team’s performance doubled in a few weeks. And so that’s when they were looking at it and saying, okay, now we want to take that team and expand it to this other bigger team in Virginia. That’s when I went back to them and said, “Hey, this is now becoming a really serious project, and you probably want some sort of enterprise agreements around this. We came to a standard SaaS agreement, the only addendum being that this clause hereby terminates Zayd Enam’s internship. Then I had to sign as the CEO of Cresta and then as a former intern at Intuit, which is a fun reminder of that contract every time it comes up again. But yeah, that’s how we got our first customer. And then, once we had that case study, we were able to go to more enterprises with that credibility.

Ishani: That’s an incredible story. And I think YC needs to write that into their playbook around how you go build a first enterprise customer. First of all, most startups don’t go to enterprise, but if you’re going to go to enterprise, follow the playbook that Cresta lays out.

Zayd: Yeah, I think you learn a lot, and I think you do things that don’t scale, right? So, take an internship at a company — that’s something that doesn’t scale.

Ishani: No, definitely not. But I think it really does take customer obsession to a whole other level — around being able to go in and understand and see how these data are collected and see how people are using them. And then how they’re able to use something that you can build in the duration of an internship, even to increase performance and double it in this case, then actually take that out into the real world and say, okay, that’s great validation. Now I have the comfort to go build a company around it. And the proof points, right? And then, by the way, you also start with a great contract.

Zayd: Yeah.

Ishani: One of the things you mentioned is this concept of building on existing infrastructure versus designing an entirely new user interface. And what I mean by that is you talk about integrating with all these systems that already exist in contact centers, right? They have agent-facing software. It seems like you’ve taken the approach of building on top and integrating with that rather than having contact center agents focus on learning something new. From a product perspective and from a utility perspective, tell us about that decision and how it’s worked out so far.

Zayd: Right. Our approach is to peacefully coexist with existing systems and infrastructure in the contact center. And that strategy really is just, there is a lot of different underlying systems and topographies in the contact center, a lot of different C cast platforms, a lot of different CRMs and knowledge bases of these kinds of things. Some folks take the approach of a full rip and replace where they recommend that they come in and replace your entire system. And our belief is that’s likely not the right approach. What we have is a modular approach where we can come in and integrate with your existing systems and take you to the future state of the contact center piece by piece by one module when you adopt another module will get more value from the second module because they amplify each other. But you don’t need to rip and replace your entire system to do it. It’s a lot of pain, a lot of implementations. You have to build more integrations. You have to spend more time on some of these edge cases and these kinds of things. It’s more effective and efficient to start with one piece and see the value from that and then expand over time.

Ishani: Especially when you think about going to the enterprise, right? It’s unlikely that you get a Fortune 100 company that’s going to rip and replace their entire existing system for you if you’re even a 50-person company. I really love how you lay that out and saying, “Hey, actually, this is worth a lot of investment from your end because there’s clear ROI.” And in your case, doubling performance and being able to demonstrate that feels like a very clear path to demonstrate for an enterprise buyer that there’s a specific return for buying Cresta.

You’ve alluded to this a couple of times in terms of different modules of the product, maybe just contextualize. Cresta started as this sort of augmentative tool for contact center agents. Where’s the product today? If I’m an end user at a big enterprise, how have I adopted it? And what exactly does Cresta do for me?

Zayd: Yeah, so we started as a real-time agent coaching and assist for chat — sort of, how do we help chat agents more effectively and more efficiently handle sales and support conversations? Over time, we built a full platform. It Really pieces together all the different components of what an intelligence layer and an intelligence suite on a contact center should do. The way Cresta works is we have an insights product that is understanding your conversations, understanding what makes things effective. Why are your top performers performing better? And what behaviors do they do that make them effective at that? And that’s giving you insights on how that’s changing over time. And then, we are able to take that and have a set of actions through real-time coaching and post-call coaching that help democratize those behaviors across your entire team. So, we figure out what makes your top performers really good. And then, we’re coaching everyone across the team to help them be as good as the best. And then, we take those top performers and we’re able to make them superhuman because we have stuff like automation and efficiencies like summarization and these features that drive these kinds of superhuman efficiencies of the team, because all of a sudden you can summarize a call, or you can automate a call or automate a workflow that takes less than a second when it used to take a long time. That’s the core loop of Cresta. And then, we go back to insights. We identify what’s working, what’s not working, how customer sentiment trends market’s changing. And then go back through the loop again in terms of democratizing the behaviors that lead to better results and driving automation that lead to superhuman efficiencies.

And it’s that virtuous cycle that goes to the contact center and it’s a platform that each piece can be adopted in a modular way. But then, as you adopt each piece, it adds value to the other piece. And when they put all the pieces together, it becomes a powerful engine that drives compounding benefit for the business.

Ishani: Absolutely. We would call that a flywheel effect. That the more you use Cresta, the better it gets. And in many ways, this is perfect for our core concept of what an intelligent application is. The idea that you’re building a core machine learning-based product that gets better the more that you use it. Versus, I think a lot of companies out there today are building AI and ML, but they’re kind of retrofitting to a product and using AI and ML to optimize it overall and over time. Whereas the concept of starting with a core machine learning-based and intelligence product that enables your users to get better, but then also actually becomes better as a product because of that feedback loop and iterative cycle, is really, I think — The next generation of companies are going to have to be built that way.

Zayd: It’s certainly not easy, but it’s something that compounds over time. Then it becomes more and more powerful for a company. And the folks that adopt it end up outcompeting the folks that don’t, so you’ll see teams and individuals that are empowered with these kinds of systems are going to produce dramatically more, and they’re going to outcompete teams that don’t, and over time, we’re just going to see this play out where teams that do this versus teams that don’t do this and it’s a competition that’s already getting started.

Ishani: That’s a good insight actually, Zayd — that not just is the next generation of companies, intelligent applications versus predictable SaaS applications, but rather, also customers that are using intelligent applications have a wedge and a differentiation component over their counterparts that are just using SaaS tools.

Zayd: Yeah, that’s what makes it exciting. I think it’s a fun time for the industry. It’s a fun time for technology. And it’s one of the things that just makes it fun to build at this time.

Ishani: Agreed. And let’s get a little bit more specific than just around how you build this intelligence layer. What’s the approach to data, for example? There are lots of customer conversations available to you, once you’re in a customer and you get maybe a transcript or set of data that they have on existing customer conversations. How do you start? How do you continuously train that model, learn from each of those conversations? And actually make sure you’re delivering an accurate, great result to the end customer and surfacing the right level of insights of what good looks like.

Zayd: One piece to that is basically we get the conversation transcripts, the audio, and then we tie specific outcomes to each conversation — was this a positive outcome in terms of, if it’s a sales use case, was it a close one or what was order value? What was the upsell rate? These kinds of things. And if it’s support, is it a first call resolution? What was the average channel time? Was it high CSAT, high transactional NPS. So, depending on the outcome the business is looking to optimize for, we’re looking at those outcomes and tying it to those transcripts. And then we’re training models. And so that then gets to one of the core differentiabilities of Cresta, which is that we’re building infrastructure to make it possible to train tens of thousands of custom models for many enterprise customers where our vision is Cresta provides the Costco hot dog, which is like a factory to build these custom models for many customers and the infrastructure internally in the tooling, internally around conversation designers and labelers and machine learning engineers that produce high-quality models trained for that customer and keep them up to date regularly. That’s a hard challenge, but that’s something that we are specifically investing in from a tooling perspective. And we’re seeing the results of that payout because we’re able to deliver a model that understands a customer’s conversations. So, we can get to the specificity of why a customer doesn’t or does buy from Verizon in terms of they’re having an effective conversation and up-sell. Versus something for a different customer. They’re able to train a specific model that helps that specific company become more effective in their sales conversations.

Ishani: Super interesting. How do you view the role of these increasingly new and increasingly powerful pre-trained models? When you go to do that. For example, I could imagine you taking a pre-trained model that’s a, maybe more rules-based type of engine when you go into a customer initially. And then, of course, creating all these derivative models on top of that, maybe for specific customers, but also maybe even for specific use cases within customers.

Zayd: So, pre-train models are powerful, and we’ve known that for a long time — more than probably I’d say a decade now. The thing, though, is that when you take a pre-train model and you’ll fine-tune it for a particular application, what ends up mattering more than the amount of data that you fine-tuned on is the quality of that data. So, are you training on high-quality examples? And are you training on high-quality labels that truly get to the root of what you’re trying to train the model on, and that’s where you need the right infrastructure and tooling to label and design effectively. And make sure you’re encoding best practices effectively into the model.

So, pre-train models give a boost across everything really, but by themselves, I think they’re useful as toys in which, and toys soon become very serious business applications, but to really leverage them as business applications, you need to have a set of infrastructure around it to really control and fine-tune it with specifics of what you’re trying to do. And that needs to be high-quality and effective data.

Ishani: Yeah, you’re giving an example to this concept of garbage and garbage out, right? That if you’re training your model on, in this case, Cresta’s model, on bad customer interactions, of course, that’s the guidance that Cresta is going to give you is, is bad. But if you figured out a way to scalably and effectively label customer conversations that are really good and train Cresta’s model on that, then Cresta gives you really good recommendations. So, it’s just a good way to then think about, okay, you have to have a data strategy and the infrastructure and tooling, as you say around it, that is really robust. Even if you already have the machine learning components, the data really does matter as a differentiator here.

Zayd: Yeah. That becomes fundamental to this Costco hot dog approach.

Ishani: I think if I take away nothing else, there will be two analogies here. One is to go intern at a company to get a customer. And two is create a Costco hot dog.

Zayd: Yeah. Our head of engineering — this gentleman named Ping Wu — he’s very passionate about Costco hot dogs and how their inflation uh, resistant. And so, that’s the vision for Cresta.

Ishani: Real-world analogies help a lot.

Zayd: Yes.

Ishani: Tell me on this tooling, an infrastructure component, what’s out there that you’ve been able to leverage in terms of software and structures that exist versus some of the things you’ve had to create that are big hurdles for you to get data to, the right insights for Cresta.

Zayd: I think right now we’re still very nascent in terms of the whole stack for data and machine learning operations. Because there are no best practices really established, and it’s tricky, right? Because it’s not as mature as other industries in terms of like, this is how you build this type of application. For us, we’ve built, I would say, almost everything in-house, just because of the specifics of our application and the relative latency of tooling and infrastructure in the ML space. That makes it an interesting problem. I think over time, it will settle, and the space will mature, but right now, there’s gaps in open-source tooling. I mean, there’s a lot of great stuff happening, but I think it’s just a while before that stuff matures to the level that we can standardize on it.

Ishani: It’s a little bit surprising that you say that. Lots of companies I know are building off some of these open-source projects, but as you say, there’s gaps. And so, is the gap in stitching it all together or is it just that they don’t serve enough function? They’re emerging and nascent and exciting, but they’re features and not platforms.

Zayd: Yeah. Our data model in terms of conversations and outcomes, and these kinds of things, let us build in specific ways. We leverage in our stack, everything from the cloud providers to Kafka and Kubernetes and all these things. But as part of our stack approaches the machine learning aspect to it, and the process of labeling and training and regression testing and automating machine learning delivery, and production, all those things. Those are things that we’ve built in-house. I think over time, we’ll see more and more of that probably get adopted across many companies, but that’s the state of where we haven’t quite found something that truly hits the nail in terms of what we need.

Ishani: That’s awesome. Maybe there’s more opportunity, right? For all the folks listening that work on MLops, that work on building the infrastructure to get to an endpoint iterative machine learning-enabled application, it isn’t quite there yet. The industry hasn’t converted on something, so it feels like a good opportunity to go and understand, and obsess about com companies like Cresta, right? If the next generation of end customers may also be intelligent applications, then we should go be building for those intelligent applications too.

Zayd: Yeah. I think the promise is there, and I think there’s a major opportunity here to standardize and build this part of the stack. I just think it takes a while to have code bases that become mature and solve the problem and the right approach to it. And so, whenever we’ve looked at these things, there’s always something missing. But I think the opportunity is there. There’s definitely a market opportunity there for sure.

Ishani: Well, and in the interim, you’ve been able to build the infrastructure internally and then also create this company that is an intelligent application. But then also part of the core of what you talk about is enabling humans to work alongside technology really well, harnessing the power of automation. It seems like a deliberate choice by Cresta. You know, people talk a lot about AI automating away jobs, but in this case, I think you view it as strongly humans and technology working together side by side. Where does that come from? How much of that is the idea that we’re not just quite there yet on technology and in terms of conversational intelligence side, and it is just not quite good enough. And how much of that is a deliberate design choice working with your end customer and those partners?

Zayd: I think it’s a fundamental principle all the way back to my Stanford thesis, which is the focus on intelligence augmentation and really the concept of the bicycle of the mind. And I think to some extent, there’s a way to look at artificial intelligence and I sometimes characterize it as lazy artificial intelligence, which is that you take an existing process and you say that I’m going to automate this process end to end, and I can use some kind of automation or some kind of AI to go do it. But that kind of overlooks, what’s possible when you approach it more creatively. And in that sense, you kind of look at AI as a building block — how does this capability combine with humans unlock things that just weren’t possible before? And that’s a fundamental approach that we took. It’s been our goal and our direction in terms of that, this is what we believe is the right approach to this and ultimately results in larger upside and larger potential. And especially in our application, there’s, yes, we’re not at human-level AI for conversations, but even then, there’s opportunities for humans to have a continuous and big impact in terms of the companies that they work with.

Ishani: If you play it forward 10 years, how much more or less are humans involved in the contact center process?

Zayd: Our vision is that you get to this point that you have this concept of experts on day one. So, folks come into an environment and within the first day, they gain this expertise of all business information and all the knowledge and subtleties of their particular environment and are able to use a whole set of support and decisioning systems to get to the right decisions and the right effectiveness in their role. And what they’re bringing to the table is creativity in terms of understanding how to approach something that isn’t encoded in the patterns of the data yet. They’re bringing that creativity to the table, and they have a whole support decisioning system that’s helping them be that expert on the first day. And as soon as they’re able to encode and establish a best practice through their creativity, that becomes a part of the system again. And then the human is just focused on the next thing and the next thing. And so, our approach with these kinds of augmentation systems is that we’re constantly figuring out what’s the best practice, what’s really working, what’s effective, building support systems and information systems that can help deliver that scale to many people, and then figure out how could the humans continuously act as in some ways like a mutation process, that’s identifying what’s a new thing and what’s the creative approach to this problem. And then keep doing that and you just build a system that just gets smarter and smarter.

Ishani: A bit of a separate question. If I look at the investors around the table of Cresta, you’ve got folks like Greylock and Tiger Global that more traditional institutional venture investors. All makes good sense. You also have a coalition of investors from kind of legacy industry players. How has that experience played out? You know, having strategic involved can always be a little bit of a double edge sword in terms of having folks around the table. Tell us about your experience.

Zayd: We’re really fortunate to work with great partners from an investor perspective. So, in this last round, Genesys, Five9, and Zoom invested in Cresta. We have great partnerships with those folks in terms of leveraging Cresta on top of the platform to really see a big impact for their businesses. We’re seeing go-to-market acceleration through those partnerships, and what that really has done is mark our leadership in this space in terms of this real-time intelligence for the contact center.

Ishani: Super exciting. Yeah, I think investors can represent impactful connections, powerful networks that enable you to, again, just build more of a flywheel. Right? So, I love that concept of solidifying you as a winner in this space.

We typically end these podcasts with a lightning round of three questions. So, I’m going to shift into that. First, aside from your own, what startup or company are you most excited about in the intelligent application space and why?

Zayd: Oh, that’s a good question. I think Tesla is doing some very interesting things overall in terms of how they’re approaching autopilot systems. I’m not sure if it counts, but I think that vision is something that will take that company far, I believe, in terms of the way they have this loop for model predictions and data collection. I haven’t quite seen other startups operate at that level of data flywheel. And I think that’s the right approach.

Ishani: Love it. Question two, outside of enabling and applying AI to solve real-world challenges, what do you believe will be the greatest source of technological disruption over the next five years?

Zayd: Some of these contact centers are still working on these green screens with these old ’80s-style computers. And it feels surreal, but the cloud hasn’t actually fully happened yet. And a lot of companies are working in all kinds of different environments. I think that just better systems, better cloud systems, better UX, better integrations — that stuff has a big impact. We see with our customers as well that the AI has a lot of value, but they also get a lot of value from just better data integration and better UX to do their day-to-day workflow.

Ishani: Yep. The concept of customer obsession going and being on-site and visiting your customers and being integrated in them, even at the intern level, really gives you a real-world perspective for how true that is and how much the install base of technology takes a while. And a couple of cycles to come up to where we think about it, whether it’s in an academic lab or as a startup CEO, or as an investor,

Zayd: Right. Agreed.

Ishani: Final question. What is the most important lesson — you know, maybe something you wish you did better — that you’ve learned over your startup journey so far?

Zayd: So, I asked Scott Cook this question and I think the biggest one is probably self-awareness. And I think if you unlock self-awareness, then a lot of other things can happen in terms of development as a leader and development just as a company. I think understanding your own weaknesses, understanding what you need to get better at, and then approaching those things with the growth mindset, that becomes really fundamental. It sounds a little fluffy or psychobabbley, but I think it’s true.

Ishani: Awesome. Zayd, thank you for talking about Costco hot dogs, interning at your company, growth mindset, and the next generation of machine learning ops. Super appreciate having you on the podcast and your time today.

Zayd: Awesome. Thanks so much, Ishani.

Coral: Thank you for joining us for this IA40 spotlight episode of Founded and Funded. If you’d like to learn more about Cresta, they can be found at Cresta.com — that is C-R-E-S-T-A.com. To learn more about the IA40, please visit IA40.com. Thanks again for joining us, and tune in in a couple of weeks for our next episode of Founded and Funded with Tesorio Founders Carlos Vega and Fabio Fleitas.

CommerceIQ’s Guru Hariharan on Hard-Learned Lessons From Successful Pivot to Unicorn

In this episode of Founded and Funded, Managing Director Scott Jacobson is talking with CommerceIQ CEO Guru Hariharan. CommerceIQ is a retail e-commerce management platform that automates and unifies category analytics, retail media management, and sales and operations all under one roof. The company secured $115 million in funding in March and just made its first acquisition — e-fundamentals — to expand into digital shelf analytics. The acquisition actually brings the company around full circle in a sense. CommerceIQ was originally Boomerang Commerce, which was a dynamic pricing software for multi-brand retail companies to better compete with the likes of Amazon. But Guru realized that despite the quality of that software and the A+ team he’d pulled together, he was trying to grow a business in an F market. He ended up pivoting the entire company to what is now CommerceIQ, selling the Boomerang business to Lowe’s. Scott and Guru dive into what went into navigating those turbulent times, what it takes to be a vertical SaaS company, and Guru’s realization that he couldn’t solve every problem as though it were a math problem.

This transcript was automatically generated and edited for clarity.

Scott: Hi, everybody, I’m Scott Jacobson, Managing Director at Madrona Venture Group, and it’s my pleasure to have Guru Hariharan, the Co-founder and CEO of CommerceIQ, here with me today.

Guru: Thanks, Scott. Thanks for having me. It’s a pleasure to be here.

Scott: Yeah, absolutely. So, for everyone who doesn’t know CommerceIQ, which is an ever-smaller part of the world, why don’t we start with what your product does? What problems does it solve for your customers? What’s the market opportunity you’re going after.

Guru: CommerceIQ is an AI platform that assists brands and agencies with their digital transformation to essentially help grow their market share and grow sales in a very profitable way. We call it retail e-commerce management platform — REM that’s the category we are creating. We are essentially helping every brand of the planet move from analog to algorithms.

Scott: You and I have had the opportunity to work together for many years. Madrona is a very happy investor in CommerceIQ. And certainly, my experience as an investor is that most great startups have very non-linear paths to success. CommerceIQ has a particularly non-linear path to where you ended up today. I think it’d be fun to unpack that. So, you raised your first round of venture financing, and you were solving a different set of problems for a different customer. Maybe start with who is your original target market? Why did you start there?

Guru: What we ended up starting out with was Boomerang Commerce which was going after this market for multi-brand retail. In fact, even rewinding back a little bit, this was my 18th iteration as a founder. For the first two years, I was iterating with a lot of ideas. I actually had a prototype for what is now Etsy. I had a prototype for what is now Viva — a sales tool for pharmaceutical companies… things like that. I could go on and on. But eventually, I realized that one has to connect the dots, as they would say. There has to be a founder-market fit. And for me, it was e-commerce. And for me, it was machine learning. It was the intersection of those two things because academically, I’m a machine learner and professionally, I’m an e-commerce guy. So, I kind of went back to my roots. Having worked at Amazon for multiple years, I had actually seen the power of algorithms. How algorithms could beat any human-dominated system. And that’s what Amazon did. We did an amazing job, and we got. Market share in almost every category by just putting algorithms to work. So, I kind of went back to those roots, and I said, “Wow if Amazon could do something like that, there’s gotta be an opportunity to go create algorithmic software for retail in general.”

We looked at multi-brand retailers — companies like say, Staples and Office Depot, or even Walmart and companies like that. And there was definitely a lot of room for improvement over that was crying out loud for some sort of innovation. So, I left my day job, and I started the company. And after these 17 iterations, the 18th iteration was a dynamic pricing software, and that hit the mark. And frankly, it hit the mark because I knew what I was doing on that knew what the right after was. And we just quoted up a great solution. And we took it to market. And we had amazing traction. We had companies like Staples, Office Depot, Home Depot, Lowe’s, Target, and Walmart — almost every multi-brand retailer that you know of today, or that you knew of before bankruptcies, was our customer.

Scott: One of Guru and my things in common is we both worked at Amazon, and I think both have this similar insight that you could apply technology, and in your case, machine learning, to great effect in e-com and why not build tech for other retailers? And you got to about $10 million of ARR in that business. You raised venture funding from a variety of funds. And then, we know the conclusion, which is you ended up exiting that business. And you’re in a different business today. Tell us a little bit about that journey. Why did you decide to exit that business — I think you foreshadowed a little bit with your comment around bankruptcy. But even more important about making the decision, how do you navigate that decision with you know, your team, your board, your customers who’ve bet on you?

Guru: Yeah. I think the journey was very intense in that period. It was actually harder for me to build a business, which was slow growing and so tough, than right now. Like in a way, it is actually harder to build a bad business — And that was a bad business because of the market that we bet on — than it is to build a good business.

We started off on this journey with multi-brand retail, right? There was an urgent problem we were solving. Product-market fit was amazing. The product was delivering great value to customers. Our net dollar retentions were off the charts. All that is great. The team was also solid. We had assembled an A+ team to work on it — an intersection of technology and retail and consulting. The problem was, that we bet on the wrong market. And hindsight is 20/20 — I learned the hard way that one could put a B or even a C team in an A+ market and make some hay. But putting an A+ team in a C or F market in our case is not a recipe for success. That is a wave that a founder should never be fighting.

We actually got to $10 million in ARR, and then we saw churn, which was a company filing bankruptcy, and it was a market-driven churn. We went back to $8M, then we crossed $10M again. Then we had this cake we brought in saying, “Hey guys, we crossed $10M” the third time we tried to celebrate, and I could see in everybody’s face that nobody was there for a celebration. In fact, after that, one of my colleagues took me to this restaurant, and he said, “Guru, I’m here for you. I’m here to build this company — this is an amazing technology that you’re building. There’s a lot of opportunity here. But if you look at it, we are kind of a hamster on a wheel. We are going after that $10 million mark for the third time. And this is not a time for us to celebrate.” That was a conversation that hit me hard. Oftentimes as a founder, as a CEO, as an operator, it’s very hard to pull back and look at the broader picture.

I said,” Okay, well, why don’t you be a part of that solution? Why don’t you help us solve that? And so essentially, we decided on that day to do a hard pivot. We were starting to explore what can we do next? And especially this time, we were going to bet on the right market — a growing market, an A+ market. And we started to look at all sorts of different avenues. It was almost like a blank sheet of paper with some money in the bank with some extremely smart colleagues and of course, a very driven board. What the hell can we do?

And so, after a lot of conversations, and Scott, you and I spent countless hours debating all these avenues, much to your frustration going back and forth on some of these things. We could not have messed up on this one. So, I was definitely slow. I maybe took a year more than I should have taken. We sort of did a lot of experiments. We talked to a lot of different types of companies and different types of industries, and it was also important for us to ask the right questions in terms of what the problem areas and things like that were? And that was the time we were lucky that Amazon acquired Whole Foods. And there was a huge rock that was dropped what was a calm pond at that time called e-commerce. And there was a massive tsunami of e-commerce coming up, and we could see it.

I remember getting a call from a top five CPG, a CIO, who we had sold to at Walmart — she had actually joined a CPG company. And she called me and said, ” My CEO just called me. We’re going to take a flight out to our headquarters. They’ve asked us to throw out our three-year vision and create a new three-year vision with Amazon in the center.” Not even e-commerce. She said Amazon in the center. So, this was like, this was crying out loud saying, okay, well, I’m connecting the dots here, not just for myself, but also for the company. We knew how every skew was operating. We knew the P&L of every skew, but we were helping the retailers be successful with that. We said, why not turn around and help the same brands who are actually selling those products? At the end of the day, consumers are not stopping to buy Pampers diapers or Kleenex tissue. They may stop going to a brick-and-mortar store, then they’ll probably go buy from an e-commerce store, like Amazon or Instacart. That’s what sort of was a small seed that we ended up watering and we did some more customer interviews.

And we ended up getting to the right answer, I would say. And that was CommerceIQ.

Scott: Maybe to pop up a level, you know, the belief was you could build technology to help very large enterprise players compete with Amazon. And it turned out that wasn’t enough. And so, when you talk about bankruptcies, it was these very large omnichannel retailers who sold both online and offline being beaten soundly in the market by Amazon. And so, in spite of the quality of the software, when you had to look at companies’ 10-Qs to figure out whether they can keep paying for it or not, I think that was the fundamental challenge. I remember a conversation, or maybe multiple conversations, we had as a board talking about, okay, what did we do about it? And, you came to the board and said, “Hey, I think we should sell this business while we try to go figure out, you know, what’s next.” As a board member that both, in retrospect, gives me a lot of joy and confidence in the outcome but were quite turbulent at the time. Maybe just kind of walk us through that process and where you ended up on the other side.

Guru: At that point, there was a choice to be made that either we could stand back and say, you know what, this was a fine run, let’s go and find a suitor for this and maybe roll it up into a larger company — could be Oracle could be whatever you name a large company, and there’s probably a space for a good dynamic pricing software. We said we could do that, or we could keep going. And for some reason, I was not there yet. Like, I think it was more personal than anything else that I was not there yet to call it a day. Maybe my biggest strength and my biggest weakness are the same is that I never give up. I never, never give up until we get through. I would call board members and call some friends and just talk to them about what was the right thing to do here. And the feedback is always what do you want to do? Where is your mind on this? And the fact that the board wasn’t pushing me towards a certain outcome or to get out or something like that just gave me the license to go back to the drawing board and think big. And that’s where we said, you know what, let’s come up with a different idea. So, we set aside this small team, we went through small product-market fit iterations. I still remember walking into this boardroom, and we were giving two updates. Update No. 1 was Boomerang Commerce. Update No. 2 was CommerceIQ. And one of the board members looked at me and said, “Guru, you’re trying to run a two-headed monster. It’s hard to build one company, and you’re trying to build two companies at once.”

And that was literally the board update. The board update was giving an update on two different companies because when you’re going after two different markets, two different sales motions, two different products. These are two different companies. And so, for us, it was a moment of reckoning. That was the point when we actually said, you know what, the energy and the gut feel, and the excitement is all around this small thing that we were bringing up. And the drudgery and the energy-sapping was this other business where the market was actually dying. So, what is the point? Let’s try to give up our ego on this and try to take two steps back to take five steps forward. And it was a license that the board gave me as a founder to go be able to do something like that, where we might either sell the company or we might bring this new thing up and potentially sell that as a business.

And it was a very personal decision for me that I wanted to sell the business and not the company because I knew that we could take this big, there was a lot of disruption to be made in the retail market. And right around that time, we started to look for suitors and we came across one of our longstanding customers, Lowe’s, came in and said, “Look, we just had a CEO change. And the entire management team is new. We’re looking to build a technology core and we looked at our kind of technology stack or vendors we work with, and you guys stood out. Are you guys looking to exit?”

And this was a conversation, by the way, I’d had six, seven months ago. At that time, we were not doing it, but I actually gave a call back to them saying now is the time to talk, and there was just a strong mind meld. So, we ended up taking our business unit, which is Boomerang Commerce and selling it to Lowe’s. At that time, absolutely, we could have exited, we could have done some distributions. In fact, I remember having a conversation with each of the investors on the board, and I laid it out saying, look, we don’t need all this money. We had raised only $20 million so far. We can certainly take 1X out and de-risks your position and stuff like that. And it was so great. Each one of the board members said, “I’m all in. I have a belief in you. I have belief in your management team. I have belief in the new product that you’re creating and the new market you’re going after. Let’s go for it.” So, we went for it.

Scott: So, you go build this team, you’re scaling up, there’s different capabilities you need when you’re five customers and a million of recurring revenue versus $10 million and a lot more customers. Now you do this sort of, okay — we got a bunch of money, a couple of customers and no revenue. But you had this history, and you had a management team who’d been through stuff. Were there any changes you needed to make in the team to have gone from zero to $10 and then $10 back to zero? It’s like, “Hey, who’s going to be coming along for the ride with me?”

Guru: Yeah, it was not much about the zero to $10 and $10 to zero. It was more about people who believed in the new vision of CommerceIQ or people who did not. Cause building a startup is freaking hard, and every day is a battle. Every day is a struggle. You need that core belief in the vision and the mission that you’re trying to solve for. But Boomerang Commerce was going after a certain market. CommerceIQ was not going after that market; it was going after something else — a completely new company. So, it was a moment where a lot of team members opted out, including management team members and C-level members, they said, look, “I joined you for solving the mission of creating an operating system for multi-brand retail. Brands do not speak to me. They don’t sing to me. And so, it’s time for me to head out.” There were some who I could see that it was not the right space for them, and I had to have the conversation with them and really asked them, are you really in this? Cause it’s okay if you’re not. And it doesn’t have to be today. We can find a good path out and hire your successor. So, there were all sorts of conversations that had to happen with the team.

I’ll say Scott, one of the most profound changes that happened was not with the team, the most profound impact was to me as a human. I came in from this Amazon school of thought. Everything for me was a math problem where I thought that everything could be solved like an analytical problem. You just gimme a problem, whether it’s a relationship problem or a human resources problem, or a market problem, I could apply analytics 101 and logic 101 and solve it. But as I look back and say what we had built as a company and what I, as a founder was, a good combination of IQ and LQ: intelligence quotient and learning quotient. What was missing, what we were not true to, was the EQ element. This pivot gave us the EQ. Gave me the EQ as a human — the ability to lead from the heart. There are situations where it was a bad idea to lead from a brain and solve it like a logic problem. For instance, somebody who had joined me with the vision, and I had sold this person the vision of winning the multi-brand retail market, and now I’m trying to logically explain why this was not a good idea and we had to go. It was not a math problem. It was not a logical argument. What I needed to show was empathy. What I needed to say to him or her in that meeting was that I understood, and I empathized with them, and I was sorry that this ended up happening. I did not foresee this. A lot of smart people did not foresee this, but it is right for the company to take this different path.

When I look at it and as they say, growth solves every problem, lack of growth also magnifies every problem. And there were lots of little problems that I had as a CEO, as a leader, as a human. And it just magnified the heck out of every one of those problems. And it was a very humbling two years in my life where I knew I wasn’t perfect, where I knew that there were lots of things that were wrong more than what were right. And I had to address them. And this was one of them. I had to really add that EQ element to my personality and to my leadership.

Scott: Yeah, I like that. It’s both the challenge of convincing people to come join you on a journey and the reality that that was the wrong journey and the self-reflection that it takes to embrace that and move on from that.

Guru: Now, so Scott, we talked about my journey going through the pivot. I actually was curious now that we are coming out on the green side, and hindsight is 2020, and we are in a good spot. I want to get your thoughts! What was going on in your mind and what was going on in the board’s mind? Outwardly you guys were doing a great job and giving me comfort, but what was going on in your mind when we came out and said, you know what. All the things that we raised money for. Forget about it. We’re going to do this new thing called CommerceIQ.

Scott: Yeah. I’m hopefully not suffering from revisionist or optimistic history. When you and I first got together to talk about Boomerang Commerce, which was the original name for the company, I was very predisposed to the idea. I felt somebody should be building the technology that helps Amazon win for the rest of the market. It’s like our former boss used to say, “Strong convictions, loosely held.” You can believe strongly in something, but if you have information that disproves or gives you doubt about that, you shouldn’t believe in it so strongly that you don’t recognize the opportunity or what you should be doing.

And so, I think like you, obviously, I was super sad when, you know, very large $3 million a year revenue customer turns into zero. Those were certainly scary moments for the company. I actually think the question of whether we exit the market was non-controversial from me or the board’s perspective. And between the conceptual decision, we should not be doing two things, we should only be doing one thing. It is fairly straightforward and obvious to say at a company at that stage, even though it took somebody to say it. Two, let’s go hire a banker and see if we can get full value for this product. And then three, you are having gone and developed those relationships, ahead of that process, resulted in what I would consider a 1-in-a-million type of outcome to sell, as you said, that part of the business and not the whole company and along the way, having done some research, some product-market fit, sort of stuff to say, “Hey, let’s go try this thing.” It’s like you said, what you want is the intersection of an A team with an A market. I felt like I had an A entrepreneur in a C market. I think the A entrepreneurs are harder to find than the A markets. And so, if we wanted to go after an A market, I’m sure we had plenty of good debate. But it was a very straightforward decision.

I did have questions from my partners like, “Hey, gosh, that’s a lot of money that you guys got. Maybe we should take some risk off the table.” And from my perspective, I felt like that was always an option. You and your team were good stewards of capital, which I think is the hallmark of a good management team. And so, whether we distributed cash the day the money hit the bank, or we did it a couple of months or years down the road because we didn’t see the opportunity, that was an option value that was always there. But the bigger opportunity was to figure out how to deploy it, to do something yet bigger. And so, the story’s not over yet, obviously, but I’m feeling pretty good about that decision.

Guru: That’s great. It’s good to understand the board dynamics at that time. Thanks for sharing.

Scott: Well, let’s fast forward to sort of the early innings of the CommerceIQ journey just by saying. You know, this very early idea in a customer to turn into a bunch more customers, your first $10 million of ARR in that business, which is now many multiples of that. And I think somewhere in the neighborhood of $200 million of total capital between the original business and the new business raised. And so, I mean, I think that’s just something fun to reflect on and feel great about. You can look at the last couple of years and say, well gosh, COVID was a big tailwind for e-commerce, you know, in some ways, clearly your customers were beneficiaries of that, CommerceIQ is a beneficiary of that because you, your customers needed algorithms to help scale the business, to make their business more profitable on Amazon and Walmart Instacart other places. And here we are in 2022, and there’s somewhat of a reversion to the mean of e-commerce, right? The growth rate was double. And now maybe it’s back to where it was, or maybe slightly elevated from that. And then you pile onto that the potential for a recession — if we’re not there already — higher interest rates, and that’s potentially having an impact on consumer spend. Obviously, the fundraising environment isn’t where it was a year ago. You didn’t have to navigate that in version one of the company. You’re having to navigate it now. Just tell us about how you’re thinking about it. You’ve got plenty of capital in the bank, you’ve got plenty of runway, but the choppy waters may be here for other reasons.

Guru: Yeah. I think the future of CommerceIQ is very exciting. We are in a very solid spot as a company. Of course, there’s going to be challenging, but one of the things that we definitely got right was the product-market fit on this one. And what we also got right was the quality of the market. Our customers are loving the product. Our net dollar retentions are off the charts in the top decile of our industry. And we also have built a company which has got a great cash efficiency ratio. As we look forward in the business, one of the things that is very exciting is this is a recession — and the recession is definitely going to happen, in my opinion, if we’re not in that already — that this is a recession where there are a certain set of markets which will continue to thrive: low-cost groceries, healthcare, discount retailers, children’s goods, pet industry, these things, usually they do a really good job in recession. We are serving, according to a study that I got the other day, we are serving eight out of the 10 markets that are expected to do well during a recession.

Scott: Yeah. I haven’t heard that stat before.

Guru: That’s a great place to be in for us as a company. We do have to slightly change how we talk about our value proposition. And in fact, even the focus of our value proposition. In a growth market in e-commerce, every brand was looking for three metrics: growth, growth, and growth.

And now, in a recessionary market, they’re looking for three metrics growth, profitability, and cash flow. So, we are having to change our value proposition by, say, 45 degrees. And this is not just marketing messaging and all that. I’m talking about what our customer success teams are working on and focusing on what our product team is focusing on, the product roadmap for the next few months, and stuff like that. We are definitely taking a slight shift to navigate that sort of dance that we have to play with the economy and help our customers win in this market. In a lot of ways, I’m really looking forward to the next two years, whether it’s expansion or recession, because of the strong foundations we have built. And frankly, it gives us a golden ticket for the next two years where new startups are probably not getting funded as fast as they were before. So, it’s a great opportunity for companies like us to deepen our moat, maybe pick up a few companies on the way and acquire them and also hire some great talent in this market. So, it’s actually very exciting. All we need to do is just stay true to our No. 1 leadership principle, which is customer obsession — ensuring that our customers are winning, they’re taken care of, and we are solving the right problems for them in the next two years.

Scott: I think that’s, that’s great. You know, you’ve got great dollar efficiency as a business and a very disciplined management team. I think you’ve got a great product roadmap, as you alluded to. You’ve got the balance sheet to go do some interesting things. You’ve got a very clear vision of where you want to take the product, and now you can go build a bunch of stuff or you can go buy some things as well. And you just closed your first acquisition. So, you know, gone from selling a piece of the business early days to adding somebody else’s business to the platform. How do you as a CEO think about building things versus buying?

Guru: This may not be the answer for every company or every CEO, but the way we think about our business is we are a vertical SaaS company. We are not a horizontal SaaS company. Horizontal SaaS companies are companies like, say a New Relic or Apptio in enterprise or Salesforce is a classic example. Like anybody who has a sales team can use a Salesforce software or anybody that has developers can use New Relic. But for us, we can only sell into the retail market. We don’t sell into the insurance, finance, or government, these are very large markets, which we don’t touch at all. And so that’s the definition of a vertical SaaS company.

And one of the things that I, as a vertical SAS CEO, or we, as a vertical SaaS company, we have to go solve a broad range of problems for every single customer in our market. That’s one of the idiosyncrasies that we cannot take one specific problem and solve it really well and go sell to thousands if not millions of companies, which is what a horizontal task would do. In a vertical, SaaS is sort of taking a slice of the market and going, solving a broad range of problems. Now we cannot be a small sliver for a small market. Then you are just building a small company, right? If you are building a multibillion-dollar company, which we are, then you are to do one of the two, right?

We are certainly not doing horizontal, we’re going vertical. We’re going deep and deep vertical. And what does that mean? That means that. We are not just solving a digital shelf monitoring problem. We’re not just solving a supply chain problem. It’s not just solving the retail media problem. We’re solving all of the above. We have to solve everything for this market.

And another idiosyncrasy of a great vertical SaaS business is that it’s a winner-takes-all market where we have to hurry up and invest strategically and go take the market. One thing we don’t have is time. We are already at a pretty good level of market share. I want to get to a point where we are 60, 70% market share in our market. And frankly, being a product-first and engineering-first CEO, it is hard for me to have that come-to-Jesus moment — that realization of, “Okay, I should go buy a product as opposed to building it in-house.” But one of the things that we do look at is how we can be open-minded to other products that are best-in-class, where customers are loving them, and frankly, can you convince that team to come in and join the common vision. And does it make financial sense for both parties to essentially go do that?

In our case, e.fundamentals was a great marriage from that perspective. The moment I talked to John Markman, who’s the CEO, both of us knew that there was something in this. And we were able to convince both our management teams very easily because we knew that there was value in putting one and one together. We were strong in North America. He was strong in Europe. We are strong in retail operations and supply chain, and retail media. He’s strong in digital shelf measurement, which is also a budgeted software. So, it was sort of complementary in almost everything that we do. I would’ve definitely not gone ahead if I was not convinced about the product if I was not convinced about the team. But in this case, the product is world-class, the technology is world-class, and the team is world-class. That sort of just gave us the confidence to move forward. Very exciting to have done this. And we are really looking forward to a fantastic journey together.

Scott: Thanks, that’s really cool. And maybe a good capstone to our conversation. You go from building a company to selling part of the business, to rebooting, building a new business to bringing in another company. And I know you’ve got a long road ahead and just personally really enjoyed our partnership together over the years, and I’m looking forward to many years to come. So, thanks for spending some time with us today. I know just as your entrepreneurial journey is such an interesting one, I think it’s really helpful to share with others.

Guru: Thank you, Scott. Thanks for having me. And certainly, thank you more than that for a wonderful partnership so far.

Coral: Thanks for joining us for this week’s episode of Founded and Funded. If you’re interested in learning more about CommerceIQ, please visit CommerceIQ.ai. Thanks again for joining us, and tune in in a couple of weeks for our next episode of Founded and Funded with Cresta Co-founder Zayd Enam.

Top Tier’s David York on Limited Partners and Expectations for the Market in 2022

In this episode of Founded and Funded, we stray a little from our typical format to answer some questions that often come up in discussions between founders and our investors. Madrona Managing Director Matt McIlwain talks with one of our Limited Partners — a partner that is not a day-to-day investor Top Tier Capital Partners Founder and Managing Director David York. They explore different kinds of funding mechanisms and how David is “selfishly optimistic” about the current market environment. And they talk about the history between the two firms – more specifically, why this San Francisco-based firm decided to bet on Seattle and Madrona all those years ago!

This transcript was automatically generated and edited for clarity.

Matt: This is Matt McIlwain. I’m a Managing Director at the Madrona Venture Group, and I’m just delighted to have a longtime friend and special guest here today — David York. He’s somebody that I’ve known now for over 20 years, and his is a really interesting journey going back to what was once called Paul Capital and had a focus on what’s called the secondary market, and how David under his leadership and with this amazing team, has really transformed it into a much bigger set of platforms. David, can you take us back to Paul Capital and how that evolved into Top Tier.

David: Sure, our pedigree actually goes back to the 1980s with the Hillman family, which is also a co-investor with us in the Madrona funds. My co-founder Phil Paul from Paul Capital used to run that portfolio in the 1980s. And at that time, the only investors in venture capital firms, or at least a lot of them, were either corporations like AT&T, which was one of the largest programs at the time, and/or families — endowments for the most part had not started to invest in venture capital and hadn’t really thought of that model. So, our legacy in this industry goes back almost 40 something years. I had the privilege in the ’90s of running a trading desk for a venture capital investment bank in San Francisco called Hambrecht & Quist, and one of my clients was Paul Capital. They, as you’ve mentioned earlier, were focused on secondaries for most of the ’90s. But at the end of that decade, it attracted capital to invest in funds on a primary basis.

Matt: Maybe David, when you say primary and secondary and then for now let’s constrain it to funds and then we can go to direct companies. Maybe we’re just going to break all those down.

David: So, when a fund is getting formed, it’s typically a blind pool. And the investment into that blind pool is usually by an accredited investor or an institution, and they usually are really trusting the folks, like the partners at Madrona, to manage that money going forward over a period of time. That initial investment into that fund is called a primary investment in our industry. You can use that same terminology to be an initial investment in a private company as well, but for limited partners, primaries are buying funds for the first time without any assets in them.

If you look at the contracts that are used to create those funds, things like defaulting on your commitment are very onerous and can be quite penal as it relates to your investment — you can forfeit your assets, you can forfeit a lot of things. And so, it’s not common that investors default on their commitments if they want to get out of, say, a venture fund. But one of the ways they can remove themselves from a venture fund, if they want to invest that money someplace else, is to sell them. And that sale transaction happens in what we call today, the secondary market. Think of that as sort of a tertiary market like used cars. Well, this is used private equity. And that was one of the early inventions that Phil Paul created when he started Paul Capital — that firm was started under the guise of a very large secondary transaction — one of the very early secondary transactions ever done in our industry.

Secondaries today now make up about 5 to 10% of the volume in the private equity industry. It’s a way to invest in private assets, typically companies, in a manager that you might know and trust, later in their life. And so, there’s a lot of visibility on what’s in those portfolios, as well as if you have some insight, you have some visibility on how those companies might do in a way that you can actually generate pretty attractive returns. You cannot generate for the most part the same type of return as if you invested in that fund at the very beginning but depending on the markets and the pricing you can acquire the secondary interest in, once it’s further along, you can generate returns that look pretty comparable.

Matt: So here is this organization, Paul Capital. They develop an expertise for buying these secondary stakes in venture capital funds. So, this is not yet at the secondary stake in an individual company level let’s pick up the story in the kind of the early 2000s.

David: Phil and I spent most of the early 2000s building what’s today our core fund to funds business. It’s 80-90% of what we do and did then — invest in funds on a primary basis, so when they got started. From time to time, we get an opportunity to buy a secondary in one of our managers as we went along, and so we would do that. With the global financial crisis, we started to see more and more secondary volume as an active fund investor in our managers, primarily driven by institutions that were essentially desperate to generate liquidity because of what had happened in the global financial crisis. And that motivated us to look at what was for sale versus what people were worried about and we realized that the worry was much higher than what they were selling, and the quality of what they were selling was quite good. So, we started aggressively buying fund interest in our managers at really very attractive prices.

I mean, think 30, 40, 50% of a discount to what the current NAV was, and that motivated us to really start to build a capital base there. So today about a third of our investment activity is focused on buying these secondaries. About 20% of what we do is then invest with our managers in the later stages of their developing portfolio companies. And usually, that’s in the B to C round, and that’s been a very lucrative investment activity for us as well. Today, we own indirectly and directly about 12,000 private companies. And we also have invested between our secondary purchases and our primary investments in about 500 different venture funds across about a 100+ general partners or managers. And that gives us a great lens on the industry, and that asset base generates quite a bit of interesting deal flow.

Matt: A lot of our audience are entrepreneurs, and what’s interesting from their perspective here is that here you are a great long-time investor — one of our limited partners — buying primary into Madrona. But then you can see through to the performance of our companies and then sometimes be a co-investor with us and a direct investor in them. And I know that you’ve done that both in terms of buying direct primary investments and in some cases, direct secondary, investments. In fact, I think your colleague Garth Timoll and you were champions of Smartsheet relatively early on. And that I think turned out to be quite a successful investment for all of us, of course, but from our perspective, it was great to have our trusted partners that were also interested in investing in our companies. And it’s a nice resource for those companies as well.

David: And we think that’s a perfect relationship with our managers. We want to be a source of capital that, thankfully, we think of as being a good partner. So, we want to help you build companies with our primary investments in your funds and then we want to help you with liquidity if you have an investor that can’t follow on, or somebody’s getting a divorce or an institution gets a new CIO, and they change their strategy, then we’ve enjoyed and had an opportunity to take advantage of those situations by buying funds from your limited partners. And then, you know, we do a handful of deals a year, so we’re not that active from the standpoint of co-investments, and we’re pretty picky, but we’ve enjoyed a great relationship with Madrona around some of the co-investments we’ve done from Qumulo to Smartsheet to Remitly and some others. One of the other things we’ve been able to do in the form of being a good partner is help some of those companies provide liquidity to their employees through tenders, which are actually direct secondaries in those companies. We look at those as a mechanism to provide more ownership to our investors in our programs to that good company. And we think it’s additive and based on the way capital markets are structured today — these companies are staying private longer — and so it gives CEOs and entrepreneurs the opportunity to help their employees get liquidity along the journey of the startup in a way that I think is constructive for everybody.

Matt: So now we’re onto secondaries directly in companies and buying shares, from an employee in theory, you could buy it from a former employee or one of the venture investors, maybe an angel investor. This is an area that I think we both agree the mindset in the venture community has changed quite a bit in the last 15-20 years. Can you maybe take us back to kind of the early 2000s mindset and how that’s changed in terms of secondary sales, especially for current employees at companies?

David: Sure. First of all, if you go back to the late ’90s, the average pre-money for an IPO was roughly $300 to $400 million — I mean, if you look at Microsoft and Amazon in particular, those that’s right in the range of where those companies were before they went public. Today that’s the average value of a Series C or a series D round, depending on how fast the business is growing and how much money they’re trying to raise. And so, the time pendulum of liquidity in the startup sort of model was you got paid enough to want to work there, but you really made your upside with your equity, and you got that liquidity from the companies going public earlier, and that’s kind of gone away. And it’s taken the investor community, meaning general partners and the limited partners, like you said, the last 15 years to get comfortable with the notion that those mechanisms are not going to change much as it relates to employee structure and whatnot. And so, it’s up to the private market investor to try and help with that. And we’ve all gotten much more comfortable in owning common. It used to be that we had to own the preferred to make ourselves feel comfortable, but as companies get big enough, which is usually where they’re typically doing these tenders, the preferred structures really are not necessary because the companies are moving well beyond that in a way that common is actually the same security in some ways.

And so that’s part of the reason we’re so comfortable with tenders is that it gives us more ownership. It gives us a better blended exposure. A lot of times the companies that we’ve done tenders with, if we’ve invested in on a direct basis or we’ll come back and do a direct round a little bit later on, and what we’re looking for is exposure to great companies that we see in our managers’ portfolios and trying to be a good partner along the way. We did one for an ad tech business down here in San Jose that they never raised any money beyond the seed round. The management team wanted liquidity, so they could kind of spend another three years doing their thing. And then ultimately the employee base wanted the same thing. And so, we did a couple of deals with them. Ultimately that company got acquired by Blackstone, and so we all did very well by it, but there was no real liquidity in the marketplace unless you did that for the employees and the management team.

Matt: You know, my mind got changed in this area maybe a decade or so ago in that you’re concerned that if people were selling, especially founders and employees, were selling their shares. They were going to be a little less aligned with the company. But I think they became more aligned with the venture investors because they were able to sell some and that could give a little bit of a release valve.

David: Yeah, Risk office as we call it, so that they can lean in even further.

Matt: And be less tempted if, you know, whether it’s a strategic or a finance — a Blackstone or somebody comes along and is trying to buy you, you can say we’re going to kind of play for the longer term, the bigger outcome. And I think that that does align with, with the venture investors. I mean, you must look through a lot of venture funds. And I’d be willing to guess that 90% of those venture funds end up having two, three, or at most four of the companies that are the ones that really move the needle in terms of the returns on those funds.

David: Yeah, those probabilities haven’t changed. No matter what decade we’re in. What’s changed in the venture capital fund investment universe today is that the dollar losses that a portfolio generates early on have really shrunk. And the reason for that is it just takes so much less capital to start a company. The number of companies that fail in a portfolio hasn’t really changed and it varies. But it over time ends up being somewhere between 20 and 50%. Of the ones that survive, half of those usually return the fund. And then the other half are where the drivers are. And just depending on how many companies you have in your portfolio in general, but that usually is in the neighborhood of two to three on the low end and maybe five or six on the high end. Every once in a while, you get a fund that has outliers in all those places, and they create really remarkable returns, but statistically, if you look at funds in China, you look at funds in the U.S., you look at funds in Europe, that all holds true. So, we’ve seen our loss ratios come down to a level that they’re lower than the buyout industry on one hand. And the other hand getting back to the old adage that you lose a lot of stuff, you do lose the companies. You just don’t lose as much money.

Matt: So, David you’ve been great partners with us at Madrona now for almost 15 years. And you know, that was back when the cloud was just getting off the ground with AWS and then later Azure, which of course are both based here in Seattle. I’m curious what got you and Top Tier excited about the Pacific Northwest as a region for venture capital as well as ultimately Madrona.

David: It’s a great question. Two things, first of all, more and more of our portfolio companies, which early on was predominantly Silicon Valley-based firms, were coming out of the Northwest. It became evident to us that there were essentially good things happening up north. And then we also had this strong belief that the cloud market in particular was going to be a big part of technology going forward. So, we wanted to sort of double down on that by getting more exposure to essentially ground zero for cloud, which is Seattle, in our opinion.

Matt: Well, we agree with you.

David: Yeah – you agree, but I mean, in general, that wasn’t obvious 15 years ago, but that was really the motivation. Seattle’s been kind of an interesting market for technology at a high level because the employment base has been for so long sucked up into a handful of really large companies. There used to be kind of the adage that if you really wanted to build a special business, you went to the big city. And then what was happening — the two things, one thing was the cloud activity that we wanted incremental exposure to if you will. But the other was that we started to see, finally, that the entrepreneurial ecosystem being generated by those large technology companies was really starting to be self-generating. And then what happens usually if you look at all the different regional markets and whatnot in the U.S. or different places around the world, you end up with this sort of flywheel of entrepreneur and startup sort of muscle memory, if you will, that allows both the entrepreneurs to invest in the businesses, but the businesses essentially generate employee capital, employee growth that you can then build upon to build an ecosystem. And so, what’s truly happened in the last 15 years in the Pacific Northwest in particular in Seattle specifically is that you’ve now that market is comparable to any other regional market in the U.S.

It doesn’t attract as much capital, a la the statistics because you don’t have as many firms up there, but I can tell you that the people that are up there think that the investment opportunities are just as good as San Francisco.

Matt: Well, we’re going try to keep spinning that flywheel.

David: Yeah. Well, you guys have done a great job. We spent a bunch of time and really felt very, very confident about where you and Tom and the rest of the partnership were headed at the time, as well as the relationships you had in the community in a way that we thought we’d get a disproportionate view of high-quality deal flow, as it relates to what you were going to look at and then ultimately made its way into our portfolios. And so that was the reason for originally investing. But the other thing that happened is we had an opportunity both to co-invest with you, which we’ve done in a number of companies, including Smartsheet, but then one of our local foundations down here decided to do some secondary sales and that gave us another opportunity to partner with Madrona and buying a portfolio of fund interests in your funds and to the point where now I think we have more exposure with you than anybody else, which is something we’re excited about. We’re big fans of the market. We think you’ve done a great job with the team and where you’re headed. And ironically, it’s probably four or five times better than when we started.

Matt: Well, thank you for all of that. And the feeling is very mutual on the partnership. And yes, you know, we don’t very often have situations where there’s a secondary in Madrona, but that circumstance where they change the CIO at that group. And the new CIO wanted to do some different things. And the great thing is that we were able to work with you all and ultimately own a piece of that ourselves. And so, I think everybody that was on the buy side of that trade was very, very happy in the end.

David: Yeah, it’s been a great transaction for everybody.

Matt: Certainly, the market conditions have changed a fair bit in the last set of months. You and I have talked about this before, and I’m curious as you kind of look down the road a little bit, we’ve got these different strategies — primary investing, secondary investments into funds, into companies directly. What’s your view on the macro just to start? And then we could talk a little bit about where you see more or less opportunity as a result of the macro environment.

David: Well, I’m selfishly optimistic. I think for the first time in probably 30 years, we have a rising rate environment. And I think the markets in general, especially the overpriced technology stocks, or the bigger momentum stories, are just being reset as to how you want to price growth when you have a rising rate environment. And we’re going through this natural churn as we reprice things. What I think, at the end of the day, you have to rely on ultimately is fundamentals. And the fundamentals of our underlying technology companies, especially the ones that have gone public recently, are still very, very strong. So, I think ultimately those prices that have been pretty radical, that declines have been pretty radical. I think they’ll get rationalized at some value that’s different than what we were at in March, for instance, but I don’t think, because the fundamentals are so strong that we’re going to stop pricing growth in those businesses. It’s just going to be at a different, multiple. And so, the market’s trying to figure out what’s a practical rationalization for growth and the value of growth.

Matt: And I think probably a lot of our listeners have seen the charts where the 5-year trend and 5-year average of SaaS companies, for example, was maybe in the eight times their forward 12 months revenue. And it went as high as like 17, 18 times even last fall. And now we’re below the 5-year average, you know, kind of in the six to seven times range and yet a lot of these companies are continuing to grow. I think there’s been one other factor. It’d be interesting to see if you’ve seen this as well, which is there was almost a growth at any cost. You’re now seeing a pretty hard swing back to cash flow break-even or better — control your destiny with positive cash flow as key criteria, at the expense of some growth people are okay with less growth, as long as you’re very close to, and you have a clear path to sustainable cash flow positive.

David: This is the notion of fundamentals. At the end of the day, growth at any cost ultimately gets outpriced in a way that you’re going to have to reset. It’s happened in the late nineties. It’s happened several times in the last two decades. You know, cash flow break-even is obviously the holy grail for these, especially the IPO companies that have gone out in the last two years. It was always the anticipation when the company went on the road that that would happen in a reasonable period of time. I think during COVID, because of the demand for technology and, frankly, those companies’ products, they kind of threw that aside and said, the world’s going to let me get by without having cash flow break even. So, bringing that back, I think, is very constructive. To me, it’s where things should net out anyway. So, I’m not against it. And I think, having a little bit of discipline in your management is not a bad thing. So, I think it’s okay.

Matt: You all you know, invest in primaries and secondaries all over the world. You also have, if I understand it correctly, a pretty geographically spread out investor base of groups that invest into Top Tier. What are you seeing globally if we zoom out from the United States in terms of capital interest availability and how folks are thinking about these changing market conditions.

David: So globally investors started allocating pretty regularly to venture capital, really starting about six or seven years ago. In the last five years, it’s now really cemented as part of a portfolio allocation strategy. If you talk to consultants like Cambridge, or you talk to the endowments or you talk to even the big pension funds. And then ironically the benchmarking that all those places use has a mixture of assets that typically has venture in it. And because venture has performed so well, especially in the last five years, it’s outperformed every equity class there is. People are having their benchmarks start to beat them in a way that they’re starting to keep that allocation and worry about catching up. So, we don’t see any real materials slowdown in venture portfolio allocations. We do see pacing, as it relates to deployment into the asset class, ebbing and flowing really with what is happening at the balance sheet level of the investor. So, think about — I have a blended portfolio of listed stocks or fixed income or whatnot. If those things go up or down then it improves your balance sheet if venture goes up and down, it improves your balance sheet. But all of them have a certain weighting that the CIO typically wants that mix to be, and if they get out of line, then that might slow down or accelerate pacing just depending on where you are.

Matt: Let’s say I’m trying to have 25% of my investments be in private equity and venture, and they’re all still basically at the same values. But my public stocks have gone way down, just mathematically, my private company holdings are going to be higher as a percentage, and I might be out of whack in terms of my percentage allocations that I’m looking to achieve as a pension fund or an endowment or a foundation. Then there’s a whole bunch of things, including this kind of, I guess, leads a little bit into why it might be a good cycle here in the not-too-distant future for the secondary markets again.

David: Yeah, we’re very selfishly bullish about that opportunity. What we do is eat and breathe venture capital and technology, but we’re very excited about the cycle in front of us. And then what we see is especially some of the more aggressive investors, where we think they will have that what you were describing, we call the denominator problem, where the denominator is shrinking, but their exposure to private assets hasn’t really changed. Over time, what happens is they typically are selling off exposure, and we think there’s going to be a lot of very interesting opportunities for that probably after the second quarter. And that’s because of the way the markets have responded and, frankly, the way the private markets respond to corrections. It usually takes two or three quarters for valuations to change. But in the meantime, the public markets have corrected overnight, and so you end up with this disproportionate overweighting in private assets in a way that I think will have investors starting to think about rebalancing later this year and potentially into next year. And so, we’re very enthusiastic about what we see coming.

Matt: There’s also an additional timing element there because so many of these nonprofits, a lot of them are educational endowments, and their fiscal year ends at the end of June. And so, they have their kind of get their final year-end numbers. They have to face the board

David: And the auditor.

Matt: And the auditor.

David: And the auditor is going to make them stay true to their charter. And we expect that market, in particular, to be rebalancing quite a bit in the second half of this year.

Matt: You talked a little bit about the thesis on cloud and that one has been a very strong one. And in Seattle, I think with Amazon, AWS and Microsoft Azure, and even a fairly substantial presence for the Google cloud teams up here has really, you know, is for all kinds of reasons, I suppose, the cloud capital of the world. But what other big themes or thesis, you know, either, in the U.S. or abroad are really on your radar screen today.

David: We think there’s been a total sea change with COVID around the use and acceptance of technology across some very major gross domestic product slices. So, health care is one of them, drug discovery has gotten better and better, but the use of technology in the hospital systems and the medical community, and I don’t know how many people went to the doctor’s office during COVID, but we certainly had Zoom calls with doctors. We just think that whole ecosystem is ripe for innovation and change. Education is another space — all the kids learned how to go to school on their computers. And ultimately, I think that whole space is going to be ripe for change. Transportation, logistics, the whole notion of the fact that you didn’t have to own a car or, frankly, you didn’t have to go to the store because stuff was facilitated for you. I think it’s becoming commonplace in a way that that whole part of our gross domestic product is going to be materially impacted. And we don’t as an economy really understand that yet, but I do think it’s going to change things like insurance, how we ship things and a bunch of other stuff. And so, that’s another slice of the GDP that’s going to change. And then technology continues to always kind of cannibalize itself, but machine learning and artificial intelligence, which are a big part of your effort there, and especially your work with some of the institutions up there in the Seattle area, that’s becoming a more and more commonplace component of software in a way that you can see that there are these big companies like Google and Microsoft, and Salesforce that have a lot of startups that are very interested in innovating or out producing by using machine learning and artificial intelligence. I just feel that’s going to be more and more standard in a way that we’re going to again have another kind of full rotation in the tech stack.

Matt: Well, as you know, I think we had dinner maybe five years ago when this was when we were still quite early in the era of applied machine learning, or we like to call intelligent applications. And I think this is one of the neat elements of Top Tier is you all were curious, too, and wanted to have a deeper discussion. And we got a group of friends together and dug into that topic. And now we’re seeing just a lot of affirmation, whether it’s in industries like insurance that you mentioned or healthcare and increasingly life sciences, it’s going to be very, very transformative in the years ahead. I think I’ve heard you say, ” Technology is business for the future.” When you kind of go around the world, you talk to the folks investing in your fund do they see that too? Are they more and more buying into that as a core thesis of what they need to have in their portfolios?

David: Well, let’s spend a minute on global investors. Yeah. I talked earlier about venture allocations, kind of being a fixed part of portfolios — that allocation typically sits in the equity component of portfolios, as it relates to sort of where the piece is and the balance sheet. Most of the pension assets in the world are really yield-oriented, and that’s primarily because they’re trying to generate 6 to 8% returns to meet their actuary and fixed income could do that for them historically. Today that hasn’t been the case, and so they’ve slowly started to add more equity-like things such as real estate or private equity or venture capital. In markets where you had culturally the ability to buy something and see it go up in value like you do in the U.S., that’s been a very large growing component of portfolios. It’s gone on average from 2 to 3% of a portfolio — venture capital has — to now it’s probably approaching 5, and that’s those are material moves in those programs. In the family office world, it’s now running in the 20 to 30% range. If you go to places like Europe, where fixed income is such a big component of the investor base, it’s slowly getting there. So, some of our larger investors are in Europe, and their blended equity portfolio is now 50% of what they do, and their private equity is now 15, including venture capital. Ten years ago, that number was more like 30, sometimes 20, as far as equity is concerned. And then venture then was a subset of that. So, we’ve seen that growth, but it’s been slower, more measured and more risk adverse. Asia still relies heavily on their fixed income markets. You know, if you think about their traditional pension markets, like Japan is the second-largest pension market in the world and they all follow the large sovereign pension funds there, and those are 80, 90% for the most part Japanese bonds. They’re large pools of capital, they’re trillion-dollar pools, but the ratios kind of dictate the trend and then if they want to do private equity, they struggle to do venture capital, because they worry about losing money. When investing, I’ve started to think about risk and where it lies and sometimes there’s risk of missing the upside. And I do think most of the Asian pension funds have missed a lot of upsides.

Matt: I tend to agree with you there. I mean, there’s some exceptions, of course. And you know, I think the folks in Singapore have done a particularly good job of diversifying into some of these different areas.

David: The sovereign wealth funds have done a better job thinking about equity than the pension systems in those communities. Yeah.

Matt: So, to bring this back to the entrepreneur for a second? What are the implications to them? My macro takeaway is that there is a growing amount of capital from pension funds and wealth assets and then you get the foundations endowments that have done very well. This seems to be generally something favorable to the entrepreneurs and the companies because there’s more capital that’s looking to find its way into private companies. Is that fair to say from your end or do you see it differently?

David: I think the capital will be abundant. But selection and actual fundamental application is still going to be the tricky bit. So that’ll take skill both on the entrepreneur’s side, as well as on the manager’s side at firms like Madrona. What we see today is that there’s an abundance of seed capital, right? So, you can get a company started, but really knowing how to build a business and get it to become successful is a whole other problem. There’s an abundance of series A through D but picking to make that stuff work is still the really, really differentiated activity. You know, most people have networks, and most people have what I would call service activities, but being able to see around corners and pick the right stuff is the hardest bit as it relates to traditional venture capital. In the growth market where a lot of the valuations are driven off of public equity activity. The people that were doing that, a fair amount of them had public equity investment funds, like mutual funds and hedge funds, and things of that nature. I think that stuff will ebb and flow with the public market valuations and the capital there will also ebb and flow a little bit with public market valuations because they too have denominator problems in those portfolios as public stocks come down.

So, we expect that market to slow down. We expect valuations to come in at the early stage and seed stage level valuations, they accreted but I think for the right reason, which was the fundamentals were in a pretty good spot for most of these seed companies. They had some sort of product, so you weren’t really doing a really true raw startup like you were maybe 10 or 15 years ago. So, to me, this is the time where the guys that roll up their sleeves and really do the good work actually are going to be the winners, whether it be an entrepreneur or an investor.

Matt: Well, I think this has been a really helpful conversation. You know, a lot of times the entrepreneurs we work with are very curious about how we get our capital and some of these other mechanisms — the primary and the secondary markets. I really want to thank you for taking the time to walk folks through some of that history. Some of the things that have changed, some of the things that are going on now and how these different parts of the kind of capital world exist and function. So, thanks very much, David, really appreciate it.

David: Matt as always. It’s a pleasure seeing you and a pleasure to spend time.

Coral: Thanks for joining us for this week’s episode of Founded and Funded. If you’re interested in learning more about Top Tier, please visit TTCP.com. Thanks again for joining us and tune in, in a couple of weeks for our next episode of Founded and Funded.

Sila Co-founder and CEO Shamir Karkal on Crypto and Web3

In this episode of Founded and Funded, Madrona Partner Chris Picardo dives into the world of crypto and Web3 with Sila Co-Founder and CEO Shamir Karkal. Sila is a FinTech platform that provides payment infrastructure as a service, which is critical for all companies that need to integrate with the U.S. Banking system and blockchain quickly and securely — while following all necessary regulations.

Sila has evolved since Madrona invested in its Seed Round in 2020, and it is now sitting at the intersection of crypto rails and traditional financial services infrastructure because as much as some people want to get away from the traditional financial system, crypto still needs to be able to plug into it. Shamir and Chris dive into the importance of this infrastructure, the ups and downs of the crypto market, the trends driving FinTech and crypto, and so much more today. So, I’ll hand it over to them to get started.

This transcript was automatically generated and edited for clarity.

Chris: My name is Chris Picardo. I’m a partner at Madrona, and we’re really excited today to have Shamir Karkal, who’s the founder and CEO of Sila. We are going to talk about all things FinTech, crypto and Web3, which I think is largely a first for the Madrona Founded and Funded podcast. Madrona has been invested in Sila since the Series A, and I think that Shamir and I have known each other for a bit longer than that and really excited to have him join. So, Shamir, welcome to the podcast, and I’d love to start off with just a little bit of background on yourself and your journey here. You’ve been in FinTech, I think since before it was called FinTech or had a name. And I’d love to hear a little bit about that journey and how it all started.

Shamir: Thank you for having me, Chris. It’s a pleasure being here and being part of the Madrona portfolio. So, I used to be a software engineer 15-20 years ago, I came to the U.S., went to business school and became a consultant. That’s really kind of where I fell into financial services. Did a lot of work, for banks, processors, central banks. This was the 08′ period where I went from working on cross-sell strategies for North American banks to country bailouts in the Middle East. And then in 09′, a friend of mine from business school sent me an email saying, let’s start a retail bank. You’ll see how crazy I am that I thought that was a good idea in 09′. And literally, my last engagement at McKinsey before that was best described as trillion-dollar bank bankruptcy. So, I had way more experience shutting down banks than starting them.

But he had this vision of how a better financial world and a better bank could help people manage their finances, and I totally got excited about that, moved back to the U.S. from Europe and started up Simple in 2009. Simple ended up being the first neobank, ever. The word neobank didn’t exist. And I think the word FinTech probably didn’t exist. We just called it financial services back in 2010. It took us three years to launch Simple because nobody had ever done anything like that before. And then in 2014, Simple was acquired by BBVA, which is a large Spanish bank. A $117 million acquisition seemed like a good outcome at the time, but now in hindsight, we probably didn’t quite realize how much potential that was.

I then got excited about building API platforms, and I was like, “The world needs API platforms.” And I persuaded BBVa to build a couple of them and built and launched them — one in Europe and one in the U.S., and launched them, acquired some customers as well, but ultimately just got frustrated with the big bank lifestyle and left in 2017. And then started Sila in 2018. Sometimes it feels to me like I’ve spent the last 12-14 years doing the same thing, which is help people, programmers, developers, innovators, program with money. A lot of that was internal. At Simple, we had to build all the infrastructure so that we could use it ourselves because it didn’t exist. Uh, I tried to build a type of bank platform at BBVA and then that’s what Sila does now. We help our customers program with money and build FinTech and crypto apps to do things like crypto on/off ramps, FinTech, PFM apps, savings, apps, credit apps, and NFT apps, all of it.

Chris: It’s an amazing journey. And I think since I’ve known you, I’ve always thought that you were out in front of all of these next big FinTech trends. I think obviously Simple was a good example of that. You’ve been talking about using crypto infrastructure in banking for a long time — I think before that really got particularly popular. If you think back on that, how did you see those pain points? What drove you to, in the case of Sila, say, “Hey, there is a new way to build this, and we should really be out in front of that”.

Shamir: I think it goes back to this fundamental thing — money is hugely important to people. I mean, it’s what drives society across the world now. If you look at new year’s resolutions every year, they kind of fluctuate, but they all come back to one of two things. It’s either, get healthy and that’s usually when times are good, people are focused on getting more healthy and especially in the last two years. And then when it’s a recession or a depression, then it’s all about getting financially healthy. And the prescription for both is kind of weirdly similar. You want to get healthier, exercise more and eat less. And if you want to get financially healthier, spend less and save more, and if you can, earn more.

But the financial system still operates in this mentality, I think, which is pre-1990s, which is we have a bunch of products, and we are going to sell them to you. I think FinTech is kind of the beginning of it, but especially in the crypto space, folks tend to flip that around and say, “Hey, I’m not trying to build a product and then sell it to customers. I’m trying to understand what customers want. And then I’m trying to build something that solves their problem.” And maybe it does something with money on the back end. But that part doesn’t need to be front and center and it should just be plugged in on the back end. Your access to financial services should be like your access to water. Like you go turn on the tap and it flows and it’s there when you need it. It tends to be a lot harder than that and a lot more complex. So, I think that’s been the driving impetus for me from like the last 12, 14 years is, we need to get the world to that place from where it is today.

And the differences I see between FinTech and crypto — at some level, it’s all just infrastructure. The FinTech guys typically started off by building on top of the existing financial system where the crypto guys are like, “Hey, we are going to build new financial systems, new payment systems around these blockchain economies, these blockchain networks. And some of the major differences I see there is that a lot of the FinTech folks are really very focused on the customer and the use case. And what are the problems you’re solving, which I think is a very good thing to me. The crypto folks tend to be very community first and they’re like, “Hey, we’re going to build a community of like-minded people. And we’re going to use this technology to excite and empower the community. And then the community as a whole is going to tackle and try and solve this problem.” In FinTech, you still see that ” Hey, there’s us, and then there’s our customers.” But in crypto, it’s like, who is a customer? Who is a builder? Those are just roles, which could be the same person.

Chris: I think that’s a really interesting way to put it. And one thing that I’ve always really liked since we first started talking about Sila, probably in 2018, was how you have this really good view of enabling your customers, who are generally developers or companies building new products, to build new products for those customers.

You started with instant ACH and for the FinTech nerds who are listening to this, I think people who spend time in this space know that ACH has been quite a hassle for a long time. And one thing you decided to do early on, which I will admit, I was very skeptical about when we started talking about it, was use versions of, call it early crypto architecture, to enable that. I think Sila at least for us was certainly the first example of a company that was enabling using some crypto infrastructure to enable use cases that may have nothing to do with what we tend to think about as crypto.

Shamir: Sometimes the way I like to think about this is in terms of financial networks. One of the jokes I say is that like old financial networks, like payment systems, just never die. They literally never die. All the oldest payment systems things like coins, cash, checks — anything that was used by a large number of people across a few different geographic areas is still with us today. And so, what ends up happening is, a lot of times in the tech world, you build technology and then you build new technology, and you’re like, you know what, we’re just going to start using the new technology and ignore the old. And you see that a little bit with the internet, like, email was one of the first killer apps with the internet in the ’90s. Email did not need to integrate into the postal service. Right. Uh, email was its own whole thing and it worked great, and it was awesome. And we still use the post. We use them for completely different things. That doesn’t work in financial services every payment system that gets built, gets built as a layer on top of a previous payment system. And then eventually all the users move to the new payment system. And so, when you’re building these new financial worlds, I think A lot of the early crypto people didn’t necessarily understand that they don’t work until they plug into the old — you kind of have to build them on top, integrate them into the old and then build new use cases, new functionality, move the volume over, and then eventually the old will die. You cannot have them exist as two separates — that doesn’t work in financial services. And so, I think the hardest problem in the whole crypto space sometimes is really the infrastructure to connect it into the traditional financial system. Because guess what? The traditional financial system sucks in many ways, and crypto may be way better, but if you can’t plug into the old, then you can’t move the value and the volume and the money. And that’s what we built Sila to do — to be that bridge between payment systems broadly, but especially between, new payment systems and new payment rails, like blockchain ones and the old ones. And to do that well, you have to do both of those well. You have to be plugged into the crypto ecosystem. You also have to have a deep understanding of how to do things like ACH payments and returns and KYC and compliance. Because that is what the old financial system is all about. So that’s what we choose to take on first is to solve not just the pure on-chain problems, not just the pure off-chain problems, but the combination of on and off-chain problems, that is the hardest thing to solve.

And so far, it’s worked. I mean, we have quite a few crypto customers who appreciate that on-chain, they can do lots of things and they can do it really well. But when it’s like, “Hey, how do you build a system and scale it on ACH, and then move that money over into a blockchain?” That’s hard, and they come to us for that. And then we have a bunch of FinTech customers who are like, “Hey, we are a FinTech app and we love being a FinTech app and we are growing and scaling nicely, but we like having the ability to potentially add the ability to buy or sell Bitcoin or Ether, or do NFTs or maybe access DeFi yield somehow.” All of those capabilities are interesting and we see those customers as well.

Chris: I think Sila is a great example, as you pointed out, of sitting right at the intersection of, call it crypto rails and ecosystem and traditional financial services infrastructure. And, to your point, those haven’t talked very nicely to each other, and people have to build the types of products that can reach into both sides of the ecosystems and say, “Hey, I can help you, for lack of a better term, build a bridge here”.

I think one thing that’s always helpful — I’d love you to walk through a customer example that can be hypothetical of what you can enable with Sila. With this kind of approach, you’ve taken that would just be really hard to do in some other way.

Shamir: There’s a few, not all of whom I can talk about. So, I’ll pick one of my favorite customers and they’re not necessarily that large, but they’re really cool and innovative, so I love talking about them. It’s a company called Fabrica and they do NFTs, but they do NFTs for land. So, if you go to www.Fabrica.Land, I think is their URL, you can sign up and they’ll verify your identity, link your bank account, and then you can go and you can buy a piece of land and they have a list of them and you can go buy like two acres of land in Southern California or middle of nowhere in New Mexico or Nevada or whatever. It’s a large country and there’s a lot of land out there. And an acre in Nevada is like, you know, $5 grand or $10 grand. You can buy on Fabrica legal ownership of a piece of land, which is sold to you as an NFT, which I find very cool because there’s this whole explosion of NFTs in the last 24 months. But most of them, when you look at it and you’re like, “Hey, what does this legally give me ownership to?” And it’s not very clear. Does it give you IP rights? Does it give you anything more than bragging rights to a piece of art as an example? And with Fabrica, it does give you legal rights to a piece of land.

They built the infrastructure on the back end, where they create a special purpose trust, move ownership of the land into that trust — the beneficiary of the trust is whoever is holding the NFT. They built all that infrastructure to do that. But on the flip side, when an NFT goes from John Smith to Jane Doe, and maybe Jane Doe goes and builds on the land or sells it onward, that’s her choice. Money has to go the other way, and they use us for that piece of it — for the onboarding, the identity verification, pulling the money out of somebody’s bank account, transferring it to somebody else’s bank account. And now, doing more sort of DeFi-ish sorts of things where it’s like the seller of the land can actually finance it and say, “Hey, instead of paying me $20K, you can do $2,000 bucks a month for 10 months. So, they build the on-chain capability to do that, but use our infrastructure on the back end to do all the money movement and the regulated functions behind that.

Chris: I think that’s a really cool example. And I like that there’s a product that in some ways is extremely crypto in this kind of NFT format. And yet, there’s the realization that you kind of need to use the existing financial infrastructure in an elegant way to be able to do what you want to do here. And Sila really fills that gap and natively can speak both languages. I want to switch gears a little bit here because we’ve talked about Sila for a little bit, but the other thing that you always have a pretty good beat on is the crypto and Web3 market in general. I’d love to understand how you think about the crypto market now and what should we make of the downturn and the noise that’s gone on, and where do you see the category and the overall market going from here?

Shamir: I think it’s actually a very exciting time in crypto. If you look at all the large crypto companies that are out there now and the folks who have real traction, most of them actually got started in the 2017, 2018, early 2019 timeframe. That was the last bust that was the crypto winter in which Sila got started as well. Crypto, especially you tend to see it’s almost like hypercycle, right? Every three, or four years you have a huge boom. And during the boom, a lot of projects end up getting funded — not necessarily from VCs. VCs actually are a late entrance into crypto and Web3— a lot of crypto fundraising has historically been community-driven. But a lot of projects end up getting funded that don’t look like very good ideas definitely in hindsight, but maybe a lot of people even in foresight thought they weren’t in great ideas. And then there’s a market crash and a lot of those ideas end up failing and these projects end up failing. And a lot of people lose money and then a lot of the air, but also a lot of the fluff, gets taken out of the market.

So, I suspect the things that are getting started now and being built now will drive the next boom three, four years from now, or maybe 12 months from now. I don’t know when the next boom will be. I’ve never figured out how to time these things. But we’re definitely in a crypto bust right now. I also am totally convinced that this is the cyclical nature of crypto. It is frustrating sometimes because it makes investment hard — you’re always on a rollercoaster, right. And people are not used to rollercoasters. But the markets will be back, and a lot of good projects will end up getting built now that will drive the next wave. And I think that’s true even in FinTech — the other space that we also operate in heavily. People look at the crypto boom and bust, and I think the FinTech boom of last year was just as big. And maybe the bust is just as big. But I think the same is true for it all. The underlying driver of this is global financial services is something like 20, 25% of global GDP — global GDP is like $100 trillion, a little bit more. So financial services like $20 trillion, and that’s annual revenue. But out of that $20 trillion, it’s like 1 to 2% of that is in FinTech and crypto. I think we are going to see in the next decade, that 1% go to like 10%. Even if you look in the world of the 2030s, like Chase and BofA and BNY Mellon, they’re not going to be gone. They’ll still be giants. They’ll still be doing a ton of business, but more and more of it will move to the new world. And that’s this underlying secular trend that’s driving FinTech, that’s driving crypto and Web3 and driving whole new use cases, products, and industries that we couldn’t even imagine a decade ago.

Chris: That’s a great segue because I was going to ask you on this theme of kind of crypto and Web3 overlapping with FinTech, maybe my personal thesis is: We need to see new and stickier and higher utility use cases emerge so there are good long-term reasons for users to use both of these rails and merge them. One way I’ve thought about it is, so far, the blockchain Web3 ecosystem has come up with one killer use case, which is cryptocurrency. Whether or not there’s volatility, we can say, “Hey, that’s a good use case”. The second use case, maybe it’s DeFi, maybe it’s something to do with NFTs, that’s still emerging.

You are sitting at a great spot where you get to see both sides of this world and your customers are the ones building those use cases. So if you look forward and you say, “Hey, here’s how this kind of crypto, FinTech overlap is going to emerge or going to continue to grow.” You know, what types of those use cases would you be most excited about?

Shamir: I think a lot of what’s going to happen over the next cycle and probably the next couple of cycles is just going to be increasing adoption. So, there was Bitcoin and Ether, and then there was this whole ICO boom, which drove the last boom back in 2016, 2017 — that went bust. And most of those cryptocurrencies went nowhere. Now we can look back on it and a few of them actually survived and built lasting ecosystems, whether it’s, BAND or Solana or whatever, but there were 2,000+ cryptocurrencies of which maybe 10 to 20 turned out to really hold value.

I feel like a lot of that needs to happen in the DeFi and NFT space as well. And when you look at an NFT, it’s like, what is this thing? It’s sort of a programmable token. It’s just a standard — on Ethereum, the ERC-721 is kind of the core of it. It is what you want to make of it. So, you have to really look at each NFT project or issuance and be like, what is this actually getting me? A lot of it early on has been around digital art, because that’s frankly, the easiest thing to move and sell online — you can send people to JPEG. It’s not hard.

The questions around what actual ownership is it giving me? What most people buy and sell in the real world all the time is not digital art. It’s not even physical art, it is phones, cameras, cars, houses, and every other type of real physical asset and virtual asset, whether it’s IP rights, whether it’s music, whether it’s video, all of those things. What NFTs really give you the ability to do is to program with those on a blockchain and build new sorts of applications or uses for them. You could not trade a piece of music across the world a few years ago, right? I feel like it’s those sorts of things that NFTs will get into, but the problem is, the more you get into the real world, the more you run into regulation. All of these markets are heavily regulated. The reason why the internet revolutionized advertising and tech and email is because those were not in regulated markets — it was easy.

All of this, whether it’s Uber with transportation or OpenSea with NFTs or whatever. These are regulated spaces, and if you want to get into them, you have to understand the complex mix of local, federal and international regulations. Because customers —they just want to go online, they want to buy cool stuff and sell cool stuff. And the fact that the buyer is in Nevada and the seller is in Vietnam, they don’t care, they’re part of the same online community — why can’t they sell to each other? The mess of laws between them is the real problem. So I think more infrastructure will get built to solve specific problems that will enable more of these applications and use cases to take off. So, a lot of the future is just more adoption, but what I call real adoption of DeFi and NFTs. I think we’ll see more interesting use cases combining this crypto and Web3-community-first approach with more and more real and virtual communities. Traditional finance wasn’t really designed for that. I think crypto naturally is. I think we’ll see a lot of that over the next, oh, probably 10, 20 years.

Chris: I actually saw a — you would probably know the name of this — I’m forgetting the name of this. There’s a version of NBA Top Shot for Premier League cricket. And I actually went to go try to buy. I was like, that seems like a good idea. I, I take, I own some of those NFTs, and I went to try to buy them, and they’re all sold out and you know, it was like, “Hey, come back at some arbitrary time. And hopefully, we’ll have some more of them.”

Shamir: Yeah, the cricket world tends to be heavily driven out of India. So, you might be in the wrong time zone. You might need to buy those things at like, you know, 2:00 AM Pacific or something and yeah, that’s the thing, right? The cricket following is so huge, but it is global, but it’s not really U.S. centered at all. Who in the U.S. plays cricket or cares about cricket? But a lot of Indians, Sri Lankans, Bangladeshis, Australians, and Britishers — the old British Empire — does.

I think that’s another thing that the U.S. as a country and as an economy is heavily financialized, right? Well over 80% of Americans have bank accounts, and lots of people have credit cards. It’s not like it’s easy to get a mortgage, but you could get one and it’s not super hard either. It’s just painfully processed, and paperwork driven. You look at the rest of the world and 80% of people in Africa or Asia have never had a bank account, and they’re just getting their first smartphones now. A lot of these people have never bought a single stock, never gotten a single loan, and never had a single bank account. And for them, they’re probably going to go straight to the crypto solutions. Because those crypto solutions are designed for them and the communities. They operate in.

Chris: I think that’s a really nice perspective. And I also think it’s good to point out that that’s a huge source of opportunity and can be a blind spot for us in the U.S. where we are so heavily financialized. And some of these tools are very natively, easy, at our disposal, in the traditional world, but for other places or for international things like cricket, that’s not quite the case.

I’d love to wrap up a little bit back on Sila and just more on your journey, which is you’ve been an entrepreneur now for a long time. This is your second, maybe arguably third company, always kind of at the forefront and in these emerging spaces. I’d love to know, if you think back over that career to date, what do you think the biggest lesson that you’ve learned from company building is, or what’s the most interesting thing that you have come across in your journey?

Shamir: I think one of the things that I’ve taken away is that market timing is impossible. I haven’t figured out how to do it at least, but persistence is massively important. Like, you might be a little bit early to a market. You might be a little bit late to a market. Or you might time it perfectly. You don’t know. You only know this in hindsight. Once you go public on the NASDAQ or whatever, you can look back at it in 10 years and say, “Yeah, I really should have started Simple in like 2011, that would’ve been the right thing to do. I’m like — Who knew, right? But if you’re persistent and you keep building and shipping, you just increase the odds of success. And ultimately, it comes down to knowing who your customers are and what value you’re delivering to them and staying close to them. And I try to do that even now at Sila, it’s hugely important because ultimately, that’s what everybody’s here for. They’re here to serve our customers and our customers typically are here to serve their customers. As long as you keep working with good people, doing good things, and keep pushing forward and stay persistent, you are increasing your chances of success. The hard part of it is — I know many people who did that and still failed. And then many people who didn’t necessarily do that that well, but still succeeded. There is a large amount of luck and a large amount of market stuff that drives outcomes in this space. That’s the frustrating part of it. All you can do is just do the things that increase your odds. If you’re around long enough, you’ll get dealt some bad hands, but you’ll get dealt some good hands too.

Chris: I love that. Be persistent, deliver customer value, and increase the odds of your success. I think that’s great advice and feels like a nice place to sort of wrap up. Shamir, I can’t thank you enough for joining the podcast today. It’s been a pleasure to be able to get to work with you for the last couple of years. And I keep looking forward to working together in the future.

Shamir: Same here, Chris. Thank you for having me.

Coral: Thanks for joining us for this week’s episode of Founded and Funded. If you’re interested in learning more about Sila, please visit SilaMoney.com. If you’re interested in learning more about Madonna’s take on crypto and Web3, head to Madrona.com/insights. Thanks again for joining us and tune in in a couple of weeks for our next episode of Founded and Funded with one of our Limited Partners — Top Tier’s David York.

Snorkel’s Alex Ratner talks data-centric AI and ‘one of the most historic opportunities for growth in AI’

Snorkel AI, Alex Ratner

In this episode of Founded and Funded, we spotlight Intelligent Application 40 winner Snorkel AI. Managing Director Tim Porter not only talks with Snorkel Co-founder and CEO Alex Ratner all about data-centric AI and programmatic data labeling and development, but they also dive into the importance of culture especially now and how to take advantage of what Alex calls “one of the most historic opportunities for growth in AI.”

This transcript was automatically generated and edited for clarity.

Coral: Welcome to Founded and Funded. This is Coral Garnick Ducken, Digital Editor here at Madrona Venture Group. Today, Managing Director Tim Porter talks to Snorkel Co-founder and CEO Alex Ratner all about data-centric AI and programmatic data labeling the two core hypotheses Snorkel was founded around. The research behind Snorkel started out as what Alex calls an “afternoon project” in 2015, but it quickly became so much more than that and officially spun out of the lab in 2019. Since then, the company has raised a total of $135 million to continue its focus on easing the burden required to label and manage the data necessary for AI and ML models to work and to extend its Snorkel Flow platform into an entire data-centric programmatic workflow for enterprises. Machine learning models have never been so powerful, automated or accessible as they are today. But we are still in the early innings of what it can do. IA40 companies are solving issues across the AI ML stack, but it all starts with clean data. Snorkel has built an incredible platform that taps into human knowledge and dramatically speeds up the data labeling that is necessary for the rest of the pipeline to work. Alex says that even the largest organizations in the world are blocked from using AI when it takes someone or a team of someone’s months of manual effort to label data every time a model needs to be built or updated. But that’s where Snorkel and its Snorkel Flow platform comes in. It should be no surprise that Snorkel was one of our 2021 intelligent application 40 winners, so I’ll go ahead and hand it over to Tim to dive into all of this and so much more with Alex. Take it away, guys.

Tim: Well, it is a real pleasure to be here with Alex Ratner professor of computer science at the Paul G Allen School of Computer Science and Engineering at the University of Washington, but even more relevantly the Co-founder and CEO of Snorkel AI. Congratulations on being recognized as one of the top 40 most innovative and high potential companies and ML/AI space broadly as voted by a large panel of VCs that are active in the space. None of whom could vote for their own portfolio companies. So, congratulations on that, Alex, and thank you so much for being here today.

Alex: Tim, thank you so much for having me and we’re obviously incredibly excited and more importantly, humbled by the honor. And I’ll note I’m not the professor yet. I’m an assistant professor, so it’s still a ways to go. But obviously, I’m very excited about the work that goes into both that on the academic side and Snorkel the company around what we call data-centric AI.

Tim: A VC once again, slightly over-promoting. I apologize for misspeaking on the title. But being based in Seattle and having a lot of connections with the University of Washington, we’re thrilled that, you know, over time that’ll be a home for you and you’re already doing a lot of things to impact the school there. But let’s talk about Snorkel. It’s been a company that I’ve followed for a long time. You and I have known each other for a number of years, Alex. But maybe we could start out by just telling our audience what exactly is Snorkel AI and what problems are you solving for customers?

Alex: We developed a platform called Snorkel Flow and it’s one of the first we call it a data-centric and programmatic development platform for AI. I think a lot of people know that AI today involves data, and it has centrally for quite some time. But what we do really is support this new reality that a lot of the success or failure in building and deploying AI applications has to do with the data they learned from. And not just any data, but carefully labeled what’s called training data, to teach them to do something.

So, we work with all kinds of customers the top five U.S. banks processing everything from loan documents to customer complaints and conversations in their chatbots all the way to medical images, network data, all sorts of stuff where basically users are trying to build machine learning models or AI applications that learn to predict or label something. And they do this by training on or learning from tons of data that’s been labeled with kind of the correct answer. If you look back 5+ years to when we started the project originally at the Stanford AI Lab, if you went onto the field and asked the practitioner, what are you spending your time on? What are you throwing team hours at? It would be all about the machine learning model or the AI application building some bespoke machine learning model architecture to handle chest x-rays or loan documents or conversational intents. And the data was an afterthought, or it was something that someone else prepared and labeled and did. You downloaded it from something like Kaggle or Image Net, and then you started your machine learning. This is what we now call model-centric development, where the data is something exogenous to the process that happens before from someone else. And you’re just iterating on your model. Fast forward a couple of very exciting years in the ML/AI space a lot of that model development is now for a staggeringly large range of problems, almost push-button a couple of lines of code thanks to some of the great companies and vendors and open-source contributions out there. And also, more powerful and more automated than ever before. But there’s always a trade-off. And the trade-off is that these new approaches are much more data hungry. So, the buck has shifted from model development to data labeling and development. And so, what Snorkel does is it tries to automate that data labeling development process- make it more programmatic, like software development — writing code, pushing buttons to label and develop your data — and solve that thing that’s often the bottleneck in AI today. This is complementary to the model development, which is often much more push button or, a line or two of open-source code. And this is based on techniques for this kind of data-centric programmatic development that we’ve developed over the last six and a half, seven years at, places including now UW, but also originally back to the Stanford AI Lab and co-developed and deployed with, lots of different tech companies, government agencies healthcare systems, et cetera.

Tim: This move from model-centric to data-centric — I really like how you frame that. We see that across companies and tying it back even to this notion of intelligent applications that data is really remaking how all applications are made, bringing new data to bear and providing new insights. I think most people also realize that ML is only as good as the training data that you bring to the problem. And this really helps speed and improve that. How the heck do you do it, though? It sounds a little bit like magic, so instead of having a person or a subject matter expert, being able to label this data, you’re able to do it with code. Two pretty hot areas that are talked about in the field — weak supervision and generative models — are two important building blocks on how you make that happen. Maybe you could spend a minute just explaining a little bit about the nuts and bolts and how you do this thing called programmatic labeling.

Alex: Yeah. So, I’ll start with the first thing that you said about magic. That’s one of the things I like to anchor on first in demos and customer presentations is that this is decidedly not aiming to be push-button auto magic. It’s still a human loop process, but it’s one that we aim to make look more like software development than just clicking one data point at a time to label it. Imagine, you’re trying to train a model to triage a customer complaint at a bank and maybe flag it as urgent or not urgent, or maybe, flag it with a specific regulation that it should be reviewed against. The traditional legacy approach that a lot of machine learning progress is based on is you’d have a bunch of people sit down and click through customer complaints, one at a time with the correct label. And that’s what your model would learn from. And in some ways, you know, what we’ve been working on is as much about inefficiencies or gross inefficiencies in that process, as it is about clever, algorithmic, theoretical and systems work that we do.

One way to think of it from that perspective is, if you have a subject matter expert sitting there who knows about all of these regulations and is reading these customer complaints, they probably know certain things they’re looking for. They have a bunch of domain expertise. They’re looking for certain phrases, certain keywords, certain metadata patterns, etc. Why can’t you just have them tell that to the model? In Snorkel Flow, they do exactly that. And some of it’s through no-code UI techniques, some of it’s through very heavily, auto-suggested, auto-generated techniques where they can even explain something they’re looking for and automatically label data that way. So, lots of acceleration automation, but at the core, it’s a domain expert using domain knowledge, heuristics, and programs to label the data, versus clicking one data point at a time.

We have customers who will take six months of manual labeling and collapse it into a couple of hours of this kind of programmatic labeling and development. The magnitude of the problem here is that a lot of these projects just don’t get tackled, especially take that example of customer complaints. You have data that’s very private, data that requires specific expertise, and data that’s always changing as input data changes and regulations change. We had a series of papers with Google and YouTube on how they were throwing away hundreds of thousands of labels a week before they started deploying Snorkel tech because even for a company with those kinds of resources, wasn’t scalable to label and re-label, every time something changed. So, we’re used to a lot of the kind of tip of the iceberg problems where we’re using machine learning to solve very standard problems. Is it a cat or a dog or a stop sign, a pedestrian, a positive or negative restaurant review? But there’s this whole iceberg under the surface of enterprise and organizational problems that are much, much more difficult to label at scale in this old way.

Tim: It’s fascinating, and just to double click on this point that it’s not magic, and you still need humans and subject matter experts, is that you want to start out with a set of ground truth labels that maybe comes from a human, but then you can use your technology to extrapolate from that to a much larger set of data, much, much more rapidly. I think it’s also clever how you use other organizational signals to try to come up with those labels in an accurate way.

Alex: Yeah. I like the parallel to software development. You don’t write down a bunch of zeros and ones every single time you want to compile a new program and you reuse assets, you use a higher level of abstraction, this higher-level knowledge. And similarly, that’s what we’re trying to do here. A lot of times, people try to apply AI in some enterprise setting. And the recommendation they get is — okay, great, you built all these things before, you have knowledge bases, you have legacy rules or heuristics. You have experts internally who have all this rich knowledge. You have models, you have all this other stuff — throw it out and start labeling data from scratch. Every single time you want to train a new model on a new setting. And what we’re saying instead is no use all that information. Use those organizational resources, whether it’s in a subject matter expert’s head, an underwriter, a legal analyst, the government analyst, a network technician, a clinician, and use other models, heuristics, and legacy systems to teach or bootstrap your machine learning model. And the cool thing is you can actually do this without any ground truth labeled data, although it’s often helpful to have a little bit of that.

You’d asked about weak supervision and generative models. A lot of the original theoretical work was diving into the algorithmic and theoretical aspects of this problem of, okay. If we shift the paradigm from labeling data points one by one, and assuming that they’re perfectly accurate, that they’re ground truth, which is, by the way, a very faulty assumption already, but, if you shift it to now having some programs, we call them labeling functions, that are radically more efficient, more auditable, more reusable, more, more adaptable, but also going to be messier and their heuristics. They’re not going to be perfectly accurate. They’re not going to perfectly cover all the diversity of data out there. They might conflict with each other and have all kinds of other messy aspects. How do you, ideally with formal guarantees, clean and de-noise and integrate those into a training set you can use. And that’s in fact, what we’ve spent half a decade working on about theoretically grounded techniques for using generative models and other approaches to figure out which of these labeling functions to up weight, down weight, how to de-noise and clean them. So, you can take this much more efficient, direct, but somewhat messier input and use it to train high-performance machine learning models.

Tim: Are there certain classes of problems or certain types of data or applications that this is best fit for?

Alex: So, we’ve applied it to everything from, self-driving to genomics to machine-reading and beyond, but I think some rules of thumb in terms of our inbound filtering, our outbound targeting is around where we think it will provide the biggest delta above other approaches.

One, first of all, is we handle structured data, especially messy structured data, but we also have a lot of focus on unstructured data. You hear about all these advances in machine learning, AI, all these new deep-learning or representation-learning models that are super powerful, but super data hungry. A lot of them provide the biggest deltas on unstructured data — think text, image, video, network data, data, PDF, website, etc. All this very messy long-tail data. Bigger data, more data-hungry models, and more need for data-centric AI development. That’s often where we sit.

Another rule of thumb is how expensive and difficult it is to actually label and relabel and maintain these big training datasets. If you’re talking about something that can be, a stop sign versus a pedestrian. Stop signs don’t change much, so you just leave it and maybe you can get by with a legacy manual approach there. But if you look at that iceberg under the surface of problems we tackle, think about very private data, very expertise, intensive data- financial insurance, medical government and most industries, honestly, anything with a user data network or technology and also settings where your data is changing, and your objectives are changing. So, you have to be constantly relabeling. So, when you have these aspects, suddenly the cost of just throwing people at the problem to kind of click, click, click, you know, a week or a month or longer at a time per model becomes infeasible literally for the world’s most well-resourced ML teams. And that’s where we like to step in to ease that bottleneck.

Tim: You mentioned moving towards even more data, hungry, deep learning, large models, you know, to extend that thought, these, very large-scale transformer models, foundational models that have gotten a lot of coverage. And then the ability that they provide to maybe do, one-shot or no-shot learning on certain problems or to refine them or train them with a smaller set of data for your specific use case. Do you see that as an overall large trend? And does that create more need for programmatic labeling?

Alex: I think it’s an extremely exciting trend, although it definitely will take a while to percolate into the enterprise for reasons we can go into about, everything from, efficient deployment to governance and auditability. But just talking about the tech trend for a second, it’s something that we’re very excited about. We had a recent webinar and a paper from my co-founder Chris’s lab at Stanford on combining these foundation or large language models with weaker programmatic supervision. And then we had another paper we just posted about using zero-shot learning on top of the large language models to automate some of these data-centric labeling and development techniques. So, we’re very excited about a whole host of complementary intersection points. And we already support basic pre-trained models of this class and these large language models in our deployed platform. In a nutshell, how I paint it is that these foundation models and a lot of us are not calling them foundation models because they serve as a great foundation for building or training or fine-tuning custom models or applications on top of them.

They do still fall into the general body of transfer learning techniques. And I’ll stick to very basic and old intuition that, you get what you train on, right? So, these large language models, let’s say they’re trained on something like web data when you actually want to use them to handle geological mining reports or clinical trial documents, or, loan documents, or, you know, the list goes on, they don’t just magically work out of the box, the zero or a few shot techniques don’t just suddenly solve the problem. You still need to label a bunch of data for the specific data and task at hand to get utility out of them. So, they’re very nicely complementary. But there’s a lot of very cool, but somewhat cherry-picked examples of what they do out there. They still need a lot of additional work to get them to be production level for enterprise use cases. So, there’s a nice complement there we’re very excited about.

Tim: You get what you train on — it continues to be a truism. Hey, you mentioned you know, the Stanford AI lab and your partnership with your Co-founder Chris Ray, maybe take us back to the founding story here, Alex. You put a lot of time into this before launching a company. You know, I feel like over the last few years there’s been this rush to start the company. Venture dollars are plentiful, so get while the getting’s good and you definitely took a longer path to get it to the point of saying, “Hey, we’re ready to commercialize this.”

Alex: Well, it all started with a massive con from my advisor and Co-founder Chris — he suggested this as an “afternoon project.”

Tim: I know there’s some lore about this started as like some math on a whiteboard, right?

Alex: Yeah, it was math on a whiteboard and then there was a Jupiter notebook. and we were, uh, teaching an intro course and we had just refactored it over the summer to center around Jupiter Notebooks, which was a really cool idea that also led to one of the most traumatic office hour sessions I had ever, where everyone in some massive intro course at Stanford came asking how they could install Jupiter Notebooks on every device imaginable. You know, My Tesla screen doesn’t support Jupiter notebooks, please help me ASAP — a five-alarm fire drill. I still remember that. It was a confluence of trends. One trend that was coming in was we had been working on all these systems for things that were more in the model-centric world. So feature engineering, model development, joint inference at scale, all these things that are super cool, but we were seeing this trend, kind of hitting us in the face from our users, who were, you know, biomedical data, scientists, geologists, all kinds of data scientists saying, “Hey, this is all great, but we’re starting to use these deep learning models and these other models and really our pain point is labeling the data. So could you help us with that?” Like everyone else back then — this is 2015, we said,” that’s not our problem, that’s someone else’s problem. We do machine learning. So. We’ll keep helping you with the fancy models.” Eventually, after being smacked in the face of this enough times, we said, “Hey there’s actually something here”. Everyone is getting stuck on the data and the data labeling and the data curation. Maybe we should look at that. So that was step one. Then, as we started thinking about more clever ways and looking at old techniques that did some of this and what our users were doing. Some of our users were getting very creative hacking together, ways to heuristically ad hoc labeled data. We said, okay, first of all, this is so painful that people are doing ungodly contortions just to hack together training sets. So, we said, “Okay, we’ve got to shift to this data-centric, versus model-centric realm. Because there’s something here.”

And then number two, we started asking, okay, how can we support this a bit more? So, we had this idea that we would come up with this kind of Jupiter Notebook where domain experts could quickly dump in some heuristics of how they were labeling data. And we would try to turn that into labeled training data. And that was the “afternoon project” that then spiraled wildly out of control because it just led to all these interesting problems of okay, well, how do you solicit information from the subject matter expert? How do you then clean it? Because even a subject matter expert is still going to give you rules of thumb that are only somewhat accurate. So how do we clean that and model it — that’s this weak supervision idea so that it’s clean enough to train a model? Then how do we build this broader iterative development loop that involves this kind of programming of data and then training models, and then, getting feedback on where to develop and debug next. That was how it all spun up. And then to your question of why were we so slow? Which is a fair one.

Tim: It’s a hard problem.

Alex: Yeah well, and honestly, I mean, we were and are very invested in this problem and in the kind of pathway that we’ve been charting with this you know, data-centric direction. And we’re always anchored on where’s the best place for us specifically to you know, center this effort. And for many years, I’m super biased, but we couldn’t ask for a better place than academia and the purview we had at Stanford. We had office hours weekly. We had everyone from major consulting companies to bioinformaticians to legal scholars coming by and trying to use these techniques. We had purview to work on getting the core theory and ideas. And we started to put some ideas out there, some code out there, we started to get some pull, started to get a bunch of people who were, trying to get me to drop out of the Ph.D. program with a pre-seed or seed round, or I had no idea what the terms meant back then, so it was all nonsense to me. But we thought that we had core problems to work out.

And then, four and a half years in, we started looking at what our users were telling us. And they were telling us things like, “Hey, maybe instead of, working on another theorem, which is cool and all you could help us solve the UI problems or the platform problems or the data management problems or the deployment problems or the feedback and error analysis guidance problems.” When that started happening, you know, we started poking our heads up and, decided, hey, it’s entered the next phase. We’re actually moving to a vehicle where we can put together a different set of people with different sets of skill sets to really build a product and a platform and engage more deeply with customers here. That was the next phase. So that was when we finally spun out.

Tim: I love that you were pulled by customers and customer-centric and making those decisions. It seems like you nailed the timing for when the market was ready and started to need these solutions on a bigger scale. But there’s another piece that you just hit on that I wanted to ask you more about, you know, we’ve talked a lot about the labeling aspect and that’s certainly the core of the solution that you provide. Snorkel Flow is a broader framework. Maybe talk a little bit about how that whole loop is important for Snorkel Flow.

Alex: Kind of our whole point, both research and product has always been that it can’t just be about labeling. When you think of labeling as this separate step in a vacuum, that’s where you get these very unscalable and impractical model-centric only setups.

The idea of data-centric development is that labeling and developing your data — so not just labeling, but sampling, slicing, augmenting all these things that people do as modern data operations. This is your primary development tool — not just to get data ready for models, but to adapt and improve models over time. And so, you have to have that whole loop otherwise you’re flying blind and you’re not really completing this kind of idea of data-centric guided development. So, our platform today starts with looking at your data sampling, labeling more broadly, developing, slicing, augmenting, etc. But then includes a full auto ML suite. Mostly just to give very rapid feedback. Where am I successfully training a model and where do I need to go next to continue this data-centric development? And then, you can export the model from our platform. We actually support broader multimodal applications. You can, if you want, just pull out the training data and train your own external models, we’re very open, but the core workflow has to include a model in the loop. And it’s more feasible than ever before to do that. Given all the kind of great modeling technology that’s out there in the open source these days.

Tim: One interesting observation about this space called MLOps now is I feel like, and sometimes joke, that companies that start out providing one important piece of functionality across this pipeline, for lack of a better term, whether it’s labeling or a feature store or deployment, you know, want to be end-to-end, and I think you just gave some good reasons why in this data-centric world, you need to be able to close the loop from watching how an application or a model is performing and tie that all the way back to iterating, to what’s happening with your label data. So that’s a good reason. But it also seems there’s a little bit of just, you know, startup imperialism that you want to be end-to-end and provide all these pieces.

On the other hand, I think you talk about plugging in other frameworks, other deployment mechanisms, other infrastructure management, it seems like you give customers the choice of like, “Hey, you can use Snorkel end-to-end, or plugin you’re best-of-breed for different pieces.” Is that the way you talk to customers about it? And is there a common way that customers tend to engage or is it really across the board?

Alex: So, and maybe three comments that are Snorkel specific, then I want to go back to that awesome phrase of startup imperialism. So, for us, first of all, there’s just a core definition of what we’ve been working on very publicly for over half a decade is this idea of data-centric development, which involves labeling. And that’s one of the several key interfaces, it’s one of the ways you can program your model. But it’s part of this broader loop that involves a set of, development, activities, and feedback from models, as you said. So that’s part of what we’ve always been, supporting and aiming to support. A second thing that’s specific to us is that we’re often approaching as I was talking about before a lot of zero-to-one type settings where you didn’t have a very sophisticated high therapist modeling stack because you were blocked on the data. You’re not predicting say customer churn where you already have the labels and you’re predicting column 20 from columns 1 through 19, you have just a pile of documents or a pile of chest x-rays or a pile of network flows, and, because it’s the zero to one state, there’s more of a pull often to just actually get to an end-to-end solution when you do go from zero to one.

And then the third point is just to touch on what you’ve mentioned, which is giving customers optionality. Our goal is to support a workflow that we’ve been working to define over the last six or seven years. But how you integrate different pieces into that workflow is something that we’re extremely open to. We have a Python SDK kind of one-to-one map throughout the whole process to make that really easy. And I think that’s critical if you want to play in this space. I think, on the one hand, I’m super biased, I think the most exciting technologies and projects will have an opinion on a workflow that is more expansive than just one little layer. But I think that workflow has to integrate with just the space that’s out there.

It’s an interesting question about startup imperialism and starting off with kind of one slice and then moving toward end-to-end. I think for a lot of folks in the space, there is also just a lot more pull to fill gaps than people may realize. I think if you just skim blog posts and academic papers, you would get a vastly different sense of AI maturity in the enterprise and the market than is actually the case. So, I think, people think we have this very complex, blog-post-defined-stack and every enterprise, but because of these problems of data is one of them and others around deployment and risk management, etc., we’re a lot earlier I think than many others do. And so often companies get pulled because there’s actually a bigger gap to fill them than people realize.

Tim: That’s a great point. And I want to talk more about that. So, you start helping a customer with problem X, maybe it’s, you know, the labeling issue here, and they’re actually asking you like, “Hey, we’re using you for this. We don’t have good solutions for these other pieces. Now help us deploy, now help us monitor. Okay. Now help us close the loop. But that’s a customer pull piece more than it is a high-level architecture strategy decision.

Alex: Yeah. And there’s a lot more of this pull in enterprise AI than people realize because there’s a lot less maturity than people realize just because there’s just so much to do. I think that one of the big challenges from a design perspective is where you draw the line so that you can really focus on what you’re uniquely best at. And we try our best to navigate that. We expand to cover this data-centric loop. We often push customers off and try to help them with reference architectures or connectors for pieces that we don’t think we have a special sauce around or that we shouldn’t spread into.

Tim: So, on this level of enterprise maturity, we have a thesis that we’re really at the beginning of a major wave of ML in production. Over these last several years, we’re kind of coming out of a period of intense experimentation at enterprises. Lots of innovation groups working on ML, working on models, seeing where they can build insights, and trying to get their data pipelines together. Cutting-edge companies certainly have been doing ML for years, but in those sophisticated examples, maybe there’s been an exponential increase in the number of models in production. Not that they are just getting them in production, but kind of the net effect is we’re at the beginnings of a pretty big bow wave of ML in production, both for internal applications, as well as the external applications that might be your company’s products.

So, is that what you’re seeing? Like where are we in terms of the innings here?

Alex: I think we’re early innings and I think it’s exciting because I don’t believe we’re early innings because of the lack of extreme concentrations of talent in the enterprise. There are historic levels of access to a lot of the core machine learning techniques, like the models, out there often in the open source than ever before. And so, you’ve got all the right ingredients, money has been put down, and they’re extremely talented data science and AI/ML engineering teams. You’ve got a flood of open-source tooling, especially around the models in the market, but you still have these significant blockers and headwinds that I think enterprises are really just starting to solve. Obviously, the one that we’re anchored around is the data. So, I think for that reason and everything else, that enterprises are very reasonably and responsibly trying to approach carefully, governance, auditability and interpretability, risk management, and deployment, we’re still in the early innings. And you see this kind of shift from the science project phase to the real production phase happening. And it’s a really exciting time to be in this space.

Tim: What industry verticals are you having the most success or focusing on the most and does that sort of map to this maturity that you’re talking about?

Alex: Our technology and our platform support a very broad set of problems. If you look at our publications and literature doing anything from, you know, self-driving to genomics to machine reading to many other things, but we focus on templatizing around certain core, very horizontal applications. And then today we work with very, highly sophisticated data science teams, and often with the kind of subject matter experts that have the domain knowledge about the problem in large enterprises across all sorts of verticals. We have a lot of customers — top five, top 10 U.S. banks and others in finance, insurance, biotech and pharma, healthcare, telecom, the government side and a range of others. So, it’s really these cross-cutting applications, things like dealing with unstructured data and, classifying, extracting, and performing other modeling tasks over them that we then templatize and target per vertical, where there are these great highly sophisticated data science teams that are blocked on the data.

Tim: I’ve used the term MLOps a few times in this conversation to describe the space. And I noticed you have not. I wonder if you like that categorization. We had another recent podcast in this series recently where Clem from Hugging Face and Luis from Octo ML hypothesize that in a few years, there will be no such thing as MLOps, it’s just DevOps and the problems that you have around machine learning deployment and management will be the same as any other application.

Do you like this category name MLOps, and do you think it has a future as its own thing or does it all converge?

Alex: I would’ve liked to be in that room for that debate. I don’t know if I’ll do justice to what that discussion covered. Okay well, why, why haven’t I used MLOpps? I think it’s growing to become a very expansive term. And so, I don’t have anything against it. I try to keep what we do a little bit more curtailed. I think there are many ways in which MLOps will remain its own thing and should. I mean, there’s a big difference between, code that is directly defined versus essentially code or programs that derive from, large statistical aggregates over, massive data sets that is just, fundamentally different in terms of how you build them, how you audit them, how you govern them, how you think about them.

Even the academic methods are very different — think more like formal analysis versus, something closer to statistical physics types of analysis. So, I think there have to be parts that are different, but I think also at the same time, there has to be many ways in which MLOps becomes closer to traditional DevOps and traditional software development. Obviously, that’s part of what we’re trying to do with data. We’re not going to get rid of all of the messy, unique properties of large data sets, but being able to at least treat the way they’re labeled and managed as more of a code asset and take a more DevOps stance versus this kind of manual activity. So, I guess in summary, I’m a big believer in pushing MLOps closer to DevOps and we’re, in some sense doing that at Snorkel, but I also think there are going to remain some aspects that just have to be unique and different even as they will get more standardized, commoditized and drift closer to DevOps as they have to.

Tim: Great points. Great framing. I completely agree with that. Let me switch gears a little bit. I was rereading your website, Alex, and I’m on the About Us page, you had your obligatory description of what the company does and then a rooted in research, point — we covered that and the cool beginnings from Stanford. And then I was struck, the next big part was about culture. How would you describe the culture at Snorkel? Are you a completely distributed company at this point? How have you continued to build the culture over these last few years, which have been tumultuous to say the least with everything going on in the world?

Alex: So, by culture, do you mean what code lender do we use? What’s our favorite sock emoji pack.

Tim: Um, among other things, yes.

Alex: I’m kidding. It’s obviously one of the, or the most important, questions, even divorced of the very unique situation we’ve been in over the last couple of years. It’ll sound somewhat vague and cheesy but, one of the most important things that starts at how we try to recruit and then goes into what we try to enforce a normalizes, is this, idea that can have extremely kind empathetic, friendly people who are also, very hard-charging and type A and obsessive about what they build and do, and that you don’t need to have one or the other. I think you can find people to work with in any context who are very fun and very kind but maybe won’t push as aggressively as you need to in the startup world. Finding people who can do both is the special thing. We always try to look for that intersection.

Of course, there are other extremely important things about building an inclusive, constructive, and positive environment. A lot of it is, again, back to cheesy comments, but about the balance of trying to always be extremely positive and supportive, but also, normalizing criticism and editorial input as much as possible as a positive, not a negative.

Tim: Are you fully distributed at this point? Is there an office-centric part of this? I’m sure everyone’s hybrid to some degree — how does Snorkel work?

Alex: Yeah. So, we just soft reopened the Redwood City office. So, for parts of our team where there, we have some parts of our go-to-market team in New York and distributed. We’re trying to navigate that in a way that’s responsive to what people want to do. We do plan to have some hybrid component and some in-person component. This is kind of an amateur hypothesis, but just from observations the last couple of years, I think you can do a really good job, and in some ways an even more efficient job of maintaining one-on-one relationships, small pods over virtual. But you face headwinds for cross-functional interactions and the broader social fabric. It’s really hard to schedule a five-minute Zoom meeting on someone’s calendar for like a bump into each other at the water cooler or walk by your office and overhear there’s a good essay that gets passed around for a lot of uh, uh, kind of intro grad students. When you start a Ph.D. program called, “You and your Research.” There was one statement I remember thereof saying that the people who always left their doors closed seemed to be much more efficient, but never really got anything done. So, I think there’s some aspect of that of you can be much more efficient with just everything back-to-back Zoom calls, and we want to keep some aspects of that, but also you lose some of that aspect of creativity, cross-functional interaction, and of course, social interactions. So, we’re going to try our best to navigate a path where we can capture the best of both. And that will be some form of hybrid that we’re still figuring out with our team.

Tim: Makes sense. And by the way, we love cheesy comments. I think some of those that might seem cheesy are the things that stick with people. Is there one ritual that you’ve established over the last few years that just works well for Snorkel that’s worth sharing?

Alex: We started doing these things we call “Whatever you Want”— “WW” at the beginning of all hands. We used to do it more than weekly at the beginning of the pandemic, but we do it weekly now, it’s just a retitling of “Show and Tell,” but it’s a couple of slides about any topic you want. And so, it’s a nice way to get to meet people who you’re not getting to bump into in the hallway and hear a little bit about some aspect of their life — a hobby, where they’re from a recent trip they went on. We did a series on failed past startups. So just little snippets and it adds a little bit more of the other dimensions to people beyond the purely kind of professional interaction. So that’s one thing that we’ve liked.

Tim: In this world of hybrid or remote, using the All Hands effectively, I think becomes really, really important. I did a panel at our CFO conference here with three chief people officers and the chief people officer from SeekOut had a different, but somewhat similar answer to what you just said. They said at their All Hands, they always kick it off with an opportunity for people to celebrate each other, which is something you said was core to your culture too, is to be, celebratory of each other, but still hard-charging. I think those little rituals mean a ton, especially in this world that we’ve been living in.

Alex: Puns are very important also. The things I’m most excited about as I recently had a second child, and I was informed by the team that I’m allowed to make two dad jokes per day now. So that’s been double the fun.

Tim: I have two kids also, and dad jokes and bad puns are right down my alley. So, there’s a lot happening in the technology markets and the public markets have corrected or repriced. You raised this awesome $85 million round last August. That was great timing. I’m sure you have a lot of cash in the bank. Your business also clearly is going well. What is your posture that you and your management team and board are talking about? Is it sort of, let’s keep accelerating here as fast as we can bear? Is there a little bit of a, ‘Hey things are good now, but we’re not sure’ in coming quarters? So maybe we don’t want to hire quite as quickly as we originally planned?” Or what’s your posture between sort of the gas pedal and the brake here as we go into the back half of this year. I know that’s a, no one knows no one has a crystal ball, but that’s a top conversation with all the companies that I’m working with.

Alex: It’s certainly uh, an interesting time. Seeing some of it as a return to sanity is obviously, I think, a positive for the space. Those of us who work in an AI, especially are always wary of over-hype leading to winters. I think for us, in particular, as you mentioned, we had recently raised a round. I think once you raise a bunch of cash in succession, you can either kind of go off the deep end or you can kind of instill good cultural habits and practices and grow up a little bit as a company. So, we were always planning to do the ladder and grow up a little bit. Obviously, the most important thing is being responsive to our customers, and we see just the same level of demand and, even more so for a lot of the projects that we try to anchor around with customers that are about increasing efficiencies and adding massive business value. And so, we’re still charging ahead at full speed. But we do think it’s a good reminder to be mature as a company and value efficiency and have that kind of culture and cadence. And I think it’s also a good reminder for the AI space to really, again, this is a little biased because we’ve been trying to do this from the beginning but focus on the business value rather than the science projects. We spend a lot of effort in our product building our go-to-market motion, trying to align with those teams and projects and budgets that are going to deliver a meaningful impact that’s robust. And so, I think it’s a good validation of that approach.

Tim: Very wise and very consistent with what we’re trying to counsel our company — don’t stop being aggressive, but efficiency ultimately also matters. And really inspect you know, new investments that you’re making because you may want to err on the side of making the runway last, even longer.

Alex: Yeah. I mean, we don’t want to slow down during one of the most historic opportunities for growth in AI, but I think you can keep going aggressively forward while also taking a nice reminder about the importance of building good, scalable practices, culture, etc.

Tim: Here, here! So, I’d be remiss to not ask, is there a company or two that you think are particularly cool or innovative in the field of ML broadly? Whether it’s an enabling company or a, finished application?

Alex: I may not sound too original cause the names already came up, but we’re big fans of Hugging Face and OctoML as representatives of those other areas of the ecosystem that, are very exciting and what they’re doing and just the evolution around models around infrastructure and, the fact that those companies exist and those technologies are at the stage of maturity, they are what makes data-centric AI development such a thing.

Tim: I’m sure we could do a whole separate podcast on learnings and tips and advice, but any tips for, maybe the technical founder, your best piece of advice that you’ve gotten on this journey — anything come to mind that you always think of first.

Alex: This is a little specific to data science and AI/ML but gravitates toward real customer problems and real customer pain. Don’t obsess over fitting into the perfect stack diagram or, you know, matching the perfect paradigm of scalability right away, go to where there are real problems, real data real use cases and learn from that.

Tim: Terrific customer-obsessed — customer-focused — is the most important thing. So, I’ve got to tell you maybe as we wrap up here, I’m sitting here, the audience, can’t see, I have my Snorkel T-shirt on, I’m a little bit of a Snorkel fanboy. A few years ago, some website or magazine interviewed me and said, what is a company you’re not an investor in that you’re most excited about? And I said, Snorkel. And Alex rewarded me with a box of swag, so I have this T-shirt to show for it. But the other piece that you don’t know, Alex, is that there was a pair of socks that you sent me, and you have the very kind of fun snorkel logo. And the socks were kind of too small for me. And my daughter saw them sitting on my desk at my home office, and they became her favorite pair of socks. She plays a lot of basketball. She’s in seventh grade. And I just want you to know that in the seventh-grade girl’s hoop leagues of Seattle, programmatic data labeling is being represented well with some flashy footwear.

So, thanks for that.

Alex: I think that’s going to be one of our biggest growth markets. We’re playing the long game here. So, I’m both incredibly humbled and incredibly appreciative because that’s going to be some great long-term value.

Tim: This is terrific. Thank you so much for your time. Congrats on everything you’re building at Snorkel. Thanks for the insights for other entrepreneurs and customers who are building in this world of machine learning and intelligent applications. And hopefully, we can do this again sometime.

Alex: Tim, thank you so much. And this was awesome.

Coral: Thank you for joining us for this IA40 spotlight episode of Founded and Funded. If you’d like to learn more about Snorkel, they can be found Snorkel.ai. To learn more about IA40, please visit IA40.com. Thanks again for joining us and tune in, in a couple of weeks for our next episode of Founded and Funded with Sila Founder Shamir Karkal.