back to index0 to over $8M ARR in 2 months as a Claude Wrapper (Bolt.new, Qodo)

Chapters
0:0 Introductions & Updates
6:1 Generic vs. Specific AI Agents
7:40 Maintaining vs Creating with AI
17:46 Human vs Agent Computer Interfaces
20:15 Why Docker doesn't work for Bolt
24:23 Creating Testing and Code Review Loops
28:7 Bolt's Task Breakdown Flow
31:4 AI in Complex Enterprise Environments
41:43 AlphaCodium
44:39 Strategies for Breaking Down Complex Tasks
45:22 Building in Open Source
50:35 Choosing a product as a founder
59:3 Reflections on Bolt Success
66:7 Building a B2C GTM
78:11 AI Capabilities and Pricing Tiers
80:28 What makes Bolt unique
83:7 Future Growth and Product Development
89:6 Competitive Landscape in AI Engineering
90:1 Advice to Founders and Embracing AI
92:20 Having a baby and completing an Iron Man
00:00:06.620 |
This is Alessio, partner and CTO at Decibel Partners, 00:00:09.220 |
and I'm joined by my co-host, Swiggs, founder of Small AI. 00:00:12.040 |
- Hey, and today we're still in our sort of makeshift 00:00:17.360 |
to have a former returning guest host, Itamar. 00:00:39.160 |
but we're also delighted to have our new guest, Eric. 00:00:50.280 |
That's the thing that we're probably the most known for, 00:00:55.520 |
because you were working at StackBlitz for so long. 00:00:59.720 |
we were doing like double the amount of traffic. 00:01:02.780 |
And StackBlitz had been online for seven years, 00:01:09.440 |
If you've heard of Bolt.new, that's our stuff, so. 00:01:20.080 |
and then suddenly you can exploit that to a new world. 00:01:28.600 |
I mean, that's, I mean, kind of a couple of months ago, 00:01:34.400 |
you know, we haven't really shared this too much publicly, 00:01:36.560 |
but like, you know, we actually had tried to build it 00:01:53.420 |
and then we got kind of a sneak peek of, you know, 00:02:10.200 |
the core StackBlitz product the past seven years 00:02:14.840 |
So the entire user experience flow we've built up 00:02:17.920 |
And so when we kind of went out to build Bolt, 00:02:25.560 |
given what is now possible with the AI code gen? 00:02:27.920 |
And so there's definitely a lot of conversations 00:02:35.640 |
to just greenfield a new thing and let's see what happens. 00:02:38.920 |
If it works great, then, you know, we'll figure it out. 00:02:57.160 |
Both of you have sort of re-founded your company recently. 00:03:02.000 |
I think a slightly different direction as well. 00:03:05.760 |
should we get caught up on where Codo is first? 00:03:08.880 |
And then, you know, just like what people should know 00:03:14.160 |
after we launched and we basically had the vision 00:03:18.520 |
The idea that software development is about specification, 00:03:23.800 |
We are more on the testing part as in essence, 00:03:30.400 |
- The beautiful chart that we'll put up on screen. 00:03:35.120 |
Like there are as many dimension, unit testing, 00:03:37.920 |
the level of the component, how big it is, how large it is. 00:03:41.440 |
And then there is like different type of testing. 00:03:45.380 |
So back then we only had like a one ID extension 00:03:51.920 |
So one and a half year later, first ID extension 00:04:01.880 |
but also 10,000s of repos for Fortune 500 companies. 00:04:06.280 |
We have another agent, another tool that is called, 00:04:14.520 |
And then we have another open source called the cover agent, 00:04:18.200 |
which is not yet commercial product coming very soon. 00:04:23.120 |
It could be that already people are approving 00:04:26.200 |
automated pull requests that they don't even aware 00:04:35.960 |
In one and a half year, what we did is grew in our offering 00:04:40.200 |
and mostly on the side of does this code actually works? 00:04:55.960 |
So, and then like for the first year was everything 00:05:02.600 |
2024, that was 2023, 2024 was starting to monetize, 00:05:06.560 |
to feel like how it is to make the first buck. 00:05:11.160 |
it went well with a thousand of teams, et cetera. 00:05:13.560 |
And then we started like just a few months ago 00:05:20.280 |
which is a lot of things that discussed in the last post 00:05:32.320 |
our company name was Codium AI and we renamed to Codo 00:05:38.400 |
So back to my point, so we started an enterprise motion 00:05:40.840 |
and already have like multiple like fortune 100 companies. 00:05:44.200 |
And then with that, we raised a series say of $40 million. 00:05:49.080 |
And what's exciting about it is that enables us 00:05:57.880 |
We're not coming very soon with an ID or something like that. 00:06:03.680 |
- Yeah, maybe we'll fork JetBrains or something 00:06:08.480 |
- I noticed that, you know, I think the promise 00:06:12.360 |
Like everyone is doing kind of what you're doing. 00:06:14.760 |
There's CodoGen, CodoMerge and then there's a third one. 00:06:19.440 |
- Which is like a commercial version of a cover agent. 00:06:23.080 |
- Yeah, I see something similar with factory AI 00:06:29.680 |
but people don't really want general purpose agents, right? 00:06:32.280 |
The last time you were here, we talked about AutoGBT, 00:06:52.640 |
hey, now be a QA or be a QA person or a developer. 00:07:15.600 |
just the same way you manage permissions for users, 00:07:31.320 |
like maybe there's a different tools, tool use, et cetera. 00:07:37.480 |
is a good reason why you wanna have different agents. 00:07:46.280 |
and now you need better tools to kind of manage it 00:08:04.160 |
going back to like the general versus like specific, 00:08:06.880 |
have you had people say, hey, this is great to start, 00:08:09.200 |
but then I want a specific Bolt.new.whatever else 00:08:14.880 |
and kind of like development or what do people say? 00:08:27.760 |
Like that's like kind of the biggest unlock that Bolt has 00:08:37.200 |
the working on like existing enterprise applications is, 00:08:40.440 |
I mean, it's crazy important because, you know, 00:08:45.280 |
some of these have been around for, you know, 00:08:48.480 |
And so it's important to be going from, you know, 00:08:55.600 |
is we see there's kind of two different users for us 00:09:01.000 |
It's like people that are developers already. 00:09:05.520 |
And more if they have, it's been very, very minimal. 00:09:12.280 |
and then they're ejecting the thing to get up 00:09:22.960 |
But for the people that don't know how to code, 00:09:24.360 |
they're actually just, they live in this thing. 00:09:26.560 |
And that was one of the weird things when we launched is, 00:09:36.120 |
And I originally saw the headlines and I was like, 00:09:39.440 |
I mean, I don't know, this doesn't make sense to me. 00:09:50.400 |
'Cause it's like cursor is a local IDE product. 00:09:55.920 |
and we have people that are using our product saying this, 00:10:00.280 |
And it turns out there are hundreds of thousands of people 00:10:08.520 |
where they're not traditional software to us, 00:10:13.120 |
it is very complicated, right, to do that with cursor. 00:10:23.840 |
it's a chat-based sort of interface that we have. 00:10:33.000 |
tomorrow I'm doing a live stream with this guy named Paul, 00:10:35.520 |
who he's built an entire CRM using this thing 00:10:40.320 |
And people have made their first money on the internet, 00:10:46.000 |
So anyways, that's kind of the two main categories 00:10:51.000 |
- I agree that I don't understand the comparison. 00:10:54.600 |
I think like we have like two type of families of tools. 00:10:58.320 |
One is like we re-imagine the software development. 00:11:02.560 |
And I think like a cursor is more like a evolution 00:11:21.960 |
like maybe Vercel, Veo, and maybe Repl.it in that area. 00:11:26.720 |
And then in the area of let's expedite, let's change, 00:11:36.040 |
We're different between ourself, Cursor and Codo, 00:11:39.080 |
but definitely I think like comparison doesn't make sense. 00:11:42.120 |
- And just to set the context, this is not a Twitter demo. 00:11:45.440 |
You've made 4 million of revenue in four weeks. 00:11:47.640 |
So this is actually working, you know, it's not a... 00:11:52.800 |
Like there's been so many people demoing coding agents 00:11:57.920 |
And then you guys were just like, here you go, it's live, 00:12:04.200 |
that was like interesting and maybe how that compares 00:12:16.440 |
So I kind of came back to the point you just made, right? 00:12:22.400 |
of like kind of rethinking the software development. 00:12:25.240 |
And then there's heavily augmenting existing developers. 00:12:28.000 |
I think that, you know, both of which are, you know, 00:12:35.840 |
it's allowing existing developers to hammer out software 00:12:39.080 |
far faster than they could have ever before, right? 00:12:41.040 |
It's like the ultimate power tool for an existing developer. 00:12:52.760 |
that aren't traditionally software engineers. 00:12:57.480 |
imagine you've never written software before, right? 00:13:01.400 |
he and I grew up down the street from each other in Chicago. 00:13:04.280 |
We learned how to code when we were 13 together, 00:13:07.520 |
And this is back in like the mid 2000s or whatever, 00:13:09.840 |
you know, there was nothing for free to learn from online 00:13:14.960 |
we asked our parents for, you know, O'Reilly books, 00:13:17.040 |
'cause you couldn't get this at the library, right? 00:13:19.000 |
And so instead of like an Xbox, we got, you know, 00:13:22.480 |
But the hardest part for everyone learning to code 00:13:24.680 |
was getting an environment set up locally, you know? 00:13:28.760 |
like kind of the key thesis, like seven years ago, 00:13:33.880 |
hey, it seems like the browser has a lot of new APIs, 00:13:36.760 |
like WebAssembly and Service Workers, et cetera, 00:13:39.240 |
where you could actually write an operating system 00:13:44.080 |
And you, you know, basically there's this missing capability 00:13:50.720 |
You should be able to build the web on the web. 00:13:52.520 |
Every other platform has that, Visual Studio for Windows, 00:13:55.560 |
Xcode for Mac, the web has no built-in primitive for this. 00:13:58.880 |
And so just like our built-in kind of like nerd instinct 00:14:01.520 |
on this was like, that seems like a huge hole 00:14:05.400 |
or like, you have a very valuable problem to solve. 00:14:07.080 |
So if you want to set up dev environments, you know, 00:14:09.040 |
this is what we spent the past seven years doing. 00:14:11.120 |
And the reality is existing developers running locally, 00:14:14.800 |
they already know how to set up dev environments, 00:14:34.480 |
no one else has been trying to make dev environments work 00:14:36.760 |
inside of a browser tab, you know, for the past, 00:14:39.840 |
if since ever, other than basically our company, 00:14:42.200 |
largely because there wasn't an immediate demand or need. 00:14:53.280 |
without downloading something to your computer 00:15:01.800 |
They're kind of looking at this as that sort of thing, right? 00:15:06.040 |
our impetus and kind of vision from the get-go. 00:15:13.080 |
an order of magnitude multiplier on how magic that is, right? 00:15:20.360 |
- Yeah, and you're going to deploy too, right? 00:15:23.960 |
- Yeah, and so that's what's really cool is it's, you know, 00:15:30.360 |
you actually built this at Netlify when you were there. 00:15:33.440 |
One of the most brilliant integrations, actually, 00:15:35.920 |
because, you know, effectively the API that Sean built, 00:15:40.680 |
we can just effectively give files to Netlify 00:15:50.640 |
But it basically is just this really magic experience. 00:15:53.800 |
'Cause when you come to Bolt, you say, "I want a website." 00:16:07.160 |
when we had a lot of people building personal, 00:16:26.880 |
And so he actually used Bolt to make a website to do that, 00:16:31.480 |
in the region she was gonna travel to ahead of time. 00:16:36.240 |
why didn't he use like Wix or Squarespace, right? 00:16:38.120 |
I mean, this is a solved problem, quote unquote, right? 00:16:41.320 |
And then when I thought, I actually used Squarespace 00:16:43.080 |
for my, the wedding website for my wife and I, 00:16:49.120 |
I know how to code, but I was like, this is faster, right? 00:16:51.960 |
there's a whole interface you have to learn how to use. 00:17:19.920 |
I think, why are we seeing this sort of growth? 00:17:34.080 |
And you can buy a domain name, attach it to it. 00:17:47.280 |
So I, you know, I probably should have disclosed 00:18:12.280 |
but I won't take claim for the anonymous upload. 00:18:20.560 |
You could drag and drop your zip file or folder 00:18:31.360 |
And it's just like, it's really nice, interesting 00:18:36.520 |
and a bunch of other sort of agent type startups, 00:18:38.360 |
they all use Netlify to deploy because of this one feature. 00:18:42.240 |
They don't really care about the other features of Netlify. 00:18:45.160 |
But just because it's easy for computers to use 00:18:49.920 |
for computers specifically that is easy for them to navigate, 00:18:55.760 |
that a lot of developer tools companies are having. 00:18:58.480 |
That's my Bolt launch story and Netlify CLI stuff. 00:19:03.760 |
Like I think you put a lot of weight on the technical modes. 00:19:06.920 |
I think you also are just like very good at product. 00:19:09.680 |
So you've like built a better agent than a lot of people, 00:19:18.920 |
But I think specifically on infra, on like the sandboxing, 00:19:22.000 |
like this is a thing that people really want. 00:19:23.960 |
Alessio has backed e2b, which we'll have on at some point 00:19:26.160 |
talking about like the sort of the server full side, 00:19:28.280 |
but yours is, you know, inside of the browser, serverless, 00:19:31.720 |
that it doesn't cost you anything to serve one person 00:19:33.960 |
versus a million people, it doesn't cost you anything. 00:19:37.440 |
I think in theory, we should be able to like run tests 00:19:48.120 |
But ideally you should be able to have a full agentic loop, 00:19:51.080 |
running code and seeing the errors, correcting code 00:19:59.560 |
At least in bulk, we've got a good amount of that today. 00:20:03.720 |
but one of the nice things, 'cause like in web container, 00:20:07.160 |
you know, there's a lot of kind of stuff you go Google, 00:20:08.960 |
like, you know, turn Docker container into wasm. 00:20:11.480 |
Like there's, you'll find a lot of stuff out there 00:20:19.200 |
is just writing an operating system from scratch 00:20:25.680 |
these Docker to wasm things will give you an image 00:20:28.360 |
that's like out 60 to 100 meg, you know, maybe more, 00:20:30.960 |
you know, and our OS, you know, kind of clocks in, 00:20:34.080 |
I think we're in like a, maybe a megabyte or less 00:20:38.120 |
I mean, it's, you know, really, really, you know, 00:20:41.520 |
- Basically the task involved, as I understand it, 00:20:52.240 |
like when you're looking at a dev environment, 00:21:05.080 |
or alternatively what you can do is you can actually be, 00:21:11.920 |
which is, at the beginning of the web in the late '90s, 00:21:15.400 |
there was two very different kind of visions for the web 00:21:19.000 |
where Alan Kay vehemently disagreed with the idea 00:21:26.680 |
was this document-based kind of browsing documents 00:21:29.800 |
Alan Kay, he's got this like very famous quote 00:21:32.120 |
where he said, "You know, you want web browsers 00:21:42.160 |
And what's kind of interesting about the history, 00:21:50.560 |
that the web became the most ubiquitous platform 00:21:54.760 |
that this is why WebAssembly has been invented, 00:21:57.320 |
is that we need to do more low-level things in a browser, 00:22:03.400 |
to build an operating system came to the browser, 00:22:05.480 |
and that was actually the realization we had in 2017 00:22:07.880 |
was, holy heck, like you can actually, you know, 00:22:17.360 |
you can actually now run web servers within a browser. 00:22:20.960 |
Like you can run a server that you open up, that's wild. 00:22:26.760 |
like I can have a URL that's programmatically controlled 00:22:32.280 |
Like the web can build the web, the primitive is there. 00:22:34.920 |
Everyone at the time, like we talked to people 00:22:36.280 |
that like worked on, you know, Chrome and V8, 00:22:38.280 |
and they were like, oh, you know, like, I don't know. 00:22:42.040 |
you just kind of have to go do it to find out. 00:22:47.000 |
And back in 2021 is when we kind of put the first like data 00:22:58.880 |
over the years of when we were doing the R&D on the thing, 00:23:07.560 |
the two types of applications are one, video games, right? 00:23:12.520 |
a lot of calculations that have to happen, right? 00:23:17.080 |
because you're talking about actually virtualizing 00:23:31.400 |
To effectively, you know, building app in app sort of thing. 00:23:39.760 |
Those are the people building games and IDEs, 00:23:42.120 |
they're the ones filing bugs on operating system level stuff, 00:23:56.200 |
just making Chrome DevTools be able to debug, 00:24:07.480 |
But it's a rising tide that's kind of lifted all boats, 00:24:11.800 |
of applications that you can debug with Chrome DevTools 00:24:14.360 |
that are running a browser that runs more reliably, 00:24:19.160 |
and, you know, games that are coming to the web 00:24:26.320 |
let's say, coding assistants from different kinds 00:24:37.760 |
- PR review is like a code review that is done 00:24:40.200 |
at the point of when you want to merge code branches. 00:24:43.920 |
But I would say that code review, for example, 00:24:46.200 |
checks best practices, maintainability, et cetera. 00:24:49.400 |
- It's not just like CI, but it's more than CI. 00:24:51.680 |
- And testing is more like checking functionality, 00:24:56.000 |
We call, by the way, all of these together code integrity, 00:25:13.720 |
it's testing is important, but I want to shed some light 00:25:20.760 |
Those startups that are doing autonomous driving 00:25:22.600 |
for highway and autonomous driving for the city, 00:25:27.120 |
and I think we saw the autonomous of the highway 00:25:31.360 |
much faster and reaching to level, I don't know, 00:25:35.200 |
four or so, much faster than those in the city. 00:25:41.200 |
and quote-unquote testing, verifying validation 00:25:44.960 |
that you're doing the right thing on the road 00:25:51.720 |
that it could be actually different technology, 00:25:53.840 |
and I claim that we're seeing something similar here. 00:26:02.480 |
That's what you're disrupting, what you just said. 00:26:04.800 |
Then basically, I would say that, for example, 00:26:10.160 |
and because you're more aiming for the end user. 00:26:19.600 |
but let alone those that do not know how to develop. 00:26:21.640 |
They need a slick UI/UX, and I think that's one reason, 00:26:25.160 |
for example, I think Cursor have really good technology. 00:26:27.960 |
I don't know the underlying, what's under their hood, 00:26:41.680 |
suddenly there's a lot of testing and code review technology 00:26:50.000 |
For example, let's talk about integration tests. 00:26:53.160 |
Probably a lot of what you're building in Bolt at the moment 00:27:07.760 |
It could be that eventually the highway AI companies 00:27:12.480 |
will go into the city and the other way around, 00:27:21.400 |
and when you think about enterprise software, 00:27:24.720 |
So to recap, I think the idea of looping and verifying your test 00:27:33.720 |
seems to be important in the highway AI and the city AI, 00:27:36.920 |
but in different ways, and critical for the city, 00:27:47.880 |
For example, when I'm using Bolt and I'm enjoying it a lot, 00:27:55.480 |
And also, I notice that you're breaking down tasks 00:28:03.600 |
but it seems like you're doing it really well. 00:28:05.560 |
So if you're willing to share anything about that. 00:28:08.960 |
I realize I never actually hit the punchline of what 00:28:12.280 |
I mentioned the point about us writing an operating 00:28:15.880 |
being important about that is that, to your point, 00:28:19.880 |
compared to a-- if you're running a cursor on anyone's 00:28:25.160 |
you're dealing with with the OS you're running on. 00:28:28.280 |
It could be like a million different things, right? 00:28:33.440 |
The thing with WebConnector is because we wrote the entire 00:28:44.080 |
is exactly what we did when we started building Bolt, 00:28:46.720 |
is we instrumented stuff at the process level, 00:28:49.400 |
at the runtime level, et cetera, et cetera, et cetera. 00:28:52.040 |
Stuff that would just be not impossible to do on local, 00:28:54.960 |
but to do that in a way that works across any operating 00:28:57.440 |
system, whatever, I mean, would just be insanely difficult 00:29:03.360 |
And that's what you saw when you've used Bolt, 00:29:08.980 |
or the actual web application itself is failing 00:29:11.120 |
or anything kind of in between, you can actually 00:29:16.280 |
of how we've implemented it, largely because the product just 00:29:20.000 |
So we got some work out of us, and we got to hire some more 00:29:25.480 |
We say, hey, here's kind of the things that went wrong. 00:29:28.200 |
There's a Fix It button and then an Ignore button. 00:29:31.720 |
and then we take all that telemetry through our agent 00:29:35.680 |
and say, here's the state of the application. 00:29:37.800 |
Here's the errors that we got from Node.js or the browser 00:29:42.800 |
And it can take a crack at actually solving it. 00:29:44.760 |
And it's actually pretty darn good at being able to do that. 00:29:48.600 |
closing the loop and having it be a reliable kind of base 00:29:52.360 |
has seemed to be a pretty big upgrade over doing stuff 00:29:59.480 |
And yeah, I think breaking things down into smaller tasks, 00:30:03.640 |
And I think Claude did a really good job with artifacts. 00:30:08.400 |
has kind of taken their approach of actually breaking out 00:30:11.640 |
certain tasks in a certain order into a concrete way. 00:30:18.360 |
So you can actually go and check out the system prompts 00:30:31.520 |
That was one of the fun things that we thought 00:30:33.720 |
would be cool to do, and people seem to like it. 00:30:36.380 |
I mean, there's a lot of forks and people adding 00:30:38.380 |
different models and stuff, so it's been cool to see. 00:30:42.120 |
I added real-time voice for my opening Dev Day demo, 00:30:52.360 |
It's funny, because I built on top of the fork of Bolt.io 00:30:56.880 |
And so you just told me you're going to merge that in, 00:30:58.320 |
so then you're going to merge two layers of forks 00:31:05.200 |
Eramar, you maybe go into the most complicated environments 00:31:08.280 |
that even the people that work there don't know how to run. 00:31:10.440 |
How much of an impact does that have on your performance? 00:31:15.040 |
Like, you know, is most of the work you're doing actually 00:31:17.280 |
figuring out environment and, like, the libraries? 00:31:19.120 |
Because I'm sure they're using outdated version of languages. 00:31:23.600 |
They're using forks that have not been on the public internet 00:31:28.720 |
is, like, there versus, like, at the LLM level? 00:31:31.440 |
One of the reasons I was asking about, you know, 00:31:36.960 |
because it really matters, like, what's the tech stack, 00:31:44.200 |
dealing with the real world, any environment of enterprise. 00:31:52.640 |
think you do enable, like, and bolt, like, to install stuff, 00:31:56.240 |
but it's quite a, like, controlled environment. 00:31:58.800 |
And that's a good thing to do, because then you narrow it down 00:32:08.720 |
One is the fact, just, like, installing our software 00:32:12.320 |
without yet, like, making it work, just installing it. 00:32:16.280 |
Because we work with enterprise and Fortune 500, et cetera, 00:32:23.560 |
Basically, we did a metrics, let's say, 96 options. 00:32:28.760 |
Because, you know, there are different dimensions. 00:32:35.800 |
to your Git, so you're having, like, GitHub, GitLab-- 00:33:02.080 |
I'm interested in these learnings, like, things 00:33:28.840 |
meeting before we launched Bolt, one of our investors-- 00:33:31.200 |
you can imagine, they were like, are you sure? 00:33:34.800 |
it was kind of a famous, very notorious Bolt. 00:33:37.640 |
And they're like, are you sure you want to go with that name? 00:33:47.600 |
There is a model dedicated for more for code review. 00:33:50.200 |
And there is a model that is for code embedding. 00:33:53.280 |
Actually, you might notice that there isn't a good code 00:33:59.120 |
Can you name one that would dedicate it for code? 00:34:05.440 |
And then you can do sort of like the hide for code. 00:34:08.680 |
And then you can embed the descriptions of the code. 00:34:17.240 |
and for different spaces, different fields, et cetera. 00:34:26.040 |
try to find there is a few code embedding models. 00:34:38.600 |
And just to go back to the '96 option of deployment-- 00:34:47.160 |
So one is dimensional, like what Git deployment you have. 00:34:53.920 |
Dotter could be like if it's air-gapped completely, 00:34:57.960 |
And then you have Azure GCP and AWS, which is different. 00:35:06.480 |
There are companies that do not do that, et cetera. 00:35:12.560 |
with one of all four enterprise, we needed to deal with that. 00:35:31.680 |
did actually a good job to build a lot of microservices. 00:35:38.320 |
But let's for a second assume that it is a good thing. 00:35:41.360 |
A lot of microservices, each one of them has their own repo. 00:35:47.040 |
And you, as a developer, want to develop something. 00:35:49.400 |
And I remember me coming to a corporate for the first time. 00:35:53.440 |
And I don't know where to look at, where to find things. 00:35:56.880 |
So just doing a good indexing for that is a challenge. 00:36:04.640 |
the one that you can find-- well, we wrote a few blogs 00:36:07.640 |
We also have some open source, different than yours, 00:36:13.480 |
You need to let the tech leads in the companies 00:36:16.960 |
For example, Mark with different repos with different colors. 00:36:33.320 |
And only then things actually work for enterprise. 00:36:36.720 |
And they don't get to a fatige of, oh, this is awesome. 00:36:44.480 |
But I'm quoting others, meaning GitHub Copilot, 00:36:47.640 |
that they see not so good retention of GitHub Copilot 00:36:55.920 |
and we have customers that are Copilot users as well. 00:37:03.840 |
between 38% to 50% retention for users using Copilot 00:37:22.840 |
needs that context of remote repos that are code-based, 00:37:27.240 |
So to make things work, there's a lot of work on that, 00:37:30.000 |
like giving the controllability for the tech leads, 00:37:34.360 |
for the developer platform, or developer experience 00:37:44.680 |
if you have really old legacy code, probably some of it 00:37:53.080 |
then there is a bias to repeat those mistakes, 00:38:02.440 |
For example, in Coda, you can have a markdown 00:38:07.400 |
And Coda will include that, and relate to that, 00:38:13.080 |
according to the best practices, just as an example. 00:38:18.720 |
that you need to do in order to deal with, like you mentioned, 00:38:28.200 |
I just want to say, what you're doing is extremely impressive, 00:38:32.480 |
the business of StackPulse, kind of before bulk came online, 00:38:35.000 |
we sold a version of our IDE that went on-prem. 00:38:39.680 |
about the difficulty of getting stuff just working on-prem. 00:38:47.400 |
I mean, we were just doing that with Kubernetes-based stuff. 00:38:54.080 |
Are you kind of plugging into Azure's OpenAI stuff, 00:39:05.520 |
Because, man, from what we saw on the enterprise side, 00:39:07.960 |
I mean, I got to imagine that that's a huge challenge. 00:39:22.760 |
I want only AWS and VPC on AWS, no matter what. 00:39:27.320 |
And then some of them, there is a subset, I would say, 00:39:30.680 |
I'm willing to take models only from Bedrock and not ours. 00:39:35.640 |
And we have a problem, because there is no good code embedding 00:39:40.200 |
And that's part of what we're doing now with AWS to solve that. 00:39:47.400 |
but run your run models on GPUs or Inferentia, 00:40:03.120 |
We see Azure where they're using OpenAI Azure. 00:40:13.640 |
Although there is Gemini, or even Sonnet, I think, 00:40:18.320 |
So all the options, that's part of the challenge. 00:40:27.600 |
that metrics that I mentioned, to start clicking 00:40:37.680 |
their networking is different, just everything's different. 00:40:44.840 |
Like, that it is, that's extremely impressive. 00:40:49.000 |
- It could be, by the way, like, for example, 00:40:50.480 |
oh, we're only AWS, but our GitHub enterprise is on-prem. 00:40:56.920 |
So we need, like, a private link, or whatever. 00:41:08.240 |
- And this primarily impacts your architecture, 00:41:11.360 |
Like, you have to, you can't choose some vendors because-- 00:41:22.640 |
By the way, it was hard for us with our technology. 00:41:28.680 |
I guess you're familiar with our Alpha Codium, 00:41:36.160 |
- Actually, we didn't have it in the last episode, so okay. 00:41:43.400 |
and then we can double-click on Alpha Codium. 00:41:59.160 |
And part of what we did there is taking a problem 00:42:03.360 |
and breaking it to different, like, smaller blocks. 00:42:05.920 |
And then the models are doing a much better job, 00:42:15.680 |
which is supposed to be able to do system two thinking, 00:42:24.520 |
But still, it's very useful to break it down for O1, 00:42:31.520 |
And that's what we presented, like, just a month ago. 00:42:35.600 |
They are doing 93 percentile with O1 IOI left, 00:42:47.600 |
And we took their O1 preview with Alpha Codium 00:42:53.800 |
and there is a big difference between the preview 00:43:09.240 |
Like, you know, I care about this philosophy stuff, 00:43:17.520 |
we take Alpha Codium, and as our principle of thinking, 00:43:21.960 |
we take tasks and break them down to smaller tasks. 00:43:25.800 |
And then we want to exploit the best model to solve them. 00:43:28.800 |
So I want to enable anyone to enjoy O1 and Sonnet 00:43:49.920 |
And to some extent, I would say that the flow engineering, 00:43:59.360 |
Because when you take a big block, a big problem, 00:44:18.720 |
as a startup trying to do different deployment, 00:44:21.400 |
getting all the juice that you can get from models, 00:44:35.120 |
And part of what we do is also open source, so you can see. 00:44:45.520 |
can sort of exchange notes on breaking down problems. 00:45:07.280 |
Adding the inference aspect on, we're like, okay, how does, 00:45:09.840 |
'cause I mean, there's not a lot of prior art, right? 00:45:11.520 |
I mean, like, this is all new, you know, this is all new. 00:45:13.840 |
So I definitely am going to have a lot of questions for you. 00:45:18.000 |
We have a paper on it, a blog, like, whatever. 00:45:23.800 |
- Yeah, and even the new results of '01, we published it. 00:45:30.360 |
I like your approach of being transparent and, you know, 00:45:34.600 |
'cause I think there's a lot of hype-ium around AI stuff. 00:45:40.920 |
that are just kind of keep their stuff closed source 00:45:46.680 |
to the incredible stuff that's actually happening here. 00:45:49.120 |
And so I think it's stuff like what you're doing where, 00:45:51.200 |
I mean, true merit and you're cracking open actual code 00:45:58.240 |
And it's great to hear that you're making such incredible. 00:46:01.000 |
- I have something to share about open source. 00:46:09.800 |
I actually wanted to ask you about your strategy, 00:46:12.800 |
there is, in my opinion, relatively a good strategy 00:46:18.320 |
but then you have the deployment and the environment, 00:46:27.080 |
but why should you try to deploy it yourself, 00:46:30.880 |
But in our case, and I'm not sure you're not going to hit 00:46:36.480 |
I wanted to ask you, for example, on some of them. 00:46:43.600 |
We are a platform, we have like the code review, 00:46:45.520 |
the testing, et cetera, spread over the ID to get, 00:46:50.960 |
or a big, big, like incumbents that are doing only that. 00:46:56.920 |
having not only a very similar UI of our open source, 00:47:05.000 |
And you know, you sit there and you kind of like, 00:47:09.480 |
Like, we don't use enough, like, grammarly or whatever." 00:47:12.040 |
And we had like a couple of these and we saw it there. 00:47:20.760 |
Bald is doing so well, and then you open-sourced it. 00:47:29.440 |
- Geohot said back, I think it was when he was, 00:47:33.440 |
I don't know what he was up to at this exact moment, 00:47:37.640 |
And someone had asked him like, "Why is this open source?" 00:47:40.120 |
And he's like, "If you're not actually confident 00:47:42.080 |
that you can go and crush it and build the best thing, 00:47:53.440 |
open source everything, 'cause for obvious reasons, 00:47:57.920 |
But I actually think a pretty liberal approach, 00:48:03.200 |
that like one of your competitors is taking your stuff 00:48:05.920 |
and they're like, "Yeah, like, let's just, you know, 00:48:11.560 |
I think it's kind of healthy 'cause it keeps, 00:48:13.160 |
I'm sure back at HQ that day when you saw that, 00:48:16.360 |
Well, let's, we gotta, we have to grind even harder, right? 00:48:23.680 |
'Cause you might feel this period of comfort. 00:48:26.240 |
I think a lot of companies will have this period of comfort 00:48:28.000 |
where, you know, they're not feeling the competition, 00:48:41.880 |
And that's, for us, the open-source version of Bolt 00:48:47.280 |
persisting chat messages and checkpoints and stuff. 00:48:50.560 |
that stuff was landed in the open-source versions. 00:48:56.600 |
And we're like, "We're trying to keep our servers 00:49:03.880 |
like the folks in the community did a great job, 00:49:07.120 |
And we've got to know most of these folks too, 00:49:10.120 |
at this point, that have been building these things. 00:49:14.040 |
Like, okay, well, if we're gonna go kind of land this, 00:49:16.120 |
there's some UX patterns we can kind of look at 00:49:19.680 |
You know, what's great about these, what's not. 00:49:24.920 |
I think from a competitive point of view for us, 00:49:26.880 |
for us, I think in particular, what's interesting 00:49:28.840 |
is the kind of the core technology of web container going. 00:49:36.040 |
there's really nothing that's kind of on par with that. 00:49:40.320 |
'cause, you know, web container runs in your browser, 00:49:42.080 |
but to make it work, you have to install stuff from NPM. 00:49:51.760 |
And so we actually sell web container as a service. 00:49:54.560 |
The original, one of the core reasons we open-sourced 00:49:57.000 |
kind of the core components of Bolt when we launched 00:50:07.120 |
kind of like what Anthropic did with Artifacts and Clod. 00:50:10.000 |
- By the way, Artifacts uses web containers, not yet. 00:50:14.880 |
- I think that they've got their own thing at the moment, 00:50:16.760 |
but there's been a lot of interest in web containers 00:50:18.800 |
from folks doing things in that sort of realm 00:50:21.320 |
and in the AI labs and startups and everything in between, 00:50:26.440 |
I imagine a good, you know, over the coming months, 00:50:28.440 |
there'll be lots of things to being announced 00:50:34.880 |
If you're a large model lab and you want, you know, 00:50:39.320 |
inside of your chat app, you should call Eric. 00:50:41.360 |
- But wait, wait, wait, wait, wait, wait, wait. 00:50:48.640 |
they felt that people are not using their model 00:50:52.160 |
as they would want to, so they built ChatGPT, 00:50:56.760 |
but I would say that ChatGPT now defines OpenAI. 00:51:00.880 |
I know they're doing a lot of business from their APIs, 00:51:10.680 |
Like, why don't you like focus on that instead of the-- 00:51:17.360 |
And so going into it, we, candidly, we were like, 00:51:25.000 |
but we were like, maybe that's allowed, you know, 00:51:29.120 |
we'd be mind blown if we added a couple hundred K of error 00:51:32.760 |
And we were like, but we think there's probably gonna be, 00:51:36.760 |
'cause there was some early poll on, you know, 00:51:43.080 |
kind of similar to what Bolt is doing or whatever. 00:51:45.800 |
We were actually prepared for the inverse outcome here, 00:51:48.920 |
but I mean, well, I guess we've seen poll on both, 00:51:52.800 |
and you're right, it's actually the same strategy 00:51:54.360 |
as like OpenAI or Anthropic, where, you know, 00:52:03.360 |
And so that's, we've kind of taken that same approach, 00:52:05.560 |
and we're seeing, I guess, kind of some of the similar 00:52:07.880 |
results, except our, right now the revenue side 00:52:14.880 |
- I think like, if you ask me what's my advice, 00:52:23.080 |
The third is to raise $1 billion or whatever, 00:52:35.720 |
because you're going to be chased by competitors, 00:52:38.560 |
and it's, I think it will be challenging, like, 00:52:43.040 |
I don't know, like, we do see these numbers right now, 00:52:45.680 |
raising above $100 million, even without having a product. 00:52:53.320 |
but also kind of challenging is you, you know, 00:52:57.840 |
okay, well, what, where are these things going? 00:53:11.160 |
you have this kind of the tech crunch launch of initiation, 00:53:17.080 |
we haven't, if there's going to be a downturn, 00:53:23.600 |
So now we're getting enough confidence in our convictions 00:53:29.720 |
- I'll tell you what other reason why I think like, 00:53:33.640 |
- They actually just announced some new numbers recently. 00:53:35.960 |
Like they, you know, they're still surviving. 00:53:38.720 |
I think that the peak that I heard was 100 billion ARR. 00:53:43.600 |
- And now, you know, there's like tens of these. 00:53:45.520 |
So I think like, and their success was phenomenal. 00:53:51.840 |
And I think like, if you want to keep that probably, 00:54:11.240 |
so like I share with you like a small competitor, 00:54:15.280 |
who has built a billion dollar company and more. 00:54:28.960 |
Like, you know, I'm thinking build some stuff 00:54:35.480 |
And I think, I thought that maybe you will answer as well. 00:54:37.520 |
Although like, I think Bolt already very promising. 00:54:40.280 |
For us, like Alpha Codium one is like GPT one. 00:54:43.760 |
I agree with you, like being open and open source, 00:54:46.440 |
et cetera, really helps to improve the product community, 00:54:55.960 |
Like Alpha Codium is the agent that is compatible 00:55:12.600 |
it kind of comes back to what GeoHot said, right? 00:55:16.200 |
there's no other option than out hustling everyone else. 00:55:31.480 |
just kind of burns the ships in a sense, right? 00:55:33.320 |
And then maybe that's the simplest way of saying it, 00:55:38.160 |
Yeah, I mean, there's a lot, tons of benefits to it. 00:55:41.440 |
They're now going to be agent force or whatever. 00:55:45.600 |
- We're going to try to get Mark on the podcast 00:56:06.400 |
And I think like you can see that like one dimension 00:56:19.040 |
And another dimension is like, where's their focus? 00:56:21.640 |
Is it like on the spec, is on the test and on the code? 00:56:24.800 |
And I think like, it's interesting to see that 00:56:27.960 |
We'll see more startup and more amazing announcement 00:56:38.600 |
To some extent, I would say that like Bolt is, 00:56:43.080 |
somewhere in the line between the spec and the code, 00:56:50.000 |
because you wanna like to look like you want in it. 00:56:56.400 |
And you see others like, I think like all the IDs, 00:56:59.080 |
most of them are the new IDs or the fork are there. 00:57:07.840 |
So these are trends, I think like we will see that. 00:57:10.680 |
And I think like another dimension to consider is like, 00:57:14.360 |
is it more for the highway AI, for the developers, 00:57:22.880 |
And that also like gives you like different products. 00:57:30.880 |
they will approach this triangle of spec and test and code. 00:57:36.200 |
And what I'm noticing is that we're seeing more and more 00:57:50.160 |
Eventually I think that that's where the world is going to. 00:57:58.200 |
But as agent improves and capabilities of the LLMs 00:58:03.000 |
and integrations to different parts of the environment, 00:58:06.640 |
development environment, we're going to see more and more 00:58:14.280 |
because you can say that tests are runnable specs, 00:58:26.800 |
- Yeah, look, I talked about system one and system two, 00:58:31.800 |
- And now with O1, people are talking about system one. 00:58:37.320 |
because I think they're totally, totally wrong 00:58:51.600 |
And the more they are aware of their environment 00:59:04.200 |
Love the philosophy talk that we had last time as well. 00:59:08.600 |
and it's more hard to leave for another interview, 00:59:14.480 |
And I held this sort of emergency council of advisors 00:59:19.480 |
for you because we had never seen this before. 00:59:23.480 |
all the smartest people I know to join this thing. 00:59:29.760 |
- You made a couple, you made one hire out of that. 00:59:34.120 |
I think I can't remember where we were at kind of ARR wise 00:59:38.640 |
- It was like, you messaged me at like two or three. 00:59:42.280 |
- And then by the time we got everything together, 00:59:50.400 |
- But I mean, it sounds like you've accelerated 00:59:52.600 |
'cause you told me it was like 100K, 200K a day. 00:59:59.440 |
every week has been kind of a blowout week as far as. 01:00:06.560 |
Kind of just like where all this stuff's coming from. 01:00:08.480 |
I mean, there's a ton of word of mouth, right? 01:00:11.320 |
which you can't just like look by refer, right? 01:00:20.360 |
in the sort of like, you know, entrepreneurial, 01:00:29.320 |
Our folks just kind of like flipped a switch. 01:00:31.960 |
people were just working through the weekends 01:00:39.040 |
Someone was like, yeah, I tried this like the first week 01:00:48.320 |
And so I think there's been an incredible amount 01:00:52.360 |
also to like the underlying models too, like Sonnet, 01:00:55.240 |
you know, that just happened to do an update on, 01:00:57.360 |
you know, with their release like a couple of weeks ago. 01:01:00.720 |
when we put our new agent online and the new Sonnet, 01:01:03.080 |
we saw a huge bump in conversion just based on that. 01:01:06.440 |
And so, yeah, like, you know, we've gone at that. 01:01:08.560 |
When we were chatting, that must have been three weeks ago, 01:01:11.200 |
you know, maybe an average of 100K ARR per day. 01:01:16.360 |
so I've said this every week, but we'll see if it holds. 01:01:19.120 |
the past couple of days have been like, you know, 01:01:23.720 |
I mean, you know, I think today we had our peak, 01:01:29.280 |
and that's kind of been, you know, every day this week. 01:01:30.880 |
But anyways, yeah, I think things just continue 01:01:32.800 |
to accelerate, which is kind of blowing my mind, you know, 01:01:35.080 |
'cause it's just the sheer numbers of this stuff 01:01:38.840 |
- I think you almost suffered from like the Twitter demo 01:01:45.880 |
I saw the demo and I was like, oh, that's cool. 01:01:47.760 |
Like I didn't go to try it because I was like, 01:01:52.920 |
And then two days ago, I signed up to use it. 01:01:59.520 |
And I was like, man, this thing really works. 01:02:02.160 |
I was like, and I already knew you, of course. 01:02:04.600 |
And I was like, man, this thing really works. 01:02:16.840 |
So first I was like, create a RSVP page for an event 01:02:25.680 |
And then I was like, well, now I need to have a way 01:02:33.080 |
And maybe what I would have done as a developer, 01:02:35.080 |
it's like, well, I'll create a different like admin view, 01:02:43.800 |
And then like just a pencil button on every page 01:02:48.920 |
And I was like, yeah, that works just as well. 01:02:54.120 |
because it like limits the amount of files that are there. 01:02:56.800 |
Can you talk just more about how much of this is like 01:03:00.120 |
how much you're prompting it to kind of like be 01:03:13.520 |
way if you had to quantify, you know, the effect is obvious. 01:03:17.320 |
The model is like this sort of like 10X multiplier. 01:03:19.800 |
How good the bottom line model is, huge, huge swing. 01:03:22.800 |
And then kind of what you can do on top of that, 01:03:24.800 |
you can squeeze out three, four X kind of more. 01:03:28.240 |
And so that's kind of where the realm of, you know, 01:03:29.740 |
prompt engineering and multi-agent approaches, et cetera, 01:03:40.020 |
like that kind of our core technology for the past, 01:03:43.660 |
his name is Dominic Elm, based out of Germany, 01:03:45.820 |
and he was one of the founding engineers of the company. 01:03:56.320 |
So think like a kind of like Google Colab sort of thing, 01:03:58.500 |
or like Hugging Face has their kind of version of this. 01:04:00.700 |
Back in 2016, it wasn't as much of a market for this stuff. 01:04:06.900 |
training, you know, ML models and that sort of thing. 01:04:11.500 |
kind of digging into AI stuff over the past year, 01:04:20.540 |
'cause he has deep understanding of our technology 01:04:26.020 |
But has a deep understanding of how these models work. 01:04:29.260 |
Going and actually kind of writing out these, you know, 01:04:32.140 |
whether it's like the prompt engineering aspect of it, 01:04:34.580 |
or multi-agent or whatever have you, you know, 01:04:39.140 |
And the other folks on the team are, you know, 01:04:44.540 |
I think we've been able to squeeze out a lot more 01:04:46.500 |
than I've seen almost anything else out there, 01:04:48.660 |
at least in the term of building web apps, at least. 01:04:53.900 |
we have more context on a fewer number of heads 01:04:57.900 |
So we can kind of connect the dots of it faster, you know? 01:05:01.140 |
with the whole raise a billion dollars thing. 01:05:09.660 |
'cause we went from, you know, call it zero customers 01:05:12.940 |
to, you know, 20, 30,000 kind of, you know, in six weeks. 01:05:17.060 |
We have to have certainly more customer support, 01:05:31.540 |
can be a thing that really hurts, you know, the company, 01:05:43.660 |
But I think for us, it's worked just to really, 01:05:46.660 |
you know, grow the team slowly and intentionally. 01:05:49.420 |
And so I think we're gonna take the same approach here 01:05:51.060 |
at a bit of a faster clip than we were previously. 01:05:53.220 |
But to me, that would just be general advice to startups 01:05:57.860 |
as fast as you can to meet demand or whatever. 01:06:03.260 |
like you're in a unique position to talk about, 01:06:05.220 |
but also kind of what we went through in our call was, 01:06:16.780 |
Because we have to sort of figure out like from our data, 01:06:19.900 |
you're now sitting on a ton of different customers 01:06:22.340 |
and we don't really know the different customer segments. 01:06:27.060 |
You're starting to get an idea of like segmentation. 01:06:34.460 |
because you were selling to enterprise for so long, 01:06:40.700 |
for a more sort of developer, bottom-up centric approach. 01:06:47.140 |
we're selling primarily to almost non-developers. 01:06:51.340 |
all the playbooks we had, not relevant here, basically. 01:06:55.860 |
So one of our investors I talked with earlier this week, 01:07:08.740 |
- Which is basically from an analytics perspective, 01:07:13.860 |
And to your point, you have people kind of around the clock 01:07:21.820 |
who are the types of people you actually want to retain 01:07:23.700 |
versus people that you know are just gonna churn out. 01:07:25.620 |
And that's okay 'cause they're not the actual like ICP 01:07:30.340 |
When you're building stuff for enterprise software, 01:07:36.940 |
and this is kind of what we found with StackBlitz, 01:07:41.340 |
it's very hard to sell on prem, extremely true. 01:07:44.700 |
But if you can do it, it's like the promised land 01:07:46.300 |
because these companies, they're Fortune 500s, 01:07:51.180 |
And so when you're going and selling to them, 01:07:52.700 |
it doesn't matter so much like on your website. 01:07:55.940 |
to the enterprise contact form or whatever, right? 01:08:13.740 |
how do we make sure they're kind of constantly successful? 01:08:17.820 |
like we can, our enterprise customer instances, 01:08:20.460 |
we have no idea how often they're using them. 01:08:23.880 |
we can't see what they're up to for a good reason, right? 01:08:30.540 |
it's actually much a very complicated problem 01:08:46.140 |
that we've gone and done and closed these folks, 01:08:59.180 |
going and actually really leaning in on analytics, 01:09:05.860 |
was the first time we had ever done enterprise. 01:09:08.460 |
Primarily, like thanks to the company we did before, 01:09:12.340 |
on how to do web development, basically, right? 01:09:26.500 |
So anyway, so that's, it's kind of cool to, you know, 01:09:41.460 |
- It's like, you're running out of tokens, dude. 01:09:44.900 |
I was like, "Fuck, I'm running out of tokens?" 01:09:46.780 |
It's like, "I don't want to run out of tokens." 01:09:48.460 |
But there's like five different tiers, right? 01:09:50.780 |
Which are kind of like token-based and capacity-based. 01:09:53.700 |
How do you reconcile that and the consumer side, 01:09:56.380 |
where maybe the consumer doesn't even really need to know 01:10:00.140 |
Like on that, like your mom probably doesn't really care 01:10:06.140 |
And then maybe ideas that you have to like improve 01:10:10.860 |
So when we first launched with StackBlitz is like, 01:10:20.180 |
And then we had a $9 plan and that was just the way it was. 01:10:23.020 |
It was kind of like our $1.50 hotdog at Costco. 01:10:25.820 |
It's kind of like this, you know, just low price, 01:10:28.580 |
just, you know, it wasn't the primary rev driver. 01:10:37.620 |
"Hey, we'll probably get a good number of people 01:10:51.420 |
And then once we hit week two, I mean, we were just, 01:10:55.140 |
it's like the cheapest AI coding thing you can get, 01:11:02.180 |
and just the sheer volume of people coming in. 01:11:13.340 |
and there's no way to actually like buy more of these things. 01:11:17.580 |
you can't get that much inference out of that. 01:11:20.140 |
And so here's the other thing that's interesting about bolt 01:11:22.220 |
compared to like something like copilot or whatever. 01:11:28.660 |
But basically what we ended up at that moment, 01:11:31.220 |
we ended up realizing is that when you use copilot, 01:11:35.020 |
it doesn't provide a lot of context of your code base. 01:11:41.180 |
And I think the origins of this stuff is they, 01:11:44.140 |
everyone kind of wants this like low price point 01:11:51.380 |
and then I can just do as much of the movie watching 01:11:57.860 |
when these first AI products came, it kind of makes sense. 01:11:59.740 |
They're like, "Okay, well, we don't want to meter it 01:12:02.860 |
But the problem is that then they're incentivized 01:12:07.740 |
the more context you give it, the more it can do. 01:12:09.620 |
And that's the magic of what we're doing with Bolt 01:12:11.860 |
is we're giving it all the context we possibly can. 01:12:21.060 |
in the entire state of the application, et cetera, et cetera. 01:12:25.780 |
versus if you go to copilot and say that it'll be, 01:12:38.420 |
they were like, "I want to give you more money. 01:12:44.300 |
We just turned it around and just, you know, we said, 01:12:46.380 |
"Okay, well, what do we think is reasonable?" 01:12:49.780 |
You immediately double the prices of the base tier 01:13:02.020 |
And so, yeah, so that's kind of the origins of it. 01:13:04.540 |
And it was people that use it, fall in love with it, 01:13:09.780 |
And the problem is the inference is expensive. 01:13:14.180 |
we have not really taken a margin at all on this stuff 01:13:16.340 |
'cause we're just trying to put all the value back 01:13:20.020 |
and just getting the D maximum amount of value out of it. 01:13:22.100 |
But it's really key to kind of the magic of the experience. 01:13:24.580 |
And so the other thing kind of worth mentioning 01:13:27.460 |
but then you can also buy additional tokens, you know, 01:13:32.740 |
And that's accounting for an additional 20, 30% 01:13:37.460 |
People are actually using this to do their jobs. 01:13:44.420 |
They're going in using Figma to make a design. 01:13:47.620 |
They have to like punch that out into code, kind of, 01:13:53.100 |
There's just wild stories online where it's like, 01:13:56.100 |
guy, a local bakery is like, "We need a website." 01:13:58.700 |
He's like, "Okay, I'm going to charge you a thousand bucks." 01:14:17.380 |
So some of the biggest power users are people 01:14:33.940 |
you know, you're probably just copying something else 01:14:38.180 |
it doesn't really matter how much time it takes you 01:14:39.980 |
because everybody's going to be so fast with these things. 01:14:44.740 |
was almost like, there's only really going to be like, 01:14:47.420 |
either $20 a month users or like $1,000 a month users. 01:14:59.980 |
So yeah, it makes sense that you have like a big part 01:15:07.500 |
I think it's 'cause it's like enough to actually, 01:15:16.620 |
And so it's been interesting to just kind of see the, 01:15:21.140 |
But what's been kind of cool about the product is it's, 01:15:36.220 |
part of the problem before is that it didn't matter 01:15:47.340 |
one of the first power users that adopted Bolt 01:15:53.020 |
And she had an idea for this app called ViralHooks.ai, 01:16:04.340 |
it goes and extracts hooks from other people's videos 01:16:07.260 |
and helps you with like, you know, AI to write your own. 01:16:10.460 |
And she had originally, the week before Bolt launched, 01:16:14.580 |
And, you know, some, I think a developer in like Ukraine 01:16:27.820 |
and she had the app built within a week or two. 01:16:49.220 |
there's people like when we've had a lot of people go, 01:16:52.580 |
And we're like, well, we're not even taking really a margin 01:16:56.340 |
But also, but when you compare that to the price 01:17:01.620 |
anyone who knows the price of building quality software, 01:17:05.700 |
It's a 99% cost production and 5X faster, you know, 01:17:10.780 |
So anyway, so that's, I think we're one of the first products 01:17:14.140 |
that have actually come out kind of proving that, 01:17:19.140 |
To kind of underscore the point, as you can imagine, 01:17:21.580 |
we've had, you know, kind of venture capital firms 01:17:24.940 |
curious to kind of, you know, what we're up to or whatever. 01:17:28.860 |
there's kind of, one of the most notable ones 01:17:32.300 |
or whatever reached out, so we kind of sent them, 01:17:41.500 |
And one of their analysts accidentally replied all 01:17:46.860 |
And so on this part there, one of the things they said was, 01:17:50.060 |
we haven't seen anything that's kind of eye-opening 01:17:52.660 |
to see people going to $200 tier on this sort of thing. 01:17:56.100 |
Haven't seen anything else like that in the space. 01:17:59.420 |
because of the new model capabilities, right? 01:18:02.940 |
Like you're willing to pay more money for this stuff, so. 01:18:06.860 |
in terms of matching the dollar amount of spend 01:18:12.300 |
The chart that I published in the past was, you know, 01:18:28.900 |
but you can sort of each match each of them with like tiers. 01:18:42.380 |
I think BrightWave is also there, by the way. 01:18:47.940 |
And like, you have to deliver more value for that, 01:18:56.140 |
- I think we're going to see a lot more of this. 01:18:58.540 |
and I think, you know, for AI, Cogen specifically, 01:19:04.220 |
there's been that moment where it goes from zero to one, 01:19:07.300 |
where it's like, yep, the price point, you know, 01:19:16.220 |
three, six months ago that I think we're going to see, 01:19:19.700 |
I think we're going to see a lot more of this. 01:19:23.420 |
one of the first things, but yeah, I mean, it's just, 01:19:27.460 |
to me, it's inevitable that we're going to see 01:19:29.940 |
many more things kind of leveraging this sort of use case 01:19:39.620 |
would be, quote, the price based on the query. 01:19:43.700 |
- Yeah, it's like, hey, it's like your mom is like, 01:19:45.900 |
you wouldn't charge your mom $2,000 to tell her stories, 01:19:50.740 |
and like a product on it, you gotta pay more, you know? 01:19:55.580 |
I understand it's like, it's really hard to figure out 01:19:59.580 |
how much value the person will get out of the thing. 01:20:02.980 |
- So I want to riff a little bit on stuff like this, right? 01:20:05.500 |
I think you nailed a lot with the design system. 01:20:07.420 |
You know, one of the differences between open source Bolt 01:20:11.900 |
you spend a lot of time on the design system, I think, right? 01:20:15.820 |
Most things just look great when they come out, 01:20:17.820 |
but then there's also a whole backend portion 01:20:21.420 |
Is there anything that you sort of like figuring out 01:20:30.380 |
we originally, again, we've been selling to developers. 01:20:32.340 |
And so we were kind of like, this is a tool for prototyping 01:20:35.820 |
But what we ended up finding in the early user testing 01:20:39.500 |
and how, and this is something you said to me specifically, 01:20:54.220 |
that folks coming to Bolt, you know, are looking to do 01:20:56.500 |
is build a real app with a backend, with billing. 01:21:02.060 |
He's like, there's three things that like every app 01:21:05.980 |
and any of these other people in this community, 01:21:08.060 |
there's three things, a database, auth, and payments. 01:21:15.620 |
- We can do that pretty decently, pretty decently. 01:21:23.500 |
And so, yeah, today I think like Viral Hooks, for example, 01:21:26.060 |
I think she's using Firebase for auth and database 01:21:31.740 |
those are the two things that just work incredibly well. 01:21:35.140 |
And so that's actually the point where we're at now, 01:21:38.860 |
folks have to still, you know, kind of go to Superbase, 01:21:48.740 |
You have to, there's like kind of steps, right? 01:22:07.580 |
- I'll go even further, like have like pre-warm instances 01:22:11.100 |
that you just assign, like it's already spun up, right? 01:22:16.420 |
even though it's like not really, but like, yeah, 01:22:18.780 |
just pre-warm and then just kind of assign it 01:22:22.620 |
Yeah, just keep one Firebase in the hopper, basically. 01:22:35.180 |
understanding your customers and do a data analytics 01:22:42.460 |
But then like, you also have to work on like, 01:22:50.540 |
I wanted to keep pushing you and I don't know if I did, 01:22:54.060 |
mostly 'cause I was serving as facilitator on that call. 01:22:58.380 |
Like, I think you got to still keep pushing the frontier 01:23:00.380 |
and I don't know what it is, but like, you know, 01:23:06.580 |
we've addressed just a lot of the low-hanging P0 stuff 01:23:09.300 |
then and we've actually seen, we've kind of the, 01:23:11.940 |
yeah, there's key moments where it's just kind of like 01:23:16.420 |
'Cause it's like, okay, well, we're just getting started. 01:23:24.340 |
how can we just make it faster to go from idea to production? 01:23:36.780 |
Yeah, and same thing with the deployment side. 01:23:43.020 |
And so I think one of the things we're gonna end up doing 01:23:46.740 |
And so I've been talking with Matt over at Netlify 01:23:49.580 |
about this, 'cause they actually have a way to kind of- 01:23:52.940 |
And so, 'cause people are just going to make a website, 01:24:01.340 |
A couple of months from now, you come to this thing, 01:24:02.660 |
you're like, "I want to make an RSVP site," right? 01:24:06.660 |
And it's like, "Great, do you have a name for it? 01:24:26.300 |
You know, like that's without leaving the product, right? 01:24:29.260 |
- So to me, like Itamar was the first to actually say like, 01:24:32.660 |
I never, I personally never thought about it that way. 01:24:39.300 |
- From what we're hearing from the folks using the product, 01:24:47.140 |
- But not to say that we don't want to, you know, 01:24:48.700 |
that that, what you're saying is now what we want, 01:24:53.220 |
And I think that there's a huge gap in the market 01:24:56.900 |
kind of more sophisticated, high quality software, 01:25:04.340 |
And so I think there's a huge market for that. 01:25:05.900 |
And obviously, even if you're trying to build 01:25:07.020 |
a wedding website, yeah, this is easier and faster, right? 01:25:12.180 |
You know, again, coming to the origins of why Albert, 01:25:16.500 |
we've always just loved building stuff on the web. 01:25:20.180 |
from what, even when Stack was just the IDE interface 01:25:28.380 |
if this is the thing I wish we had when we were 13 years old, 01:25:30.620 |
I'm so glad that my daughter's gonna have this thing, 01:25:33.500 |
So anyways, yeah, I think it makes me pretty, pretty stoked 01:25:36.300 |
that people are gonna be able to actually build 01:25:41.300 |
that can do really sophisticated things, you know? 01:25:43.900 |
So yes, I think the short answer is heck yeah. 01:25:58.540 |
You know, like the previous generation of site builders 01:26:06.380 |
Or are we just like, you know, always been on JavaScript 01:26:10.500 |
- You know, I think we're certainly with great interest, 01:26:21.220 |
I think especially with the stuff we're seeing though, 01:26:23.180 |
it's the language is kind of ancillary to the thing. 01:26:39.780 |
So I think you'll certainly be able to get people 01:26:42.460 |
And I think the only thing that would be missing 01:26:47.580 |
is only in libraries that are in Python or something, right? 01:26:50.700 |
And I think just kind of seeing the applications 01:26:57.260 |
And so that's, we're not seeing a lot of that stuff. 01:27:07.260 |
And I think they started off with like doing Python service. 01:27:09.180 |
Actually, I haven't tried their new agent stuff 01:27:15.820 |
Repl.it has the database, the sort of live hosting, 01:27:20.300 |
everything integrated that you're going to want to build. 01:27:23.460 |
And I think you're on a collision course with them, 01:27:38.980 |
what's kind of the end goal that you're shooting? 01:27:46.980 |
even if focusing on a language or an ecosystem as well, 01:27:50.100 |
'cause again, the problem is that these things 01:27:54.700 |
a lot of the work in making the experience better, 01:28:25.780 |
they may not need that level of kind of streamline, 01:28:29.380 |
I think that's kind of where I see the main divergence 01:28:31.260 |
is that we are unabashedly focused on this ecosystem 01:28:41.060 |
'Cause it's, I think what they're doing is actually, 01:28:42.980 |
I mean, I'm very curious to see what Microsoft does. 01:29:02.180 |
I must imagine that they're cooking stuff over there. 01:29:13.220 |
I just have one personal question before we wrap the pod. 01:29:17.700 |
now that you've been through this journey, right? 01:29:25.940 |
Thinking about, there are many founders out there 01:29:30.300 |
they're working really hard at it, it's interesting, 01:29:34.740 |
And you kind of took the plunge to invest in this, 01:29:42.220 |
Obviously there's a little bit of luck in everything, 01:29:48.660 |
How would you advise someone who was in your shoes 01:29:51.020 |
and thinking about, maybe I should have a second product. 01:30:03.380 |
You know, I was like this, I think there's something here. 01:30:07.020 |
but I had waited a long time to give you the call. 01:30:13.100 |
at the beginning of the conversation with Sean, 01:30:16.980 |
in SF and so I was kind of giving him the pitch of like, 01:30:21.700 |
I think that I can't remember the exact framing I said, 01:30:34.700 |
And Sean, you gave me this like skeptical look. 01:30:46.380 |
of just kind of going and jumping on hype trains is good. 01:30:54.700 |
is the most important thing when you're a founder. 01:30:58.340 |
like I had mentioned at the beginning of this, you know, 01:31:17.940 |
and then going and talking to the smartest people you know 01:31:19.660 |
with more domain knowledge on that stuff than you have 01:31:32.340 |
'Cause I walked away from that and I was like, 01:31:36.100 |
Like this, you know, like Sean's at the intersection 01:31:41.740 |
has one of the best perspectives on this stuff 01:31:45.340 |
That put a huge, you know, wind in our sails, honestly, 01:31:51.340 |
let's go and double down here because, you know, 01:31:55.700 |
who's in the space independently kind of verify 01:32:03.380 |
And I waited, I waited until I was pretty darn sure 01:32:06.020 |
it was not gonna be a waste of time to, you know? 01:32:12.780 |
you had a baby in April, you ran an Ironman in October. 01:32:22.340 |
the call for him and he goes like, nope, I'm running. 01:32:27.780 |
- And for those who don't know, actually, I did not know, 01:32:29.620 |
I don't even know the distance of an Ironman. 01:32:37.420 |
- You're like, give me my minutes, give me my minutes. 01:32:41.020 |
- No, no, it completely depends on the course 01:33:06.140 |
- And you were not like a super endurance athlete before, 01:33:16.180 |
and at that time, the future of the company was, 01:33:19.260 |
we were figuring out what are we going to do here? 01:33:24.300 |
kind of getting kicked into the rebirth of it 01:33:35.700 |
There's a lot of, to be a great parent is a ton of work. 01:33:40.860 |
where there's a lot of uncertainty or whatever. 01:33:43.260 |
The way I've always found like when I have to go 01:33:50.780 |
yeah, just to make it all aspects of my life. 01:33:53.180 |
And so I was, I just won, yeah, I woke up one day, 01:33:55.420 |
I was like, all right, I'm going to do an Ironman this year. 01:34:00.420 |
it costs a thousand bucks to do these, didn't know that. 01:34:03.740 |
And just started, I never ran a marathon at that point. 01:34:06.780 |
And so I think it was like 45 or 60 days after that, 01:34:10.700 |
My brother-in-law, he's, that was even more insane. 01:34:14.580 |
hey, do you want to run a marathon in two weeks? 01:34:19.500 |
He did not an endurance athlete either, right? 01:34:27.020 |
you just go, you're kind of online, he's up in Marin. 01:34:29.420 |
Great guy, was on the US Olympic team for triathlons. 01:34:34.020 |
I'm doing Ironman California in three months, 01:34:42.620 |
you'd ask for my opinion, but like, I just want you to know, 01:34:46.460 |
I think, you know, like you shouldn't do this, et cetera. 01:34:51.780 |
And so he was like, okay, like that's pretty bad. 01:34:53.540 |
- But what makes you ignore expert advice here? 01:35:03.820 |
and being a founder, right, it's all about like, 01:35:07.540 |
when we talk to people that worked on browser engines, 01:35:09.380 |
they're like, you can't build what you're talking about. 01:35:11.780 |
I think the job of a founder is to solicit that advice. 01:35:18.020 |
There are certain areas where I was under indexed on. 01:35:21.540 |
spending nearly enough time on my bike, for example. 01:35:23.540 |
Like after that, I was on my bike six hours a day 01:35:35.860 |
And, but I kind of had to look internally and go, okay, 01:35:37.420 |
like, what is he kind of missing about who I am 01:35:40.260 |
and like what I kind of know I'm capable of at this point. 01:35:44.060 |
I mean, going into the thing, you know, it's, you get, 01:35:45.860 |
and this is the same thing with launching Bolt. 01:35:47.260 |
It's like, or launching anything, launch day, race day, 01:35:50.980 |
you kind of go in, you're like, all right, here we go. 01:35:56.140 |
how based in reality I was about all the decisions 01:36:02.700 |
Most people spend, you know, the folks he trains, 01:36:05.060 |
usually it's, you know, one to two years on this stuff 01:36:09.620 |
You know, it's like going and kind of doing it 01:36:11.820 |
It's very similar to the same sort of skill set 01:36:17.020 |
You have to really kind of look at the base reality 01:36:19.780 |
and go make your own assessment on it, right?