I thought AI was gonna get cheaper?

Intelligence too cheap to measure is Intelligence too cheap to measure is AI's next frontier. According to Sam AI's next frontier. According to Sam AI's next frontier. According to Sam Altman back in July of 2025, I'm pretty Altman back in July of 2025, I'm pretty Altman back in July of 2025, I'm pretty sure that in all of 2025, my personal sure that in all of 2025, my personal sure that in all of 2025, my personal use of AI would probably amount to like use of AI would probably amount to like use of AI would probably amount to like $800 to $1,000. Versus this year, 2026, $800 to $1,000. Versus this year, 2026, $800 to $1,000. Versus this year, 2026, any given day, I can probably pull any given day, I can probably pull any given day, I can probably pull $1,000 in tokens. It seems like $1,000 in tokens. It seems like $1,000 in tokens. It seems like intelligence is getting way more intelligence is getting way more intelligence is getting way more expensive, especially now with models expensive, especially now with models expensive, especially now with models like Fable and Astra that are literally like Fable and Astra that are literally like Fable and Astra that are literally more expensive per token and are doing more expensive per token and are doing more expensive per token and are doing more in it generating more tokens, more in it generating more tokens, more in it generating more tokens, massively increasing the cost that massively increasing the cost that massively increasing the cost that real-world businesses are seeing. It real-world businesses are seeing. It real-world businesses are seeing. It seems like everyone's AI bill is just seems like everyone's AI bill is just seems like everyone's AI bill is just going up and up and up with no sign of going up and up and up with no sign of going up and up and up with no sign of stopping. So, what happened here? Why stopping. So, what happened here? Why stopping. So, what happened here? Why aren't we achieving this new frontier as aren't we achieving this new frontier as aren't we achieving this new frontier as Sam Altman promised us? Why isn't Sam Altman promised us? Why isn't Sam Altman promised us? Why isn't intelligence getting cheaper? I feel intelligence getting cheaper? I feel intelligence getting cheaper? I feel like I was spending a few pennies per like I was spending a few pennies per like I was spending a few pennies per prompt last year, and now I'm spending prompt last year, and now I'm spending prompt last year, and now I'm spending tens, if not hundreds, of dollars. What tens, if not hundreds, of dollars. What tens, if not hundreds, of dollars. What went so wrong? Why are these companies went so wrong? Why are these companies went so wrong? Why are these companies charging so much more? I thought it was charging so much more? I thought it was charging so much more? I thought it was supposed to get cheaper. supposed to get cheaper. supposed to get cheaper. This video is inspired by Primagen, This video is inspired by Primagen, This video is inspired by Primagen, because he made a tweet referencing a because he made a tweet referencing a because he made a tweet referencing a real promise that Sam Altman had made, real promise that Sam Altman had made, real promise that Sam Altman had made, which is that he said AI would get 10 which is that he said AI would get 10 which is that he said AI would get 10 times cheaper year over year. And Prime times cheaper year over year. And Prime times cheaper year over year. And Prime said he's a bit confused because he said he's a bit confused because he said he's a bit confused because he thought that we would get this 10 times thought that we would get this 10 times thought that we would get this 10 times cheaper AI, but Astra's out and it's way cheaper AI, but Astra's out and it's way cheaper AI, but Astra's out and it's way more expensive. So, what went wrong? I more expensive. So, what went wrong? I more expensive. So, what went wrong? I got a lot of thoughts on this one.

got a lot of thoughts on this one. got a lot of thoughts on this one. The short version of what happened here The short version of what happened here The short version of what happened here is it did actually get cheaper. We're is it did actually get cheaper. We're is it did actually get cheaper. We're just not measuring it right. Long just not measuring it right. Long just not measuring it right. Long version, aka the video, will be the next version, aka the video, will be the next version, aka the video, will be the next thing after the sponsor break. Okay, thing after the sponsor break. Okay, thing after the sponsor break. Okay, look. I know this is an ad, but I just look. I know this is an ad, but I just look. I know this is an ad, but I just want to nerd out for a minute, because want to nerd out for a minute, because want to nerd out for a minute, because I've been building a lot more with I've been building a lot more with I've been building a lot more with Railway recently and I've had so much Railway recently and I've had so much Railway recently and I've had so much fun doing it. Let me get some bias out fun doing it. Let me get some bias out fun doing it. Let me get some bias out of the way first. I've loved Railway for of the way first. I've loved Railway for of the way first. I've loved Railway for years now. I was almost their fourth years now. I was almost their fourth years now. I was almost their fourth hire, but I instead chose to make my own hire, but I instead chose to make my own hire, but I instead chose to make my own startup and then my YouTube channel soon startup and then my YouTube channel soon startup and then my YouTube channel soon after. I know this team well. I love after. I know this team well. I love after. I know this team well. I love them and everything they're building is them and everything they're building is them and everything they're building is awesome. Railway had already built the awesome. Railway had already built the awesome. Railway had already built the easiest cloud for developers to build easiest cloud for developers to build easiest cloud for developers to build and ship real full-stack applications and ship real full-stack applications and ship real full-stack applications on. it. guys can everything from the on. it. guys can everything from the on. it. guys can everything from the database to the CDN and everything else database to the CDN and everything else database to the CDN and everything else in between. You could build your full in between. You could build your full in between. You could build your full app from scratch on Railway. And it was app from scratch on Railway. And it was app from scratch on Railway. And it was really nice when you needed persistent really nice when you needed persistent really nice when you needed persistent servers. Where things got genuinely servers. Where things got genuinely servers. Where things got genuinely magical is when they introduced their magical is when they introduced their magical is when they introduced their skills, CLIs, and MCPs to our agents. skills, CLIs, and MCPs to our agents. skills, CLIs, and MCPs to our agents. And now I can have agents just deploy And now I can have agents just deploy And now I can have agents just deploy and manage full stack apps without ever and manage full stack apps without ever and manage full stack apps without ever having to think about it. Even calling having to think about it. Even calling having to think about it. Even calling these apps almost feels misleading these apps almost feels misleading these apps almost feels misleading though, cuz one of those apps is a cloud though, cuz one of those apps is a cloud though, cuz one of those apps is a cloud I built on top of Railway. Yes, the I built on top of Railway. Yes, the I built on top of Railway. Yes, the cloud I've been working on for a while cloud I've been working on for a while cloud I've been working on for a while now, Lakebed, is entirely built on top now, Lakebed, is entirely built on top now, Lakebed, is entirely built on top of Railway and I'm so happy I did it of Railway and I'm so happy I did it of Railway and I'm so happy I did it this way. I have my full production this way. I have my full production this way. I have my full production environment as well as a staging environment as well as a staging environment as well as a staging environment that my agents provisioned environment that my agents provisioned environment that my agents provisioned for me, as well as an environment for for me, as well as an environment for for me, as well as an environment for one specific PR that again, my agent one specific PR that again, my agent one specific PR that again, my agent provisioned for me to test things out provisioned for me to test things out provisioned for me to test things out end to end. When I have any questions end to end. When I have any questions end to end. When I have any questions about how the infra is working or any about how the infra is working or any about how the infra is working or any ideas for how it could work better, I ideas for how it could work better, I ideas for how it could work better, I tell Claude or Codex about it. It tell Claude or Codex about it. It tell Claude or Codex about it. It connects to the MCP, it spins up a new connects to the MCP, it spins up a new connects to the MCP, it spins up a new environment, it figures it out, it environment, it figures it out, it environment, it figures it out, it verifies the changes, it ships to prod verifies the changes, it ships to prod verifies the changes, it ships to prod by merging on main. It will then check by merging on main. It will then check by merging on main. It will then check it on the environment through the MCP it on the environment through the MCP it on the environment through the MCP server and just know what's going on.

server and just know what's going on. server and just know what's going on. Ready for the spiciest part of this ad? Ready for the spiciest part of this ad? Ready for the spiciest part of this ad? I haven't looked at this dashboard in I haven't looked at this dashboard in I haven't looked at this dashboard in weeks cuz I don't have to, because my weeks cuz I don't have to, because my weeks cuz I don't have to, because my agents can manage all of it for me. agents can manage all of it for me. agents can manage all of it for me. Whether I'm building a one-off Whether I'm building a one-off Whether I'm building a one-off experiment to host my own analytics like experiment to host my own analytics like experiment to host my own analytics like I did with Slot Paws, or I'm trying to I did with Slot Paws, or I'm trying to I did with Slot Paws, or I'm trying to put together an HTML host like I did put together an HTML host like I did put together an HTML host like I did with Post Plan, or I'm building my own with Post Plan, or I'm building my own with Post Plan, or I'm building my own cloud with Lakebed, my default has been cloud with Lakebed, my default has been cloud with Lakebed, my default has been Railway for months now and I'm so Railway for months now and I'm so Railway for months now and I'm so thankful that changed. If you're worried thankful that changed. If you're worried thankful that changed. If you're worried about costs, don't be. I'm hosting a ton about costs, don't be. I'm hosting a ton about costs, don't be. I'm hosting a ton of stuff on Railway including our entire of stuff on Railway including our entire of stuff on Railway including our entire internal video pipeline where this ad's internal video pipeline where this ad's internal video pipeline where this ad's actually going to be uploaded, and my actually going to be uploaded, and my actually going to be uploaded, and my estimated costs for the month are under estimated costs for the month are under estimated costs for the month are under $50 for this insane amount of usage I'm $50 for this insane amount of usage I'm $50 for this insane amount of usage I'm getting. Ship on a platform that you and getting. Ship on a platform that you and getting. Ship on a platform that you and your agents will love at your agents will love at your agents will love at sodalite.link/railway. sodalite.link/railway. sodalite.link/railway. Sorry for the break, good to have you Sorry for the break, good to have you Sorry for the break, good to have you back. In order to explain why AI is back. In order to explain why AI is back. In order to explain why AI is actually getting cheaper, we're going to actually getting cheaper, we're going to actually getting cheaper, we're going to have to look at some numbers and talk have to look at some numbers and talk have to look at some numbers and talk more about how models work. The first more about how models work. The first more about how models work. The first thing we need to talk about is token thing we need to talk about is token thing we need to talk about is token cost. Flash bang warning for artificial cost. Flash bang warning for artificial cost. Flash bang warning for artificial analysis. analysis. analysis. When you look at model prices over time, When you look at model prices over time, When you look at model prices over time, the numbers are pretty scary. GPT-5 the numbers are pretty scary. GPT-5 the numbers are pretty scary. GPT-5 medium was $10 per million tokens out medium was $10 per million tokens out medium was $10 per million tokens out and a and a and a per million tokens in. Versus a model per million tokens in. Versus a model per million tokens in. Versus a model like GBT-6 Astra, which is $50 per mil like GBT-6 Astra, which is $50 per mil like GBT-6 Astra, which is $50 per mil out and 10 per mil in. That is a five to out and 10 per mil in. That is a five to out and 10 per mil in. That is a five to 10x increase on input and output tokens 10x increase on input and output tokens 10x increase on input and output tokens cost. That's crazy. That's terrifying.

cost. That's crazy. That's terrifying. cost. That's crazy. That's terrifying. That's the exact opposite of what we That's the exact opposite of what we That's the exact opposite of what we were promised. We were promised 10x were promised. We were promised 10x were promised. We were promised 10x decreases in cost, but there's a 10x decreases in cost, but there's a 10x decreases in cost, but there's a 10x increase. Well, there are layers to this increase. Well, there are layers to this increase. Well, there are layers to this because token cost is one of the worst because token cost is one of the worst because token cost is one of the worst ways to measure cost. The three things ways to measure cost. The three things ways to measure cost. The three things we need to be considered of are first, we need to be considered of are first, we need to be considered of are first, yeah, sure, token cost. I'll talk a yeah, sure, token cost. I'll talk a yeah, sure, token cost. I'll talk a little bit about it. But the other two little bit about it. But the other two little bit about it. But the other two are where most of the important parts are where most of the important parts are where most of the important parts come from. The second one is how many come from. The second one is how many come from. The second one is how many tokens it takes to complete a given tokens it takes to complete a given tokens it takes to complete a given piece of work. And the third is the piece of work. And the third is the piece of work. And the third is the types of work the models can complete. types of work the models can complete. types of work the models can complete. Specifically, how much intelligence per Specifically, how much intelligence per Specifically, how much intelligence per dollar, so to speak. So, we have token dollar, so to speak. So, we have token dollar, so to speak. So, we have token cost, tokens per dollar. We have tokens cost, tokens per dollar. We have tokens cost, tokens per dollar. We have tokens per task cost, how many tokens it take per task cost, how many tokens it take per task cost, how many tokens it take to solve a task. And then we have cost to solve a task. And then we have cost to solve a task. And then we have cost per level of intelligence. How much per level of intelligence. How much per level of intelligence. How much spend does it take? How much money do we spend does it take? How much money do we spend does it take? How much money do we have to spend to get a solution to a have to spend to get a solution to a have to spend to get a solution to a problem at a certain level of problem at a certain level of problem at a certain level of intelligence? So, yes, token costs did intelligence? So, yes, token costs did intelligence? So, yes, token costs did go up for the best of the best models, go up for the best of the best models, go up for the best of the best models, but let's be real here, there are also but let's be real here, there are also but let's be real here, there are also cheap options that are incredible. For cheap options that are incredible. For cheap options that are incredible. For example, a model like JLM 5.3 Flash, example, a model like JLM 5.3 Flash, example, a model like JLM 5.3 Flash, which I absolutely adore, it's one of my which I absolutely adore, it's one of my which I absolutely adore, it's one of my favorite model releases ever. This model favorite model releases ever. This model favorite model releases ever. This model is 15 cents per million input tokens and is 15 cents per million input tokens and is 15 cents per million input tokens and 50 cents per million out. It's also on 50 cents per million out. It's also on 50 cents per million out. It's also on sale in a lot of places for 50% off. So, sale in a lot of places for 50% off. So, sale in a lot of places for 50% off. So, it's actually 7 cents per mil in and 25 it's actually 7 cents per mil in and 25 it's actually 7 cents per mil in and 25 per mil out. That means that it's about per mil out. That means that it's about per mil out. That means that it's about a 30th the cost of GPT-5. For a 20th to a 30th the cost of GPT-5. For a 20th to a 30th the cost of GPT-5. For a 20th to a 30th the price per token, JLM 5.3 a 30th the price per token, JLM 5.3 a 30th the price per token, JLM 5.3 Flash will run circles around GPT-5 for Flash will run circles around GPT-5 for Flash will run circles around GPT-5 for a lot of real-world agentic stuff.

a lot of real-world agentic stuff. a lot of real-world agentic stuff. So, again, if we look at the top-tier So, again, if we look at the top-tier So, again, if we look at the top-tier models, yes, cost per token's gone up. models, yes, cost per token's gone up. models, yes, cost per token's gone up. But if you look at other places, you'll But if you look at other places, you'll But if you look at other places, you'll see that we've also gotten really see that we've also gotten really see that we've also gotten really capable models that are way cheaper than capable models that are way cheaper than capable models that are way cheaper than before as well. So, yes, the top end has before as well. So, yes, the top end has before as well. So, yes, the top end has gotten crazier, but so has the bottom gotten crazier, but so has the bottom gotten crazier, but so has the bottom end. Both sides have seen meaningful end. Both sides have seen meaningful end. Both sides have seen meaningful improvements here. But as I mentioned improvements here. But as I mentioned improvements here. But as I mentioned before, cost per token is only a tiny before, cost per token is only a tiny before, cost per token is only a tiny piece of the formula here. I'll use a piece of the formula here. I'll use a piece of the formula here. I'll use a really fun example. Let's look at Gemini really fun example. Let's look at Gemini really fun example. Let's look at Gemini 3 8 Flash. 3 8 Flash. 3 8 Flash. On this chart, it looks like a pretty On this chart, it looks like a pretty On this chart, it looks like a pretty good deal. It's $3.75 per million out. good deal. It's $3.75 per million out. good deal. It's $3.75 per million out. That makes it less than half the price That makes it less than half the price That makes it less than half the price of GPT-5 and less than a tenth the price of GPT-5 and less than a tenth the price of GPT-5 and less than a tenth the price of Astra and Fable. But then we hop up a of Astra and Fable. But then we hop up a of Astra and Fable. But then we hop up a little bit to cost per intelligence little bit to cost per intelligence little bit to cost per intelligence index task, and suddenly that difference index task, and suddenly that difference index task, and suddenly that difference gets a lot less different because 3 8 gets a lot less different because 3 8 gets a lot less different because 3 8 Flash uses so many tokens for the work Flash uses so many tokens for the work Flash uses so many tokens for the work that it's doing. So even though it is that it's doing. So even though it is that it's doing. So even though it is comically cheaper per token, the token comically cheaper per token, the token comically cheaper per token, the token waste that 3 8 Flash has results in this waste that 3 8 Flash has results in this waste that 3 8 Flash has results in this gap going from over 10x to under 3x. And gap going from over 10x to under 3x. And gap going from over 10x to under 3x. And 3.5 Flash was even worse here cuz it was 3.5 Flash was even worse here cuz it was 3.5 Flash was even worse here cuz it was so token hungry, getting to over half so token hungry, getting to over half so token hungry, getting to over half the cost of 5 6 Soul, even though 5 6 the cost of 5 6 Soul, even though 5 6 the cost of 5 6 Soul, even though 5 6 Soul is a way more expensive model. So Soul is a way more expensive model. So Soul is a way more expensive model. So once again, you need to factor all of once again, you need to factor all of once again, you need to factor all of these things in. Hilariously enough, these things in. Hilariously enough, these things in. Hilariously enough, Sonnet 5 was more expensive than Astra Sonnet 5 was more expensive than Astra Sonnet 5 was more expensive than Astra because Sonnet just burns tokens.

because Sonnet just burns tokens. because Sonnet just burns tokens. So those are the first two dimensions to So those are the first two dimensions to So those are the first two dimensions to consider. consider. consider. Cost per token and the amount of tokens Cost per token and the amount of tokens Cost per token and the amount of tokens used to solve a given task. And to be used to solve a given task. And to be used to solve a given task. And to be clear, different tasks have different clear, different tasks have different clear, different tasks have different ways that they work here. For example, ways that they work here. For example, ways that they work here. For example, if the task is to ingest 800,000 tokens if the task is to ingest 800,000 tokens if the task is to ingest 800,000 tokens and categorize them in some way, and categorize them in some way, and categorize them in some way, the categorization and the output tokens the categorization and the output tokens the categorization and the output tokens aren't going to matter as much. The aren't going to matter as much. The aren't going to matter as much. The input tokens will, so you're always input tokens will, so you're always input tokens will, so you're always paying that cost basically no matter paying that cost basically no matter paying that cost basically no matter what. At that point, optimizing for the what. At that point, optimizing for the what. At that point, optimizing for the cheapest model for the input token read cheapest model for the input token read cheapest model for the input token read is probably the right call. If you're is probably the right call. If you're is probably the right call. If you're doing agentic dev work, things like doing agentic dev work, things like doing agentic dev work, things like caching, reliability, and token caching, reliability, and token caching, reliability, and token efficiency suddenly matter a hell of a efficiency suddenly matter a hell of a efficiency suddenly matter a hell of a lot more. We're also not looking at this lot more. We're also not looking at this lot more. We're also not looking at this the right way. We're just looking at the right way. We're just looking at the right way. We're just looking at cost right here. What we want to see is cost right here. What we want to see is cost right here. What we want to see is cost versus intelligence. This chart is cost versus intelligence. This chart is cost versus intelligence. This chart is much more interesting, where you can see much more interesting, where you can see much more interesting, where you can see how expensive a run was and how well it how expensive a run was and how well it how expensive a run was and how well it performed in the benchmarks. They have performed in the benchmarks. They have performed in the benchmarks. They have this nice line now for the Pareto this nice line now for the Pareto this nice line now for the Pareto frontier, which is what is the best frontier, which is what is the best frontier, which is what is the best model at a given cost level. And you'll model at a given cost level. And you'll model at a given cost level. And you'll see GBD-6 Astra has a significant number see GBD-6 Astra has a significant number see GBD-6 Astra has a significant number of the spots here. And Fable ends up of the spots here. And Fable ends up of the spots here. And Fable ends up being way more expensive all the way being way more expensive all the way being way more expensive all the way over there, but you'll see at a given over there, but you'll see at a given over there, but you'll see at a given level of intelligence, cost can go down level of intelligence, cost can go down level of intelligence, cost can go down massively. Like if you're happy with a massively. Like if you're happy with a massively. Like if you're happy with a 45 to a 46 as the score here, your cost 45 to a 46 as the score here, your cost 45 to a 46 as the score here, your cost will be 82 cents per task. Where if you will be 82 cents per task. Where if you will be 82 cents per task. Where if you want to bump up into the 50s, suddenly want to bump up into the 50s, suddenly want to bump up into the 50s, suddenly it's $3.26.

it's $3.26. it's $3.26. So for just a few more points, you're So for just a few more points, you're So for just a few more points, you're spending three times more money. I still spending three times more money. I still spending three times more money. I still don't think this is the best way to don't think this is the best way to don't think this is the best way to think about it though. I want to flip think about it though. I want to flip think about it though. I want to flip it. Instead of thinking about this as it. Instead of thinking about this as it. Instead of thinking about this as how much intelligence can you get per how much intelligence can you get per how much intelligence can you get per dollar, let's take a level of dollar, let's take a level of dollar, let's take a level of intelligence and see how much it costs intelligence and see how much it costs intelligence and see how much it costs over time. If we took at the capability over time. If we took at the capability over time. If we took at the capability of GPT-5 for example, how expensive of GPT-5 for example, how expensive of GPT-5 for example, how expensive would it be to get that same level of would it be to get that same level of would it be to get that same level of intelligence today with other cheaper intelligence today with other cheaper intelligence today with other cheaper options? I actually did a good bit of options? I actually did a good bit of options? I actually did a good bit of research here to find what models have research here to find what models have research here to find what models have similar scores to GPT-5. And it was similar scores to GPT-5. And it was similar scores to GPT-5. And it was harder than expected because we've had harder than expected because we've had harder than expected because we've had to overhaul almost all the benchmarks to overhaul almost all the benchmarks to overhaul almost all the benchmarks that we use over the last year because that we use over the last year because that we use over the last year because we saturated everything. I eventually we saturated everything. I eventually we saturated everything. I eventually stumbled on V4 Flash being roughly stumbled on V4 Flash being roughly stumbled on V4 Flash being roughly equivalent to 5 Codex High because the equivalent to 5 Codex High because the equivalent to 5 Codex High because the handful of benches they had overlapping handful of benches they had overlapping handful of benches they had overlapping were actually similar in score. Funny were actually similar in score. Funny were actually similar in score. Funny enough, the Deep Seek V4 Flash model is enough, the Deep Seek V4 Flash model is enough, the Deep Seek V4 Flash model is actually outperforming it in a bunch of actually outperforming it in a bunch of actually outperforming it in a bunch of places like Humanities Last Exam, AI places like Humanities Last Exam, AI places like Humanities Last Exam, AI Amnitions, which is a benchmark Amnitions, which is a benchmark Amnitions, which is a benchmark measuring hallucination rates, but it measuring hallucination rates, but it measuring hallucination rates, but it got roughly the same overall got roughly the same overall got roughly the same overall intelligence index score. Deep Seek V4 intelligence index score. Deep Seek V4 intelligence index score. Deep Seek V4 Flash is 21 times cheaper than GPT-5 for Flash is 21 times cheaper than GPT-5 for Flash is 21 times cheaper than GPT-5 for input tokens and 55 times cheaper for input tokens and 55 times cheaper for input tokens and 55 times cheaper for output tokens. I couldn't find good output tokens. I couldn't find good output tokens. I couldn't find good numbers to measure the efficiency numbers to measure the efficiency numbers to measure the efficiency changes here, but even if you assumed changes here, but even if you assumed changes here, but even if you assumed that Deep Seek was 3x less efficient, that Deep Seek was 3x less efficient, that Deep Seek was 3x less efficient, the difference still nets out to around the difference still nets out to around the difference still nets out to around a 20x improvement. So if the goal was to a 20x improvement. So if the goal was to a 20x improvement. So if the goal was to get 10 times cheaper intelligence at a get 10 times cheaper intelligence at a get 10 times cheaper intelligence at a given level, we blew that out the given level, we blew that out the given level, we blew that out the [ __ ] park. We're at 20 times cheaper.

[ __ ] park. We're at 20 times cheaper. [ __ ] park. We're at 20 times cheaper. Thankfully, this is actually being Thankfully, this is actually being Thankfully, this is actually being tracked by our friends at Artificial tracked by our friends at Artificial tracked by our friends at Artificial Analysis. They would pick a given level, Analysis. They would pick a given level, Analysis. They would pick a given level, which was intelligence less than 10 which was intelligence less than 10 which was intelligence less than 10 points before. That used to cost 60 points before. That used to cost 60 points before. That used to cost 60 cents per task, and that got all the way cents per task, and that got all the way cents per task, and that got all the way down to 2 cents per task over the course down to 2 cents per task over the course down to 2 cents per task over the course of about 2 years. From November of 2022 of about 2 years. From November of 2022 of about 2 years. From November of 2022 to July of 2024, we saw that cost go to July of 2024, we saw that cost go to July of 2024, we saw that cost go down massively. But then we start down massively. But then we start down massively. But then we start ranking things between 10 and 20 points. ranking things between 10 and 20 points. ranking things between 10 and 20 points. Initially, they were expensive all the Initially, they were expensive all the Initially, they were expensive all the way up to like $15 per task with O1 way up to like $15 per task with O1 way up to like $15 per task with O1 preview, cuz that model was super preview, cuz that model was super preview, cuz that model was super expensive. But you can see over time, it expensive. But you can see over time, it expensive. But you can see over time, it didn't take very long to drop. It was didn't take very long to drop. It was didn't take very long to drop. It was September of 2024 that it cost $15 for September of 2024 that it cost $15 for September of 2024 that it cost $15 for this level, and by February of 2025, this level, and by February of 2025, this level, and by February of 2025, just a few months later, Grok-3 mini was just a few months later, Grok-3 mini was just a few months later, Grok-3 mini was getting similar numbers at a way, way getting similar numbers at a way, way getting similar numbers at a way, way cheaper price. Pennies to what were cheaper price. Pennies to what were cheaper price. Pennies to what were dollars before. 16 cents to get a score dollars before. 16 cents to get a score dollars before. 16 cents to get a score that was actually higher than O1 that was actually higher than O1 that was actually higher than O1 preview, cuz O1 preview only got an 11. preview, cuz O1 preview only got an 11. preview, cuz O1 preview only got an 11. And that was September of 2024, and by And that was September of 2024, and by And that was September of 2024, and by February of 2025, Grok-3 mini had four February of 2025, Grok-3 mini had four February of 2025, Grok-3 mini had four points on top of it at under a hundredth points on top of it at under a hundredth points on top of it at under a hundredth the price. Sorry, roughly a hundredth the price. Sorry, roughly a hundredth the price. Sorry, roughly a hundredth the price. Pretty crazy that the price the price. Pretty crazy that the price the price. Pretty crazy that the price has dropped by almost 99% in just 4 has dropped by almost 99% in just 4 has dropped by almost 99% in just 4 months. And Chad just made a good months. And Chad just made a good months. And Chad just made a good observation. Chad said, "The drops are observation. Chad said, "The drops are observation. Chad said, "The drops are faster each time." That is where things faster each time." That is where things faster each time." That is where things get really, really cool. The speed of get really, really cool. The speed of get really, really cool. The speed of this drop was a little crazy because the this drop was a little crazy because the this drop was a little crazy because the O1 preview and O1 models were more O1 preview and O1 models were more O1 preview and O1 models were more expensive than they should have been, expensive than they should have been, expensive than they should have been, but the drop happened nearly immediately but the drop happened nearly immediately but the drop happened nearly immediately after. And then we get to the 20s, where

after. And then we get to the 20s, where after. And then we get to the 20s, where O3 was the first model to break 20, and O3 was the first model to break 20, and O3 was the first model to break 20, and from April to August that year, GPT-5 from April to August that year, GPT-5 from April to August that year, GPT-5 mini got a meaningfully higher score. mini got a meaningfully higher score. mini got a meaningfully higher score. Actually, no, it's like the same score. Actually, no, it's like the same score. Actually, no, it's like the same score. It's a 20 to 21. It's a 20 to 21. It's a 20 to 21. But instead of costing $1.55, it only But instead of costing $1.55, it only But instead of costing $1.55, it only cost 26 cents. Then DeepSeek 3.2 got the cost 26 cents. Then DeepSeek 3.2 got the cost 26 cents. Then DeepSeek 3.2 got the same score for 10 cents. And now there's same score for 10 cents. And now there's same score for 10 cents. And now there's models like Ling-3 flash that get the models like Ling-3 flash that get the models like Ling-3 flash that get the same score for 4.7 cents. But now models same score for 4.7 cents. But now models same score for 4.7 cents. But now models are even smarter. The ones in the 30s are even smarter. The ones in the 30s are even smarter. The ones in the 30s started at a dollar and 90 cents with started at a dollar and 90 cents with started at a dollar and 90 cents with 5.2. 5.2. 5.2. And not long after got to literally 3 And not long after got to literally 3 And not long after got to literally 3 cents. cents. cents. And now that we're in the 40s to the And now that we're in the 40s to the And now that we're in the 40s to the 50s, Opus 4.7 started us strong here at 50s, Opus 4.7 started us strong here at 50s, Opus 4.7 started us strong here at $3.85 per task, which also this is a fun $3.85 per task, which also this is a fun $3.85 per task, which also this is a fun trend. trend. trend. Initially, the new model at the new Initially, the new model at the new Initially, the new model at the new level isn't that much more expensive. level isn't that much more expensive. level isn't that much more expensive. But then with 01, this new level cost us But then with 01, this new level cost us But then with 01, this new level cost us way more. Then the next new level cost way more. Then the next new level cost way more. Then the next new level cost us less more. Then the next one after us less more. Then the next one after us less more. Then the next one after was roughly the same. The next one after was roughly the same. The next one after was roughly the same. The next one after was slightly more expensive but barely. was slightly more expensive but barely. was slightly more expensive but barely. So like when a new level of intelligence So like when a new level of intelligence So like when a new level of intelligence happens, the cost isn't going up a whole happens, the cost isn't going up a whole happens, the cost isn't going up a whole bunch then even. And yes, all the axes bunch then even. And yes, all the axes bunch then even. And yes, all the axes are exponential here. The cost measure are exponential here. The cost measure are exponential here. The cost measure here is log, so the top is $16 here is log, so the top is $16 here is log, so the top is $16 and halfway through is a dollar. So and halfway through is a dollar. So and halfway through is a dollar. So remember that as we look.

remember that as we look. remember that as we look. But now we get to where we are now, But now we get to where we are now, But now we get to where we are now, where you can see some of the most where you can see some of the most where you can see some of the most intense battlegrounds we've ever seen in intense battlegrounds we've ever seen in intense battlegrounds we've ever seen in LLM history, where when we got Opus 4.7, LLM history, where when we got Opus 4.7, LLM history, where when we got Opus 4.7, which was meaningful bump hitting a 41 which was meaningful bump hitting a 41 which was meaningful bump hitting a 41 on the intelligence index, we got 5.6 on the intelligence index, we got 5.6 on the intelligence index, we got 5.6 Tera not long after with a higher score Tera not long after with a higher score Tera not long after with a higher score at like almost half the price. Then GLM at like almost half the price. Then GLM at like almost half the price. Then GLM 5.3 getting an even higher score at 5.3 getting an even higher score at 5.3 getting an even higher score at under a third the price. And then GLM under a third the price. And then GLM under a third the price. And then GLM 5.3 Flash getting it nearly the same 5.3 Flash getting it nearly the same 5.3 Flash getting it nearly the same score at a hundredth the price. So while score at a hundredth the price. So while score at a hundredth the price. So while it might feel bad now because we just it might feel bad now because we just it might feel bad now because we just did another one of these bumps, at a did another one of these bumps, at a did another one of these bumps, at a given level of intelligence prices do given level of intelligence prices do given level of intelligence prices do drop massively, way more than 10x year drop massively, way more than 10x year drop massively, way more than 10x year over year. And when I said there was over year. And when I said there was over year. And when I said there was three things, I kind of lied cuz there's three things, I kind of lied cuz there's three things, I kind of lied cuz there's one last piece that's important to know. one last piece that's important to know. one last piece that's important to know. As intelligence has gotten more As intelligence has gotten more As intelligence has gotten more intelligent, the ways we use it have intelligent, the ways we use it have intelligent, the ways we use it have changed. We used to have the model auto changed. We used to have the model auto changed. We used to have the model auto complete a single function for us in our complete a single function for us in our complete a single function for us in our code base. Now we have it take a code base. Now we have it take a code base. Now we have it take a screenshot of a bug and get the change screenshot of a bug and get the change screenshot of a bug and get the change landed for us. The models can do so much landed for us. The models can do so much landed for us. The models can do so much more. They're going end to end. We don't more. They're going end to end. We don't more. They're going end to end. We don't have to interfere as much because they have to interfere as much because they have to interfere as much because they stay on task better, too. So yes, our stay on task better, too. So yes, our stay on task better, too. So yes, our bills are getting higher. I'm not trying bills are getting higher. I'm not trying bills are getting higher. I'm not trying to gaslight you into thinking otherwise, to gaslight you into thinking otherwise, to gaslight you into thinking otherwise, but it's not because the token cost went but it's not because the token cost went but it's not because the token cost went up, it's because the usage went up. We up, it's because the usage went up. We up, it's because the usage went up. We are using these models so much more.

are using these models so much more. are using these models so much more. They are running longer. They are doing They are running longer. They are doing They are running longer. They are doing a bigger tasks. They are completing work a bigger tasks. They are completing work a bigger tasks. They are completing work that we used to have to intervene with that we used to have to intervene with that we used to have to intervene with all the time. The fact that we are all the time. The fact that we are all the time. The fact that we are generating way more tokens per prompt is generating way more tokens per prompt is generating way more tokens per prompt is success. It's because the models got success. It's because the models got success. It's because the models got cheaper and better and more capable. cheaper and better and more capable. cheaper and better and more capable. This is kind of a Jevons paradox thing. This is kind of a Jevons paradox thing. This is kind of a Jevons paradox thing. When steam power got cheaper and coal When steam power got cheaper and coal When steam power got cheaper and coal got more accessible, we started spending got more accessible, we started spending got more accessible, we started spending much more money on all of those things much more money on all of those things much more money on all of those things because it suddenly was cheap enough and because it suddenly was cheap enough and because it suddenly was cheap enough and good enough to be usable in places it good enough to be usable in places it good enough to be usable in places it wasn't before. Our bills aren't going up wasn't before. Our bills aren't going up wasn't before. Our bills aren't going up because the models are more expensive, because the models are more expensive, because the models are more expensive, they're going up because we're using the they're going up because we're using the they're going up because we're using the expensive models more. expensive models more. expensive models more. It really is that simple. And this is It really is that simple. And this is It really is that simple. And this is where things get really fun. Like A4 in where things get really fun. Like A4 in where things get really fun. Like A4 in chat saying, "Imagine getting Fable 5.1 chat saying, "Imagine getting Fable 5.1 chat saying, "Imagine getting Fable 5.1 levels of intelligence for GLM 5 3 Flash levels of intelligence for GLM 5 3 Flash levels of intelligence for GLM 5 3 Flash pricing." It's going to happen. It's pricing." It's going to happen. It's pricing." It's going to happen. It's absolutely going to happen because I absolutely going to happen because I absolutely going to happen because I kind of danced around something earlier. kind of danced around something earlier. kind of danced around something earlier. I was comparing 5 3 Flash and 5 3 Flash I was comparing 5 3 Flash and 5 3 Flash I was comparing 5 3 Flash and 5 3 Flash pricing to GPT 5 pricing. And comparing pricing to GPT 5 pricing. And comparing pricing to GPT 5 pricing. And comparing the 25 to 50 cents per mil out on 5 3 the 25 to 50 cents per mil out on 5 3 the 25 to 50 cents per mil out on 5 3 Flash against the $10 per mil out on GPT Flash against the $10 per mil out on GPT Flash against the $10 per mil out on GPT 5 is unfair. It's unfair because it does 5 is unfair. It's unfair because it does 5 is unfair. It's unfair because it does not do enough credit to GLM 5 3 Flash. 5 not do enough credit to GLM 5 3 Flash. 5 not do enough credit to GLM 5 3 Flash. 5 3 Flash is a way, way better model than 3 Flash is a way, way better model than 3 Flash is a way, way better model than GPT 5. I would rather use GLM 5 3 Flash GPT 5. I would rather use GLM 5 3 Flash GPT 5. I would rather use GLM 5 3 Flash for everything than be stuck using GPT 5 for everything than be stuck using GPT 5 for everything than be stuck using GPT 5 for anything because 5 3 Flash has a lot for anything because 5 3 Flash has a lot for anything because 5 3 Flash has a lot of the industry-wide advancements that of the industry-wide advancements that of the industry-wide advancements that have happened in the last year. The way have happened in the last year. The way have happened in the last year. The way it does vision is better. The way it it does vision is better. The way it it does vision is better. The way it handles tool calls is better. Most handles tool calls is better. Most handles tool calls is better. Most importantly, the way it manages importantly, the way it manages importantly, the way it manages long-running work in agentic workflows

long-running work in agentic workflows long-running work in agentic workflows where the model goes and does things for where the model goes and does things for where the model goes and does things for hours instead of seconds is comically hours instead of seconds is comically hours instead of seconds is comically better. GLM 5 3 Flash is not just better. GLM 5 3 Flash is not just better. GLM 5 3 Flash is not just cheaper for a given level of capability cheaper for a given level of capability cheaper for a given level of capability than GPT 5, it's also just so much than GPT 5, it's also just so much than GPT 5, it's also just so much better in every realistic way. The only better in every realistic way. The only better in every realistic way. The only thing 53 flash doesn't have that GPT-5 thing 53 flash doesn't have that GPT-5 thing 53 flash doesn't have that GPT-5 does is a bit more knowledge that does is a bit more knowledge that does is a bit more knowledge that doesn't require searching. And chances doesn't require searching. And chances doesn't require searching. And chances are if you gave both a search tool and are if you gave both a search tool and are if you gave both a search tool and bench them on any knowledge anything, 53 bench them on any knowledge anything, 53 bench them on any knowledge anything, 53 flash will smoke GPT-5 like order of flash will smoke GPT-5 like order of flash will smoke GPT-5 like order of magnitude difference simply because it magnitude difference simply because it magnitude difference simply because it can do the searching well. It can use can do the searching well. It can use can do the searching well. It can use its tools well. It can get solutions its tools well. It can get solutions its tools well. It can get solutions better even if the model is dumber in better even if the model is dumber in better even if the model is dumber in terms of what we've stuffed into its terms of what we've stuffed into its terms of what we've stuffed into its brain. Small models with good tools brain. Small models with good tools brain. Small models with good tools massively outperform last year's massively outperform last year's massively outperform last year's smartest models even with tools because smartest models even with tools because smartest models even with tools because we've gotten so much better at that. we've gotten so much better at that. we've gotten so much better at that. And we're going to see more and more of And we're going to see more and more of And we're going to see more and more of these types of improvements. And this is these types of improvements. And this is these types of improvements. And this is coming from the guy who not that long coming from the guy who not that long coming from the guy who not that long ago said that we had peaked. ago said that we had peaked. ago said that we had peaked. Two years ago I did a video back when I Two years ago I did a video back when I Two years ago I did a video back when I was mostly blonde and mustached titled was mostly blonde and mustached titled was mostly blonde and mustached titled AI isn't going to keep improving because AI isn't going to keep improving because AI isn't going to keep improving because I thought we had kind of flatlined. And I thought we had kind of flatlined. And I thought we had kind of flatlined. And you can see here in the bench I had you can see here in the bench I had you can see here in the bench I had GPT-3.5 then GPT-4, 14, and 4.0 did not GPT-3.5 then GPT-4, 14, and 4.0 did not GPT-3.5 then GPT-4, 14, and 4.0 did not meaningfully improve on the benchmarks meaningfully improve on the benchmarks meaningfully improve on the benchmarks that we were looking at. That's because that we were looking at. That's because that we were looking at. That's because we needed new benchmarks.

we needed new benchmarks. we needed new benchmarks. I was so wrong. I've never in my life I was so wrong. I've never in my life I was so wrong. I've never in my life had a take that was that bad. And I had a take that was that bad. And I had a take that was that bad. And I I've learned my lesson. I was so wrong I've learned my lesson. I was so wrong I've learned my lesson. I was so wrong it's hilarious. You're going to make fun it's hilarious. You're going to make fun it's hilarious. You're going to make fun of me for being a guy who doesn't know of me for being a guy who doesn't know of me for being a guy who doesn't know what they're doing, make fun of that what they're doing, make fun of that what they're doing, make fun of that version of me not whatever you're mad version of me not whatever you're mad version of me not whatever you're mad about when I talk about compaction or about when I talk about compaction or about when I talk about compaction or something. I be people are mad at me for something. I be people are mad at me for something. I be people are mad at me for things that I'm right on and they are things that I'm right on and they are things that I'm right on and they are not mad at me for the things I was not mad at me for the things I was not mad at me for the things I was really really wrong on for some reason. really really wrong on for some reason. really really wrong on for some reason. But yeah, the point I'm trying to make But yeah, the point I'm trying to make But yeah, the point I'm trying to make is that we are still trying to find ways is that we are still trying to find ways is that we are still trying to find ways to measure these levels of intelligence. to measure these levels of intelligence. to measure these levels of intelligence. Things are so much better than I ever Things are so much better than I ever Things are so much better than I ever would have guessed they would have would have guessed they would have would have guessed they would have gotten way faster than I ever would have gotten way faster than I ever would have gotten way faster than I ever would have expected it to happen and way cheaper expected it to happen and way cheaper expected it to happen and way cheaper than I ever could have imagined it would than I ever could have imagined it would than I ever could have imagined it would be. The issue is that these things have be. The issue is that these things have be. The issue is that these things have gotten so cheap and so capable that we gotten so cheap and so capable that we gotten so cheap and so capable that we are just pissing money all over them. We are just pissing money all over them. We are just pissing money all over them. We are spending so much because they are so are spending so much because they are so are spending so much because they are so useful. And that doesn't mean that we useful. And that doesn't mean that we useful. And that doesn't mean that we failed. In fact, I would go as far as to failed. In fact, I would go as far as to failed. In fact, I would go as far as to say intelligence too cheap to measure, say intelligence too cheap to measure, say intelligence too cheap to measure, that isn't happening in the way that Sam that isn't happening in the way that Sam that isn't happening in the way that Sam may have implied here, but his previous may have implied here, but his previous may have implied here, but his previous promise of intelligence 10 times cheaper promise of intelligence 10 times cheaper promise of intelligence 10 times cheaper has been blown out of the water. We has been blown out of the water. We has been blown out of the water. We absolutely achieved that. The tasks that absolutely achieved that. The tasks that absolutely achieved that. The tasks that we used AI for last year are actually we used AI for last year are actually we used AI for last year are actually that much cheaper. The difference is we that much cheaper. The difference is we that much cheaper. The difference is we can do bigger and tougher things with can do bigger and tougher things with can do bigger and tougher things with it, which is, in my opinion, way more it, which is, in my opinion, way more it, which is, in my opinion, way more exciting. All that said, exciting. All that said, exciting. All that said, it's kind of crazy that you can rack up it's kind of crazy that you can rack up it's kind of crazy that you can rack up $1,500 of spend in a day using these $1,500 of spend in a day using these $1,500 of spend in a day using these models. I don't want to discount that models. I don't want to discount that models. I don't want to discount that with the things I'm saying.

with the things I'm saying. with the things I'm saying. All I'm saying is that you would never All I'm saying is that you would never All I'm saying is that you would never have been able to do that with GPT-5, have been able to do that with GPT-5, have been able to do that with GPT-5, not because it was so much cheaper, but not because it was so much cheaper, but not because it was so much cheaper, but because you just wouldn't be able to get because you just wouldn't be able to get because you just wouldn't be able to get that much work done. LLM spend is tied that much work done. LLM spend is tied that much work done. LLM spend is tied to the productivity we get from LLMs, to the productivity we get from LLMs, to the productivity we get from LLMs, and yes, we are getting more from that. and yes, we are getting more from that. and yes, we are getting more from that. Think I've said all I have to on this Think I've said all I have to on this Think I've said all I have to on this one. I hope you can better understand one. I hope you can better understand one. I hope you can better understand where our money's going now. And don't where our money's going now. And don't where our money's going now. And don't worry, things will continue to get worry, things will continue to get worry, things will continue to get cheaper, even if it doesn't look like it cheaper, even if it doesn't look like it cheaper, even if it doesn't look like it right now. Keep your head up and be right now. Keep your head up and be right now. Keep your head up and be excited for all the developments that'll excited for all the developments that'll excited for all the developments that'll continue to make models cheaper and more continue to make models cheaper and more continue to make models cheaper and more capable. I know I've been hyped about capable. I know I've been hyped about capable. I know I've been hyped about this, and I hope you are, too. Until this, and I hope you are, too. Until this, and I hope you are, too. Until next time, next time, next time, peace, nerds.