In my last post I walked through five layers of token optimization that took a product classifier from $200+/month down to $25–40: context compression, two-stage prompting, exact-match lookup, similarity caching, and batching. Each layer attacked either the size of the context or the number of LLM calls. The post ended with the bill mostly tamed. But there was a layer I hadn’t built yet, and it’s the one that interests me most in hindsight, because it inverts the whole relationship: instead of making the LLM cheaper, you train a model to not need the LLM at all for most of the work — using the LLM’s own past output as training data. ...
A small piece of plastic in our kitchen soap dispenser snapped. The official Grohe replacement costs €80. I had a 3D printer and a Claude Cowork session — five iterations later, I had a working part.
The Problem One of the services I’ve been building for an ecommerce app is a product categorizer: given a product name, assign it a 3-level category path from a large taxonomy. The app is in Polish, so both the product names and the category tree are in Polish — which matters less than you’d think, since LLMs handle this well, but it does mean the examples in this post would normally look like “Drzwi sosnowe 80cm” instead of “Wooden door 80cm.” I’ve translated everything to English here for readability. Simple on paper, until you’re classifying ~1M products a month and watching your LLM bill climb past $200. ...
What the Hell Are Layer2 Rollups? If you’ve spent any time in the Ethereum or blockchain space, you’ve probably heard the term “Layer 2” thrown around—often in the same breath as “rollups.” But what does it actually mean? Why is everyone so excited about it? And why should anyone building on blockchain care? The Problem: Ethereum’s Scaling Bottleneck Ethereum is the world’s most popular smart contract platform, but it’s not without its flaws. The biggest? Scalability. The base layer (Layer 1) can only handle about 15-30 transactions per second: When demand spikes, fees skyrocket and the network slows to a crawl. Not exactly the “world computer” we all dream about. ...