From $200 to $30: Five Layers of LLM Cost Optimization
The Problem One of the services I’ve been building for an ecommerce app is a product categorizer: given a product name, assign it a 3-level category path from a large taxonomy. The app is in Polish, so both the product names and the category tree are in Polish — which matters less than you’d think, since LLMs handle this well, but it does mean the examples in this post would normally look like “Drzwi sosnowe 80cm” instead of “Wooden door 80cm.” I’ve translated everything to English here for readability. Simple on paper, until you’re classifying ~1M products a month and watching your LLM bill climb past $200. ...
What the Hell Are Layer2 Rollups
What the Hell Are Layer2 Rollups? If you’ve spent any time in the Ethereum or blockchain space, you’ve probably heard the term “Layer 2” thrown around—often in the same breath as “rollups.” But what does it actually mean? Why is everyone so excited about it? And why should anyone building on blockchain care? The Problem: Ethereum’s Scaling Bottleneck Ethereum is the world’s most popular smart contract platform, but it’s not without its flaws. The biggest? Scalability. The base layer (Layer 1) can only handle about 15-30 transactions per second: When demand spikes, fees skyrocket and the network slows to a crawl. Not exactly the “world computer” we all dream about. ...