Topic
cost
Where infrastructure and API spend goes, measured from the bills and logs rather than estimated.
2 engineering notes.
- Kaggle is not a free AI server: what its quotas and terms allowRunning an LLM API on Kaggle's free GPUs is a popular hack. Kaggle's session limits make it unreliable, and its terms rule out server farming and third-party use.
- Prompt cache misses are a silent cost leak in coding agentsA background agent that fires after the cache expires pays full price to rebuild it. How to read the cache numbers and stop the leak.
