Free AI Inference Providers
A daily dashboard for monitoring free AI inference providers, with curated vendor boards and a machine-refreshable OpenRouter free-model roster.
Inference
When Tokens Explode: The Hidden Geometry Behind Attention Sinks
Serving an LLM is usually discussed in pleasantly managerial language: latency, throughput, context windows, GPU memory, quantization, cache eviction. Nice clean nouns. Then the model ruins the spreadsheet by producing internal activations that are thousands of times larger than ordinary values, while some tokens quietly become attention magnets for reasons that are not exactly semantic. Very professional behavior from a trillion-dollar technology stack. ...
From Tokens to Teaspoons: What a Prompt Really Costs
TL;DR for operators A Google paper on Gemini Apps reports that the median text prompt in May 2025 consumed 0.24 Wh, generated 0.03 gCO2e, and consumed 0.26 mL of water under a comprehensive production-serving measurement boundary.1 That is small. Very small. Less “boil the kettle” and more “squint at a television for nine seconds.” ...