datawhalechina/zero-to-sglang
Hands-on course that builds a miniature SGLang inference engine from scratch, then walks through the real SGLang codebase's serving optimizations.
Awesome Infra for AI › Educational Resources
QuesmaOrg/awesome-ai-tokenomics
Awesome AI Tokenomics is a curated reference maintained by Quesma about the economics of tokens in production AI systems: what they cost, how to measure them, how to spend fewer of them and how to keep spending under control. Every entry is a link with a one-line summary that states what the item does and the number behind it, and each carries a badge marking its kind, whether tool, paper, benchmark, dataset, company or report, together with the licence when it is known. The list is organised around what an operator wants to do rather than by technology. Monitor collects dashboards and usage trackers that read agent logs and report token spend with caching-aware pricing. Optimize gathers techniques and tools for caching, prompt and context compression, context engineering, memory, and routing or model selection. Govern covers budgets, caps, quotas and the policy side. Understand and Measure hold pricing models, cache accounting, benchmarks and evaluations, energy and carbon figures, and material on multi-agent systems, gateways and proxies, and observability. On top of the link sections sit several short pages written by the maintainers: practices describe what to do, concepts explain how the underlying economics work, claims record what the authors currently believe together with the supporting evidence, and setups hold runnable configurations that can be pasted straight into a coding agent. It is aimed at engineers and platform teams that pay per token and need to decide where the money goes: which caching strategy is worth the complexity, when routing to a cheaper model is safe, how to account for cache reads and writes, and what to measure before optimizing. The maintainers describe it as a reference to browse, grep or hand to an agent rather than a product.
https://github.com/QuesmaOrg/awesome-ai-tokenomics