Awesome Infra for AI › Weekly › 2026-06-22

2026-06-22

5 projects added

AI Governance & Compliance

iflytek/skillhub

SkillHub is a self-hosted, open-source agent skill registry for enterprises to publish, version, discover, and govern reusable skill packages for AI agents with RBAC and audit logs.

AI Safety & Guardrails

ZaxbyHub/opencode-swarm

OpenCode Swarm is an architect-centric agentic plugin for OpenCode that orchestrates specialized AI agents to generate, review, and test code, enforcing rigorous gated pipelines and security guardr...

Inference Optimization

zengxiao-he/tessera

From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX or...

raketenkater/ggrun

GGRUN is an auto-tuning launcher for GGUF models on llama.cpp/ik_llama.cpp, providing an OpenAI-compatible server with multi-GPU tensor splitting, MoE expert placement, AI-tuned flag optimization, ...

LLM Gateways & Proxies

caozhiyuan/copilot-api

A small AI gateway acting as an OpenAI and Anthropic-compatible proxy for GitHub Copilot, Codex, and other third-party AI providers, enabling unified access and management.

Newer issue Older issue