Use github actions cache to back the go build

Cost-efficient and pluggable Infrastructure components for GenAI inference

Health checks for Azure N- and H-series VMs.

Gateway API Inference Extension

Hyperlight is a lightweight Virtual Machine Manager (VMM) designed to be embedded within applications. It enables safe execution of untrusted code within micro virtual machines with very low latenc…

Open-source framework to review and patch code using your preferred LLM.

This Kubernetes fork is intended to provide long term support for Kubernetes releases, but is not an official release of the Kubernetes project. For more information, please see https://github.com/…

Basic Streamlit Application for testing, and displaying Multi-GPU LLM timings

A high-throughput and memory-efficient inference and serving engine for LLMs

Containerized Python based Framework for running and visualizing benchmark workloads on any Kubernetes/ OpenShift and runtime kinds pods, kata containers and kubevirt virtual machines simply and sa…

LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

📦 Produce secure packages and containers with declarative configurations

InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing

This is a Kubernetes controller that watches for changes to a custom resource and syncs the secrets from external secrets-store as Kubernetes secret.

🥑 Inspect and understand an organization's software supply chain that enables stakeholders to make actionable decisions about software supply chain security

Use Prometheus to monitor Kubernetes and applications running on Kubernetes

All the things to make the scheduler extendable with wasm.

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

Kubernetes AI Toolchain Operator

The Startup CTO's Handbook, a book covering leadership, management and technical topics for leaders of software engineering teams

🦜🔗 Build context-aware reasoning applications

A Ledger-backed Secure Key-Value store (LSKV), built on the Confidential Consortium Framework (CCF)

GitHub Action for Copacetic: Directly patch container image vulnerabilities

Tool to inspect and push and SPDX document as an OCI artifact

A lightweight WebAssembly runtime that is fast, secure, and standards-compliant

Home of StarCoder: fine-tuning & inference!

This is an experimental project to make it possible to write JavaScript guest applications that make use of SpiderLightning capabilities.

Experimental ONNX implementation for WASI NN.