Pinned Loading

1. Guardrails-AI Guardrails-AI Public template

   Reliable AI Infrastructure: Input/Output validation, structured data generation, and real-time risk mitigation for LLMs. Includes 50+ pre-built validators for PII, toxicity, hallucinations, and more.

   Python 1

2. aMMare-Asymmetric-Multi-Model-AI-Routing-Engine aMMare-Asymmetric-Multi-Model-AI-Routing-Engine Public

   A containerized, local-first agentic AI toolchain. LangChain middleware validates model output and executes approved tools; Headroom optimizes context; LiteLLM routes between a local vLLM endpoint …

   Shell 1

3. Containerized-llamma.ccp-AMD-9700 Containerized-llamma.ccp-AMD-9700 Public

   Containerized environment for deploying llama.cpp specifically optimized for AMD hardware, particularly configured for the Ryzen 9700. It simplifies the deployment of large language models on AMD-b…

   Shell

4. vLLM-Llama.ccp-Dashboard vLLM-Llama.ccp-Dashboard Public

   This repository provides a dashboard interface for monitoring and managing large language model inference, specifically integrating vLLM and llama.cpp environments. It is designed to provide visual…

   Python

5. Containerized-Hermes-AI-llama.ccp-connector Containerized-Hermes-AI-llama.ccp-connector Public

   Automated, idempotent deployment of Nous Research Hermes Agent and its management dashboard, preconfigured for local llama.cpp inference on Linux.

   Python

6. Containerized-VLLM-AMD-R9700 Containerized-VLLM-AMD-R9700 Public

   Repo to spin up VLLM with DeepSeek Coder 33b

   Shell