NeMo Guardrails

NeMo Guardrails is an open-source toolkit from NVIDIA for adding rules to LLM-based chatbots. Using a small modeling language called Colang, you define topics the bot should avoid, flows it must follow and checks on inputs and outputs.

It helps keep assistants on-topic, resist jailbreak attempts and call approved tools only. It can sit between your app and any model.

Setup takes some learning, but it gives fine-grained control that simple system prompts cannot.