Skip to main content

Open source

Built by Raintree Technology

PolicyStrata LLM Policy Drift Testing

Explore PolicyStrata's deterministic tests for cross-layer policy drift, clean controls, transition obligations, and minimized failure witnesses.

Install: pip install policystrata

Definition

What PolicyStrata does

PolicyStrata is an open-source regression-testing framework for policy drift in LLM data-agent stacks. It checks whether manifests, validators, compilers, database controls, and release filters preserve the responsibility assigned to each layer.

Audience

Who it is for

PolicyStrata is for teams that operate governed data agents and need repeatable evidence that authorization, semantics, lineage, containment, and release behavior still agree after a policy, schema, or model-facing surface changes.

Capabilities

Responsibility-scoped tests

Each policy-bearing layer is checked against its own obligation instead of being treated as an equivalent copy of another layer.

Deterministic benchmark

DataPolicyDriftBench covers seeded, generated, held-out, and clean-control suites that can run without an LLM API key.

Minimized witnesses

Failures produce smaller reproducible cases that identify the first violated transition.

How the work stays reviewable

  • Clean controls

    The benchmark includes unchanged configurations so a detector must avoid false positives as well as find injected faults.

  • Explicit limits

    Published results are described as coverage of the implemented fault model, not recall on unknown production failures.

  • Reproducible artifacts

    The repository, paper, PDF, benchmark traces, and artifact kit expose the material behind the reported result.

Evidence and access

Back to the portfolio