Popular repositories Loading

1. OpenRLHF OpenRLHF Public

   RLHF based

2. AV AV Public

   TypeScript

3. raweval-eval-core raweval-eval-core Public

   LLM evaluation infrastructure — IAA workbench, LLM-as-a-judge harness, output drift detection, multi-model cost routing. Powers chat.raweval.com.

   Python

4. raweval-iaa-engine raweval-iaa-engine Public

   Production IAA engine — Krippendorff's Alpha, SBERT semantic agreement, Fleiss' Kappa, Shannon entropy, 3-layer collusion detection. Ran behind RawEval's 9-annotator workbench.

   Python

5. raweval-interview raweval-interview Public

   AI interview engine — resume parsing, context-aware question generation, deterministic rubric scoring, hire band recommendation. Live at work.raweval.com.

   Python

6. raweval-qc-pipeline raweval-qc-pipeline Public

   4-stage annotation QC pipeline — rubric generation, 3-judge LLM panel, fraud detection (5 attack vectors), verdict aggregation. Catches bad AI annotations before they reach training data.

   Python