What is this page for?

🎯 RLHF Alignment Hub

Preference dataset collection, model arena side-by-side evaluation, and fine-tuning export engine

Total Candidates 0
Pending Annotation 0
Annotated Pairings 0
Top Model Elo β€”
Judge vs. Votes β€”
Target Domain:
INCOMING MODEL PROMPT (boardroom) Item #--
Loading candidate prompt from queue...
MODEL A (gemini-3.6-flash) Not judged yet
Response A loading...
MODEL B (gpt-4o) Not judged yet
Response B loading...
Hallucination Bad Code Overly Verbose Unsafe/Offensive Bad Formatting Off-Tone
Helpfulness: 3/5
Accuracy: 3/5
Tone & Alignment: 3/5

Model Elo Leaderboard

Rank Model Name Elo Rating Total Battles Wins Losses Ties Win Rate
Loading Elo metrics...

The ladder moves on human votes only, from a 1200 start with k=32. A Tie counts as a draw for both models. A Both Bad vote counts as a battle for both but is not a win, loss or tie, and moves no rating β€” nothing about it says which answer was better.

RLHF / DPO Fine-Tuning Datasets

Download Full DPO Dataset (JSONL)
πŸ€– What this page is for

Two AI answers to the same prompt, side by side, and you say which is better. Come here to work through the pending queue: vote A, B, tie or both-bad, score helpfulness, accuracy and tone, tag what went wrong, and write a corrected gold answer when neither is good enough. Votes move the model leaderboard and become the JSONL files you download to fine-tune on.