Human data for video and image models Top creative professionals who have worked for the biggest channels on the internet. They rank, score and mark up what your model makes, against your rubric. Experts from 150+ countries Scoped per project Prompt UGC style, 9:16. A woman pours coffee and tells the camera why she gets up at 6. Handheld, warm morning light. 01 Who judges your model The people judging your model's short-form video should be the ones the biggest channels hire to make it. The professionals on Roster have worked for channels with 1B+ combined followers . For your project, we brief the ones whose experience fits the task. Work that needs a trained eye . The tasks post-training teams already run, done by people who make this content for a living. Each card shows what comes back. A or B, with the reason Two generations, one prompt. The rater picks per dimension, ties allowed, and writes one line on why. Feeds reward models Scores against your rubric Each clip or image scored 1 to 5 per criterion, with a short rationale your researchers can read. Feeds evals and graded RL Every defect, timestamped Hands, faces, text, physics and continuity across a cut, pinned to the frame and labeled by type. Feeds fine-grained reward models Taste, written as criteria Senior creatives write the criteria and the eval prompts for what they know best: hooks, pacing, captions and thumbnails. Feeds benchmarks and holdout evals Prompts that break your model Creatives write the requests that should fail: a real creator's likeness, a brand logo, fake UGC for a product claim. Each failure comes back with its seeds. Feeds safety evals Captions in an editor's words Dense captions that name shot, motion, cut and pacing, plus hand-picked reference clips with notes on why they work. Feeds SFT and quality tuning 03 Scoping tool Scope the pool your project needs . Pick the modality, task, seniority and volume to see the shape of a pilot. Send it to us with the form below.

04 How a project runs Start small, then scale . You brief us, we find the professionals and run them on your project. The method stays yours, and the shape is the usual one for a new rater pool. You brief us on the task Share the task, your guidelines and a few labeled examples. We tell you who fits and whether we can staff it. A small cohort works a sample A handful of raters from the network work a sample batch against your gold items, in the tool you already use. Splits get discussed Disagreements on subjective items are reviewed with your team and the guidelines tighten. You keep the raters who converge on your rubric. Grow what works, or stop Add raters who match the calibrated profile, or end after the pilot. Each project is scoped on its own. Roster in numbers countries the experts on Roster work from combined followers across the channels on Roster Channels on Roster Subscribers on YouTube Stokes Twins 147M · Comedy Alan Chikin Chow 71M · Comedy Alan Chikin Chow Jordan Matter 27M · Kids & Family 27M · Kids & Family Chloe Ting 25M · Fitness Jesser 23M · Sports Nick DiGiovanni 22M · Food Nick DiGiovanni Rebecca Zamolo 17M · Lifestyle 17M · Lifestyle 06 Get in touch Brief us on your next eval . Send us the scope and we'll reply by email.