Back to all jobs

AI Training Scenario Designer

Work from home Full-time role Hiring

About the Role

We're looking for creative, detail-oriented experts to help train the next generation of AI agents. You'll design realistic, complex digital worlds and craft challenging scenarios that test how well AI navigates real-world tasks — think scheduling conflicts, information overload, competing priorities, and more.

  • *What You'll Do**

- Build richly detailed personas and simulated digital environments (Gmail, Slack, Calendar, WhatsApp, Google Drive, and more) - Write tasks that challenge an AI agent's ability to reason, filter, and prioritize - Run the agent against your scenarios, evaluate its performance, and guide it to success through structured hints - Document your work clearly in Airtable and Crucible

  • *You're a Good Fit If You**

- Have strong written communication and attention to detail - Think creatively and enjoy constructing layered, realistic scenarios - Are comfortable working with structured tools like JSON editors, Airtable, and AI platforms - Can spot inconsistencies and think critically about information quality - Work independently and manage your own workflow -

Must Have

- Undergrad degree, 2+ years professional experience. -

Nice to have:

-

Writing chops

— copywriter, UX writer, journalist, content strategist, editor, published blog/newsletter, creative writing background. Strong writers make the best task creators _and_ reviewers -

Multi-stakeholder coordination

— PM, account manager, consultant, client success, event coordinator, producer. Creates richer, more authentic professional scenarios -

World-building / creative design

— game designer, curriculum designer, UX researcher, simulation designer, tabletop RPG creator -

Technical / data comfort

— JSON familiarity, Jira/Asana power user, technical PM, data analyst, SQL/Python exposure. A plus but not required — we'll provide a JSON onboarding guid Apply To This Job

More remote roles to explore

CADD Designer - Bridge

Work from home Full-time role

Performance Creative Strategist (paid ads)

Work from home Full-time role

AI Creative Director

Work from home Full-time role

Game Development / Environment Artist - California, US (Freelance - Remote)

Work from home Full-time role

Photo Editor, Animals - National Geographic

Work from home Full-time role

Content Creator - Entertainment (Freelance)

Work from home Full-time role

Associate, Publishing Strategy

Work from home Full-time role

Senior Medical Secretary / Healthcare Administrative Specialist ($50/hr, )

Work from home Full-time role

Traveling Pediatric Dental Assistant

Work from home Full-time role

[Hiring] Dental Biller @Paired

Work from home Full-time role

NP/PA/CNS - Chemo Care / Infusion (Hybrid)

Work from home Full-time role

Experienced Data Entry Specialist – Join arenaflex's Dynamic Team

Work from home Full-time role

Experienced EIT Project Manager – Healthcare IT and Clinical Solutions

Work from home Full-time role

Experienced Customer Success Manager – Media and Technology Industry Expert

Work from home Full-time role

Lead Game Designer

Work from home Full-time role

Physician Reviewer (AI Solutions)

Work from home Full-time role

Experienced Customer Support Assistant – Delivering Exceptional Service in a Dynamic Environment at arenaflex

Work from home Full-time role

Experienced Full Stack Customer Service Representative – Pet E-commerce Support

Work from home Full-time role

Senior Intellectual Property Counsel

Work from home Full-time role

Part-Time Data Entry Clerk – Flexible Schedule and Competitive Hourly Rate

Work from home Full-time role