Askable is the research platform helping enterprises build better products, and frontier AI labs build better models. Millions of verified participants, and a platform powering thousands of research and product teams globally.
Position: Accounting / Bookkeeping Expert
Type: Contract, two weeks, full-time
Compensation: $60 to $90 per hour
Location: Remote, any location
We're looking for accountants and bookkeepers to spend two weeks stress-testing AI models against the work you actually do. You'll write realistic task scenarios, run them at the model, and build the rubrics other reviewers grade against.
Role responsibilities
- Design task briefs from real accounting workflows: reconciliation and month-end close, AR and AP management, payroll, BAS and tax preparation, financial statement review, chart-of-accounts restructuring, and multi-entity reporting in QuickBooks.
- Specify what a task needs to be realistic: the ledger state, the source documents, the data the model has to work from, and the call a strong practitioner should reach.
- Run your prompts at the model to surface failure modes, hallucination triggers and reasoning gaps, then escalate the complexity.
- Write reference answers and scoring criteria that separate a correct treatment from one that is plausible but wrong.
- Author objective, self-contained rubrics backed by explicit reference sources, so peer reviewers grade the same output the same way.
Qualifications
Must-have
- 5+ years professional accounting or bookkeeping experience.
- 3 to 4 years hands-on in QuickBooks.
- Hands-on experience writing complex prompts, evaluating LLM output and building evaluation rubrics.
- Professional English, written and spoken.
- Full-time availability across the full two weeks.
- A secure personal or corporate device. Public or shared computers aren't permitted.
Preferred
- More than one accounting platform
- Practice or firm experience covering several client entities at once.
- A CPA, CA or equivalent qualification.
- You've written training material, SOPs or review checklists for other accountants.
- Prior AI training or evaluation work on RLHF, DataAnnotation, Outlier, Scale AI or similar.
Terms
- You're engaged as an independent contractor for the length of the campaign. The fee is agreed before you start.
- You won't use your employer's or your clients' data. The tasks are scenarios you author. Don't bring confidential information to this work.
- Campaigns can be extended, shortened or ended early depending on need and performance.
