About this role
Phone numbers and emails in this ad are masked until you log in.
auto_translated_note
Role Title: Evaluation Specialist/Recent GradRole Type: ContractorLocation: Remotemicro1 is engaging Evaluation Specialists/Recent Grads to contribute to a high-impact project for a customer at the frontier of artificial intelligence. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input.
No prior experience in AI is required - your domain knowledge is what matters.Scope of Work Develop original, challenging question-and-answer pairs that test the limits of advanced AI models across diverse subjects. Conduct in-depth research, applying rigorous source triangulation to ensure each answer is accurate, comprehensive, and well-documented. Create multi-step questions that require synthesis and analytical reasoning - not just single-source lookups.
Test your questions against AI models, analyze outcomes, and iterate to increase or adjust difficulty as needed. Document your research process, providing clear citations and logical explanations for each answer. Refine content based on reviewer input and maintain alignment with project guidelines and quality standards.
Preferred
Qualifications
Proven ability to conduct thorough, independent research and critically evaluate information from multiple sources. Exceptional attention to detail and written precision in English (fluency required, but it does not need to be your first language). Talent for crafting nuanced and well-structured questions that probe deep understanding.
Strong self-direction, reliability, and accountability in remote, independent project work. Interest in cutting-edge AI and a passion for testing the boundaries of current model capabilities. Prior experience in AI training, evaluation, or content creation is a plus, but not required.
Open to recent graduates, advanced-degree holders, and individuals from any academic or professional background with demonstrated research and writing expertise.
Compensation Structure
Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission
Requirements
apply. Experts must submit a minimum of tasks per week.Start Timeline & AvailabilityWe typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24 - 48 hours of completing onboarding.Originally posted on Himalayas
Community Q&A
Anyone worked here? Ask before you apply.
No threads yet for this job or company.