Outlier AI Logo

Outlier AI

Humanity's Finest - Referrals

Job Posted 7 Days Ago Posted 7 Days Ago
Be an Early Applicant
Remote
8 Locations
Expert/Leader
Remote
8 Locations
Expert/Leader
Join a team of top experts to craft challenging problems for AI models. Contribute to datasets and cite co-authorship in research papers.
The summary above was generated by AI

Note: At the moment, this opportunity is not available to applicants from California and New York.

We'll cut to the chase: we're looking for the world's best experts to take on the world's smartest models.

In Humanity’s Last Exam, we introduced the most challenging reasoning benchmark for frontier AI models. So far, the highest-performing system—OpenAI’s Deep Research—has achieved only 26% accuracy. We are collaborating with leading AI labs to identify the most effective data to improve AI reasoning capabilities in expert domains, and we aim to publish a new paper presenting our findings.

To do this, we are assembling a team of elite individuals who are the utmost experts in their respective fields. Our shared goal is to create PhD+ level problems that current state-of-the-art LLMs cannot correctly solve. This team will work collaboratively to produce datasets that will be available to our partner research groups, the world’s most advanced AI laboratories.

We're looking for unicorns to help us write some of the hardest problems intelligence has ever seen — do you think you can do this?

Why Join?

  • Have the opportunity to co-author a research paper analyzing how effectively this data enhances model reasoning.
  • Get access to an exclusive community of world-class researchers in a variety of domains; Each task submission will be open to peer review.
  • Receive up to $540 for each contributed problem and solution pair

What’s Next?

  • Still unsure? Watch this quick video of what comes after you hit "Apply Now" below
  • If you're up for the task, apply below!

PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data.

This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances.

Top Skills

Ai Research
Data Analysis
HQ

Outlier AI Oakland, California, USA Office

Oakland, Oakland, CA, United States, 94612

Similar Jobs

Yesterday
Remote
Hybrid
India
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Sr. Data Engineer will design and implement data pipelines, utilizing big data tools and technologies. Responsibilities include programming in Pyspark/Scala, managing scheduling with Airflow, and troubleshooting code issues. The role supports financial and energy sectors, emphasizing innovative solutions in data engineering.
Top Skills: AirflowAnsibleApache HadoopElastic SearchEtl FrameworksGitGitHiveJavaJenkinsJIRALinuxMap ReducePysparkPythonRestful ServicesScalaSparkSQLUnixYarn
Yesterday
Remote
Hybrid
India
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
This role requires analyzing data, documenting business processes, and participating in solution design and change management activities. The individual will collaborate on implementing solutions and track progress while managing status reporting. Strong interpersonal skills and banking domain knowledge are essential.
Yesterday
Remote
Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
As a Data Architect, you'll design and develop data architecture solutions in Finance, enhancing stakeholder collaboration and ensuring compliance.
Top Skills: AWSAzureEr StudioErwinGCPPowerdesignerVisual Paradigm

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account