Senior Data Scientist
Hire FeedAbout the role
Role: Senior Data Scientist (Remote)
Location: Remote (Work from Anywhere)
Job Type: Contract
Payout: $120-$170 / hr
Role Overview:
We are hiring for one of our clients, seeking a Data Science Expert to evaluate how well AI systems perform real-world data science work. The role involves defining grading criteria and scoring completed work samples with detailed written justifications. Candidates will assess analyses, models, dashboards, and written recommendations without producing deliverables themselves.
Key Responsibilities:
- Design precise, task-specific grading criteria for real-world data science deliverables including analyses, models, dashboards, experiment readouts, and written recommendations.
- Score AI-generated and human work samples against established criteria with detailed written justifications for each score.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on grading criteria and evaluations.
- Maintain high attention to detail while managing multiple evaluations with calibrated peer reviews.
Required Skills & Qualifications:
- Background in business operations, product, or growth data science at top-tier technology companies.
- Deep fluency in experiment design and A/B testing, metric definition, SQL, Python analysis, and communicating findings to executive stakeholders.
- Exceptionally strong written communication skills for crafting precise, evidence-based evaluations.
- Detail-oriented mindset with comfort in having judgment reviewed and calibrated against peers.
More About the Opportunity:
This role offers a unique opportunity to work with a leading AI research organization, contributing to the evaluation of AI systems in real-world data science applications. The project focuses on defining excellence in data science deliverables and improving AI performance through rigorous assessment.
Equal Opportunity Employer:
We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.
Apply Now!
Responsibilities
- Design precise, task-specific grading criteria for real-world data science deliverables including analyses, models, dashboards, experiment readouts, and written recommendations.
- Score AI-generated and human work samples against established criteria with detailed written justifications for each score.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on grading criteria and evaluations.
- Maintain high attention to detail while managing multiple evaluations with calibrated peer reviews.
Qualifications
- Background in business operations, product, or growth data science at top-tier technology companies.
- Deep fluency in experiment design and A/B testing, metric definition, SQL, Python analysis, and communicating findings to executive stakeholders.
- Exceptionally strong written communication skills for crafting precise, evidence-based evaluations.
- Detail-oriented mindset with comfort in having judgment reviewed and calibrated against peers.
Skills mentioned
About Hire Feed
HireFeed: A QuikHire product. Earn in dollars. On your hours. From wherever. HireFeed is the AI-curated feed of contract, gig, and AI training jobs that pay in USD, built for the people who actually want to work, not the ones writing job descriptions. Why it exists: the highest-paying contract work in the world - RLHF, AI evaluation, domain-expert training, senior contract engineering, sits scattered across hundreds of ATS feeds and platform job boards. Most of it never makes it to Indeed or LinkedIn, and the roles that do are usually stale by the time you find them. The best opportunities are also the most ephemeral. HireFeed pulls from 500+ verified sources, including Outlier, Mercor, Surge AI, Micro1, Turing, Toloka, Appen, and Remotasks, and refreshes every 60 seconds. The moment a role closes at the source, it falls off the feed. What you'll find here: - AI training, RLHF, and evaluation: $20–$80/hr - Domain experts: medical, legal, finance, math (PhD) - Senior contract engineering, paid weekly - Multilingual annotation, creative writing training, AI research What you won't find: pay-undisclosed listings, expired roles, "still accepting applications" lies, recruiter middlemen, or data resale. Pay is a hard requirement. Apply links 302-redirect to the source ATS. We never see your résumé. Free for candidates, forever. Funded by the partner side. → hirefeed.co.in