Software Engineer — AI Code Ranking

About the role

About The Role

What if your years of software engineering experience could directly shape how AI writes code for millions of developers? We're looking for Software Engineers in New York to evaluate, rank, and refine AI-generated code — helping the next generation of coding assistants produce solutions that are correct, efficient, idiomatic, and production-ready.

Your deep understanding of software architecture, design patterns, and real-world engineering trade-offs is exactly what AI models need to get better. This isn't about writing boilerplate — it's about applying expert judgment to push the boundaries of what AI can do with code.

This is a fully remote, flexible contract role built for experienced developers who want meaningful, high-impact work on their own schedule.

Organization: Alignerr

Type: Hourly Contract

Location: Remote

Commitment: 10–40 hours/week

What You'll Do

Review and rank AI-generated code solutions across multiple programming languages and problem domains

Evaluate code for correctness, efficiency, readability, maintainability, and adherence to best practices

Identify bugs, anti-patterns, security issues, and performance bottlenecks in AI-generated outputs

Write detailed, structured feedback explaining why one solution is better than another

Refine and improve AI-generated code to meet production-level engineering standards

Provide preference rankings that help AI models learn what "good code" actually looks like

Work independently and asynchronously — fully on your own schedule

Who You Are

Software engineer with 3+ years of professional development experience

Proficient in one or more major programming languages (e.g., Python, JavaScript/TypeScript, Java, C++, Go, Rust)

Strong grasp of data structures, algorithms, and computational complexity

Deep understanding of software design principles, clean code practices, and engineering trade-offs

Experienced with code review — you know how to assess quality and articulate why something works or doesn't

Clear, concise written communicator who can explain technical decisions effectively

Self-motivated and reliable when working independently without supervision

Nice to Have

Experience across multiple languages, frameworks, or tech stacks

Background in systems design, distributed systems, or backend architecture

Familiarity with AI/ML concepts or experience using AI coding tools (Copilot, ChatGPT, etc.)

Prior experience with code evaluation, technical mentoring, or open-source contribution

Knowledge of security best practices and performance optimization

Experience in competitive programming or technical interviewing

Why Join Us

Work on cutting-edge AI projects alongside leading research labs

Directly influence how AI coding assistants learn to write better software

Fully remote and flexible — work when and where it suits you

Freelance autonomy with the structure of meaningful, task-based work

Leverage your hard-earned engineering expertise in a new, high-impact way

Potential for ongoing work and contract extension as new projects launch

Join a global community of top-tier engineers shaping the future of AI-assisted development