Software Engineer Task Author (AI Training)

About the role

About The Role

Alignerr is building a dataset of expert tasks that train and evaluate advanced AI agents on real enterprise engineering work. As a Task Author, you will design and calibrate authentic engineering challenges — diagnosing failing integrations from logs, tracing bugs through codebases, and writing and verifying real fixes — that genuinely push the limits of capable AI agents.

Germany's engineering talent spans automotive technology, industrial IoT, enterprise SaaS, and manufacturing software — all domains highly relevant to this work. If you are a working software engineer who operates in production environments, reads real logs, and writes real fixes, this role is a strong fit.

Organization: Alignerr

Type: Hourly Contract

Location: Remote

Commitment: Flexible, task-based

Key Responsibilities

Author realistic engineering task prompts covering integration failures, log-based debugging, bug traces through source code, and configuration or integration fixes

Write scoring rubrics that define exactly what a correct fix or diagnosis looks like and how it is verified — including live environment validation where applicable

Set up task environments with realistic codebases, logs, alerts, and system states that place an AI agent in a plausible engineering situation

Solve each task yourself — write the actual fix and confirm it works — to validate the task is sound and the rubric is accurate

Calibrate task difficulty by adjusting code complexity, log volume, failure modes, or ambiguity until the task reliably challenges the model to the intended degree

Review and correct AI-drafted task prompts or rubrics when provided

Qualifications

Working software engineer with hands-on, industry-level experience — this is not a theoretical or instructional role

Fluency in Git, version control workflows, and code review practices

Strong debugging skills: comfortable reading logs, using observability tools, and tracing failures through a codebase

Experience with infrastructure, integrations, and configuration code (APIs, services, config files, CI/CD)

Ability to write and verify a code fix in a live or simulated environment

Ability to define precise, checkable correctness criteria for engineering outcomes

Strong written communication skills in English

Nice to Have

Experience in manufacturing, automotive software, industrial IoT, or enterprise SaaS engineering — sectors where Germany's engineering community excels

Background with monitoring and observability platforms such as Datadog, Grafana, or PagerDuty

Familiarity with embedded systems, OT/IT integration, or SCADA environments

Why Join Us

Work on cutting-edge AI projects alongside leading research labs

Fully remote and flexible — work when and where it suits you

Freelance autonomy with the structure of meaningful, well-defined task-based work

Contribute directly to how AI systems understand and perform real software engineering

Potential for ongoing work and contract extension as new projects launch