AI Engineer
About the role
AI Engineer (Forward Deployed)
NYC - $200k-$350k - early equity
Join a small, high-calibre AI team working at the frontier of model development and deployment.
This is a hands-on Applied ML role focused on LLM post-training, fine-tuning, and evaluation, adapting models for real-world use cases and pushing performance in production environments.
What You’ll Do:
Fine-tune and iterate on LLMs
Build and run evaluation frameworks to measure real performance
Prepare and curate training data from messy, real-world inputs
Debug training and inference issues, improving model reliability
Support deployment of models into production environments
What We’re Looking For:
Strong hands-on experience with LLM post-training and fine-tuning
Deep understanding of evaluation methodology and model quality
Comfortable with training infrastructure and debugging training runs
Strong Python engineering fundamentals and experience shipping ML systems
Ability to operate in fast-paced, ambiguous environments
Responsibilities
- Fine-tune and iterate on LLMs
- Build and run evaluation frameworks to measure real performance
- Prepare and curate training data from messy, real-world inputs
- Debug training and inference issues, improving model reliability
- Support deployment of models into production environments
Qualifications
- Strong hands-on experience with LLM post-training and fine-tuning
- Deep understanding of evaluation methodology and model quality
- Comfortable with training infrastructure and debugging training runs
- Strong Python engineering fundamentals and experience shipping ML systems
- Ability to operate in fast-paced, ambiguous environments
Benefits
- Early Equity
Skills mentioned
About scalr
scalr places Forward Deployed Engineers, Engagement Managers and Engineering Leaders at the fastest-moving AI startups in San Francisco and New York.