Senior AI/ML Research Engineer
CNA SearchAbout the role
We’re looking for a Senior AI/ML Research Engineer to work on large-scale AI inference, synthetic data generation, and distributed training systems.
This is a hands-on research and engineering role for someone who has built infrastructure supporting large-scale AI models and wants to work on difficult problems across inference performance, distributed systems, reinforcement learning, and synthetic data.
No third parties
What You’ll Do
Design and build large-scale synthetic data generation pipelines and orchestration systems.
Optimize AI inference workloads for performance, cost, memory, and compute utilization.
Build and improve distributed inference infrastructure for large-scale AI models.
Contribute to open-source libraries and frameworks for synthetic data generation and distributed reinforcement learning.
Research and implement new approaches to model inference, training, and post-training.
Collaborate with researchers and engineers working on large-scale AI systems.
Contribute research suitable for publication at conferences such as ICML and NeurIPS.
Translate highly technical work into clear technical content for developers and users.
Stay current with advances in AI infrastructure, distributed inference, synthetic data, and model optimization.
What We’re Looking For
Strong AI/ML engineering background with experience building production systems for large-scale model inference or training.
Experience designing and implementing end-to-end AI/ML pipelines.
Deep understanding of distributed inference and optimization of large-model workloads.
Hands-on experience with inference frameworks such as vLLM or SGLang.
Strong understanding of GPU compute, memory optimization, throughput, latency, and resource utilization.
Experience with one or more of the following is especially valuable:
LLM inference infrastructure
vLLM
SGLang
Distributed inference
Distributed training
Reinforcement learning
Synthetic data generation
GPU optimization
Model post-training
Large-scale ML systems
Responsibilities
- Design and build large-scale synthetic data generation pipelines and orchestration systems
- Optimize AI inference workloads for performance, cost, memory, and compute utilization
- Build and improve distributed inference infrastructure for large-scale AI models
- Contribute to open-source libraries and frameworks for synthetic data generation and distributed reinforcement learning
- Research and implement new approaches to model inference, training, and post-training
- Collaborate with researchers and engineers working on large-scale AI systems
- Contribute research suitable for publication at conferences such as ICML and NeurIPS
- Translate highly technical work into clear technical content for developers and users
Qualifications
- Strong AI/ML engineering background with experience building production systems for large-scale model inference or training
- Experience designing and implementing end-to-end AI/ML pipelines
- Deep understanding of distributed inference and optimization of large-model workloads
- Hands-on experience with inference frameworks such as vLLM or SGLang
- Strong understanding of GPU compute, memory optimization, throughput, latency, and resource utilization
Skills mentioned
About CNA Search
CNA Search advises companies on the leadership required to build modern technology platforms. We specialize in identifying the operators behind artificial intelligence systems, digital infrastructure, advanced analytics, and enterprise software organizations. In markets where experienced builders are scarce, we help companies secure the leaders capable of scaling engineering teams, launching products, and driving enterprise growth. Our clients include venture backed companies, private equity platforms, and enterprise technology organizations investing heavily in AI, data, and digital infrastructure. CNA Search focuses on leadership across: Artificial Intelligence and Machine Learning Data and Analytics Leadership Digital Infrastructure and Data Centers Enterprise Software and Platforms Executive and Technical Leadership We partner with organizations where the right hire materially changes the trajectory of the business.