Software Engineer II, MLOps Framework

Ladders
RemoteFull-time$139,000–$166,800Posted Aug 27, 2026

About the role

For our client, we are seeking a Software Engineer II, MLOps Framework to join the team of a leader in the Manufacturing & Automotive space.

This role will focus on building and refining the infrastructure that enables machine learning models to move efficiently from development into production on edge devices. You will work closely with model development teams and other stakeholders to ensure releases are traceable, reproducible, and meet strict latency and quality requirements. The position sits at the intersection of software engineering, model deployment, and validation for real-world automotive and manufacturing use cases.

Location: Remote - US based candidates only, no visa sponsorship available

Compensation: $139,000 – $166,800 annually

Responsibilities

Architect and implement model conversion and compilation pipelines for edge devices

Maintain and evolve the model release registry for traceability and reproducibility

Conduct latency benchmarking and model quality parity evaluations

Validate accuracy and latency compliance of models across platforms before release

Communicate findings to model development teams and stakeholders

Qualifications

Bachelor's or Master's degree in Computer Science, Electrical Engineering, Robotics, or a related field with relevant experience

4+ years of experience, or 2+ years with a Master's degree, in model conversion and compilation pipelines

Experience with ONNX, TensorRT, and torch.compile for model deployment

Hands-on experience deploying and testing models on edge hardware such as NVIDIA Orin

Familiarity with maintaining a model release registry in a production environment

Benefits

100% paid medical, dental, and vision premiums for full-time employees

401K plan with a 6% employer match

Flexibility in schedule and generous paid vacation starting immediately

AD+D and Life Insurance

Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.

Responsibilities

  • Architect and implement model conversion and compilation pipelines for edge devices
  • Maintain and evolve the model release registry for traceability and reproducibility
  • Conduct latency benchmarking and model quality parity evaluations
  • Validate accuracy and latency compliance of models across platforms before release
  • Communicate findings to model development teams and stakeholders

Qualifications

  • Bachelor's or Master's degree in Computer Science, Electrical Engineering, Robotics, or a related field with relevant experience
  • 4+ years of experience, or 2+ years with a Master's degree, in model conversion and compilation pipelines
  • Experience with ONNX, TensorRT, and torch.compile for model deployment
  • Hands-on experience deploying and testing models on edge hardware such as NVIDIA Orin
  • Familiarity with maintaining a model release registry in a production environment

Benefits

  • 100% paid medical, dental, and vision premiums for full-time employees
  • 401K plan with a 6% employer match
  • Flexibility in schedule and generous paid vacation starting immediately
  • AD+D and Life Insurance

Skills mentioned

MLOpsModel DeploymentModel ServingPerformance TestingPerformance OptimizationPythonDeep LearningCUDAEmbedded SystemsSoftware Testing

About Ladders

We lead the leaders. Ladder’s community of 10 mm leading professionals come to us to be inspired, grow in their careers, and get ahead in their professional lives. We focus on the $100K+ job market, representing 25% of all jobs and about 50% of income in the US & Canada. We build data-driven tools, marketplaces, news and entertainment products for our growing audience, and the companies, recruiters, and advertisers that want to reach them. We work best with people who enjoy using their talents, commitment and hard work to achieve great successes for millions of real life users through products that impact their careers. We are deeply technology-driven -- about half the company are engineers, technical product people or product designers -- but we never build technology for technology’s sake. We’re always trying to connect our efforts to the good it can do in people’s lives.

Technology51-200 employeesNew York

H-1B sponsorship history

Historical employer filing data was found for Ladders. The employer record includes 8 historical certified applications. This is employer-level history, not a guarantee that this role currently offers sponsorship.