Staff Software Engineer - Ingestion Platform

About the role

This is a Fully Remote Job

About Our Client:

Reddit operates as a large internet community platform hosting over 100,000 active communities and approximately 130 million daily active unique visitors. Positioned in the social media and content sharing space, the organization addresses the challenge of enabling open and authentic conversations across diverse interests. Its infrastructure supports reliable, high-performance, and efficient content experiences at scale, impacting critical user interactions such as feeds, posting, commenting, and voting.

About the Opportunity:

The STAFF SOFTWARE ENGINEER - INGESTION PLATFORM role is focused on leading the development and evolution of a core data ingestion platform that supports distributed data movement across streaming and batch workloads. This position drives improvements in operational reliability, scalability, and user experience for platform consumers, directly influencing the ability to manage data pipelines integral to key product functions and growth.

Responsibilities:

Lead design and delivery of reliable distributed data ingestion software emphasizing availability, scalability, latency, and cost efficiency.

Own architecture and evolution of platform components including pipeline APIs, controllers, connectors, schemas, and sink integrations.

Extend platform capabilities beyond existing Kafka-to-BigQuery integration to other data stores and reusable processing features.

Develop high-quality connectors and abstractions for various data systems while maintaining modularity.

Enhance self-service features for platform users through APIs, automation, documentation, and observability.

Manage migrations from legacy ingestion systems in collaboration with other teams.

Establish reliability, security, and operational best practices for pipelines running on Kubernetes.

Identify and lead improvements in platform architecture and user experience to support organizational growth.

Collaborate across teams to align roadmaps and deliver robust solutions.

Mentor engineers to improve technical design, operational excellence, and customer focus.

Requirements:

10+ years experience in building internet-scale distributed systems or developer platforms.

Degree or equivalent experience in Computer Science or related field.

Proficiency in general-purpose programming languages such as Go, Python, Java, or Scala.

Expertise in designing and operating high-throughput, fault-tolerant data pipelines.

Experience with Kafka, BigQuery, S3, GCS, Apache Iceberg, Flink or similar.

Skilled in API and platform abstraction design, including schema evolution and serialization.

Familiarity with Kubernetes and cloud-native platform concepts.

Strong knowledge of observability, monitoring, incident response, and safe migration practices.

Product-minded with ability to translate user needs into reliable scalable solutions.

Proven technical leadership in complex cross-functional projects.

Excellent communication and collaboration skills.

Experience or interest in low-code or self-service developer platforms is a plus.

Pay Range and Compensation Package:

This role offers base salary, equity in the form of restricted stock units, and may include commission depending on the position.

The pay range and compensation package for this role will be determined based on the candidate's experience, skills, and other relevant factors.

Benefits & Perks:

Medical, dental, and vision insurance.

401(k) program with employer match.

Generous vacation time and parental leave.

Equal Opportunity Statement: Our client is an equal opportunity employer. They celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, or national origin.

Note:

TalentHop is not the Employer of Record (EOR) for this role. Our purpose in this opportunity is to connect exceptional candidates with leading employers. We help job seekers worldwide discover roles that match their goals and guide them to complete their full application directly through the hiring company's career page or ATS.