Lead Data Software Engineer
EPAM SystemsAbout the role
We are looking for a Lead Data Software Engineer to drive the migration of an existing data analytics platform, originally built on Azure resources such as Data Factory, Databricks, Event Hub, and Cassandra, to a cloud-agnostic platform deployable on-premises.
Experience the freedom of remote work from anywhere in Georgia, whether from the comfort of your home, our modern offices in Tbilisi and Batumi or a coworking space in Kutaisi.
Responsibilities
Implement streaming and batch Spark pipelines running on Kubernetes
Lead the implementation of objects within the data generator framework
Oversee deployment and testing across local and development environments
Drive improvement of the current, actively changing solution
Conduct bug investigation and resolution
Perform unit testing to ensure solution quality
Participate in refinement, planning, and demo sessions
Guide and mentor team members throughout the implementation phase
Requirements
5+ years of experience with Apache Spark, Confluent/Apache Kafka, and Kubernetes
Proficiency in Python
Familiarity with the data engineering domain and cloud-agnostic platform migrations
Capability to dive deeper into new technologies in a short time during active implementation phases
Ability to work independently with syncs with a team lead
Strong communication skills and proactiveness
Showcase of being a hands-on team player and technical leader
Proficiency in English at a B2+ level
Nice to have
Knowledge of Java
Familiarity with Kafka Connect, KSQL, and Kafka Streams
Skills in Ansible and Argo CD
Understanding of TDD
We offer
We connect like-minded people
Delivering innovative solutions to industry leaders, making a global impact
Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
Opportunity to work abroad for up to two months per year
Relocation opportunities within our offices in 55+ countries
Corporate and social events
We invest in your growth
Leadership development, career advising, soft skills and well-being programs
Certifications, including GCP, Azure and AWS
Unlimited access to EPAM's internal learning database
Free English classes with certified teachers
We cover it all
Participation in the Employee Stock Purchase Plan
Monetary bonuses for engaging in the referral program
Comprehensive medical & family care package
Five trust days per year (sick leave without a medical certificate)
Benefits package (sports activities, a variety of stores and services)
EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.
Responsibilities
- Implement streaming and batch Spark pipelines running on Kubernetes
- Lead the implementation of objects within the data generator framework
- Oversee deployment and testing across local and development environments
- Drive improvement of the current, actively changing solution
- Conduct bug investigation and resolution
- Perform unit testing to ensure solution quality
- Participate in refinement, planning, and demo sessions
- Guide and mentor team members throughout the implementation phase
Qualifications
- 5+ years of experience with Apache Spark, Confluent/Apache Kafka, and Kubernetes
- Proficiency in Python
- Familiarity with the data engineering domain and cloud-agnostic platform migrations
- Capability to dive deeper into new technologies in a short time during active implementation phases
- Ability to work independently with syncs with a team lead
- Strong communication skills and proactiveness
- Showcase of being a hands-on team player and technical leader
- Proficiency in English at a B2+ level
Benefits
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to EPAM's internal learning database
- Free English classes with certified teachers
- Participation in the Employee Stock Purchase Plan
- Monetary bonuses for engaging in the referral program
- Comprehensive medical & family care package
- Five trust days per year (sick leave without a medical certificate)
- Benefits package (sports activities, a variety of stores and services)
Skills mentioned
About EPAM Systems
EPAM (NYSE:EPAM) is a global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, EPAM empowers organizations to become AI-native enterprises, driving measurable value from innovation and digital investments. Recognized by industry benchmarks and leading analysts as a leader in AI, EPAM delivers globally while engaging locally, making the future real for clients, partners and employees. We are proud to be recognized by Forbes, Glassdoor, Newsweek, Time Magazine, Great Place to Work and kununu as a Most Loved Workplace around the world. Learn more at www.epam.com and follow us on LinkedIn.