Senior Data Engineer with Java, Apache Spark
Indexed description
We are seeking a Senior Data Engineer to join a technology-driven organization operating in the financial data domain, building a production-grade analytics and data ingestion platform processing large-scale financial datasets. This role focuses on designing, building and operating large-scale data ingestion and analytics solutions for batch and real-time processing of financial data, supporting critical downstream analytics and reporting use cases.
Experience the freedom of remote work from anywhere in Georgia, whether from the comfort of your home, our modern offices in Tbilisi and Batumi or a coworking space in Kutaisi.
Responsibilities
- Design, develop and maintain Apache Spark batch pipelines and Kafka streaming solutions
- Build serverless microservices using AWS Lambda and Azure Functions
- Develop data ingestion connectors for databases, file systems, message queues and financial data feeds
- Write production-grade code in Java, Scala and Python
- Manage infrastructure using Terraform across multiple environments
- Containerize and deploy applications using Docker and Kubernetes (EKS/AKS)
- Implement and maintain CI/CD pipelines in GitLab CI
- Write and maintain unit and integration tests with high code coverage
- Monitor platform health and troubleshoot production issues in distributed systems
Requirements
- 5+ years of experience in data engineering or backend platform development
- Proficiency in Java and/or Scala as primary languages with Python as secondary
- Expertise in Apache Spark including Spark SQL and Spark Streaming
- Skills in Apache Kafka and event-driven architectures
- Competency in SQL and data modeling
- Familiarity with AWS cloud services and serverless computing
Nice to have
- Knowledge of Terraform for Infrastructure as Code
- Skills in Docker and Kubernetes (EKS/AKS)
- Familiarity with CI/CD pipelines such as GitLab CI, Jenkins or equivalent
- Background in cloud data warehouses such as Amazon Redshift
- Understanding of Microsoft Azure services and Azure-native tooling
- Knowledge of Iceberg, Hudi or Delta Lake
We offer
- We connect like-minded people
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
- We invest in your growth
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to LinkedIn Learning and Udemy
- Free English classes with certified teachers
- We cover it all
- Participation in the Employee Stock Purchase Plan
- Monetary bonuses for engaging in the referral program
- Comprehensive medical & family care package
- Five trust days per year (sick leave without a medical certificate)
- Benefits package (sports activities, a variety of stores and services)
EPAM Georgia is a team of innovators united by a passion for technology. The dynamic and inclusive culture we embrace helps positively impact our communities, clients, and employees. Here you will collaborate with multi-national teams, contribute to numerous cutting-edge projects, deliver the most creative solutions, and have an opportunity to learn. Our people are at the heart of our success, and we are proud to provide talents with a solid ground to develop and grow.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search