Senior Big Data Engineer (Scala/Spark)

We are looking for a Senior Big Data Engineer for an American multinational corporation and technology company. The project goal is to implement pipelines and infrastructure for reports generated based on huge amounts of data collected into data sets. Our team’s job is to design, code and verify jobs written in the latest version of Scala/Spark and make sure that the algorithms we implement return correct statistics which will be further used by our stakeholders. The project team is distributed, giving us a chance to work with leading big data engineers both in Europe and overseas.

Even though this is a Big Data engineer position, CI/CD and DevOps knowledge would be a big plus for a candidate for this project, as working with infrastructure will be part of the job.

Responsibilities

• Working on infrastructure-related initiatives, such as Spark upgrades, cloud migration, and overall platform improvements.
• Contributing to Dev Analytics solutions and helping improve existing analytics processes.
• Extending and improving Crash Analytics functionality.
• Working with infrastructure observability, monitoring, and management tooling to support system stability and performance.

Requirements

• Strong experience with Scala.
• Hands-on experience with Spark and Spark Streaming.
• Understanding of Kubernetes, especially how Spark runs on Kubernetes.
• Experience with Hive and/or Iceberg.
• Experience with Airflow.
• Strong SQL skills

We offer

• Opportunity to work on bleeding-edge projects
• Work with a highly motivated and dedicated team
• Competitive salary
• Flexible schedule
• Benefits package - medical insurance, sports
• Corporate social events
• Professional development opportunities
• Well-equipped office

About Us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.