Big Data Engineer (Spark/Scala/Java)

🔥Become a Luxoft employee🔥

Our Benefits:

💰Paid Referrals

💻Equipment: laptop and monitor

🩺Private Medical & Dental care & Life Insurance covered

🏋🏽 ♀️ MyBenefit program (sports card, well-being program etc.)

🌎 Internal Mobility program - possibility of rotation between projects, locations, accounts

🎓 LuxTalent platform (webinars, training, courses)

...and more!

Project Description:

ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver:

• Scalable cost-efficient infrastructure, using cloud PaaS components.

• Single core platform, open architecture, designed for change, itemised $cost metrics, automated data lineage.

• Shared across Front Office, Finance and Risk, improving regulatory compliance.

• One-Platform / One-Experience -fast to train, easy to operate, retaining talent.

The ACQA platform is made up of a series of components providing the next generation valuation and risk management services.

Responsibilities:

• Work with multiple federated teams to enable them to build Big Data solutions

• Manage the ACQA Databricks platform – provide monitoring and other tooling

• Provide best practices for runtime upgrades

Mandatory Skills Description:

• Development of big data technologies like Apache Spark and Azure Databricks

• Programming complex production systems in Java and Scala

• Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)

• Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab

• Experience with containerisation in development, build, and runtime environments, including experience with Kubernetes

Nice-to-Have Skills Description:

• Production experience with Terraform on a major public cloud provider (ideally Microsoft Azure)

• Python experience

• Testing and instrumentation practices, observability and alerting tooling

• Understanding of information modelling, data structures and algorithms

• Technical architecture and low-level design

• Agile development and planning practices

• Ability to collaborate effectively in a large global team and influence key architectural decisions

Languages:

English: B2