Data Engineer

Data Engineer (Databricks, Spark & Cloud Data Platforms)

Global Insurance Leader | Investment Management

Our key partner, a leading international insurer, is seeking an experienced Data Engineer to join its Investment Management technology team in the Barcelona area.

This is an exciting opportunity to become part of a global function responsible for delivering critical investment data capabilities that support portfolio management, reporting, analytics, and investment decision-making across the business. The successful candidate will play a key role in the development of a strategic cloud-based data platform that leverages Bloomberg and other financial data sources to drive value across the organisation.

Working alongside investment professionals, data specialists, and technology teams across multiple regions, you will help build and enhance a rapidly growing data ecosystem at the heart of the company's investment operations.

The Role

As a Data Engineer, you will help design, develop, and maintain a modern investment data platform built on cloud technologies. You will be responsible for engineering scalable data pipelines, enhancing data architecture, and supporting the delivery of trusted, high-quality data to investment stakeholders globally.

This position would suit an individual who enjoys working in a collaborative environment, solving complex data challenges, and building enterprise-grade solutions using modern cloud and big data technologies.

Key Responsibilities

• Design and develop scalable cloud-based data solutions for investment management.
• Build and optimise data pipelines using Python, Apache Spark, and Databricks.
• Develop and maintain robust data models and database architectures.
• Integrate and manage data from Bloomberg and other financial data providers.
• Support reporting, analytics, and data-driven decision-making across investment teams.
• Ensure data quality, governance, performance, and reliability across the platform.
• Collaborate with global business and technology stakeholders to deliver strategic initiatives.
• Contribute to the ongoing evolution of the firm's investment data architecture.

Required Experience

• Proven experience as a Data Engineer, Analytics Engineer, or Software Engineer.
• Strong hands-on experience with Python, Apache Spark, and Databricks.
• Experience designing and supporting cloud-based data platforms and architectures.
• Strong understanding of ETL/ELT processes and modern data engineering principles.
• Experience working with large-scale data environments and complex datasets.
• Excellent communication and stakeholder management skills.

Desirable Experience

• Experience within Insurance, Asset Management, Investments, Banking, or Financial Services.
• Exposure to Bloomberg or other market data platforms.
• Experience with Azure, AWS, or Google Cloud.
• Knowledge of investment operations, portfolio analytics, or financial reporting environments.

Location Requirements

• Candidates must be based in Barcelona or the surrounding area, or be willing to relocate.
• Hybrid working arrangement with regular onsite collaboration expected.

What's on Offer?

• Opportunity to join a globally recognised insurance organisation.
• Work on a strategic, business-critical investment data platform.
• Exposure to cutting-edge cloud and data technologies.
• International environment with global stakeholders.
• Long-term career growth and development opportunities.
• Collaborative, innovative, and technology-driven culture.

If you are passionate about building modern data platforms and leveraging data to support investment decision-making, we would be delighted to discuss this opportunity with you.

Desired Skills and Experience

3+ years of Data Engineering experience including 2+ years designing and building Databricks data pipelines is required; Azure cloud is highly preferred, however will consider AWS, GCP or other cloud platform experience in lieu.

Experience with conceptual, logical and/or physical database designs is a plus

2+ years of hands-on Python/Pyspark/SparkSQL and/or Scala experience is required

2+ years of experience with Big Data pipelines or DAG Tools (Data Factory, Airflow, dbt, or similar) is required

2+ years of Spark experience (especially Databricks Spark and Delta Lake) is required

2+ years of hands-on experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta Lakes, is required

2+ years of SQL experience, specifically to write complex, highly optimized queries across large volumes of data is highly desired

Experience working in a controlled environment with Github and CI/CD release pipelines is highly desired

Experience with financial data providers such as Bloomberg in an asset/investment management firm or other financial service company is highly desired but not essential

Experience with AI, LLMs, Databricks Genie or similar tools is required

Must be comfortable speaking English

A positive attitude and a 'can do' mentality is essential

APPLICANTS MUST BE LIVING IN OR AROUND THE BARCELONA AREA