Back to search
DNS Info Ltd Linkedin · Posted 8d ago

Data Engineer

Ireland

Linkedin
Continue to application Add your email once, then Caio opens the original posting.

Indexed description

Role Purpose:

Build scalable data pipelines and ensure curated, high-quality cyber data is available for analytics.


Must have worked in the Insurance domain or with top Tier 1 companies.


Key Responsibilities


  • Build ingestion pipelines (logs, network data, security tools)
  • Develop ETL/ELT pipelines using Databricks & Spark
  • Implement Delta Lake (Bronze–Silver–Gold layers)
  • Optimise performance and cost (partitioning, caching)
  • Ensure data quality, lineage, and reliability


Required Skills

  • Strong PySpark / Spark SQL
  • Databricks ecosystem (Delta Lake, Jobs, Workflows)
  • Experience with streaming (Kafka / Event Hub)
  • Cloud expertise (AWS preferred – S3, IAM, Glue)


Key Deliverables

  • Data ingestion pipelines
  • Curated cyber datasets
  • Optimised lakehouse architecture
Free. 20 seconds. No password. See every match in this search.

Create a free Caio profile to unlock more results and save your role and location preferences.

Unlock free search
Want help applying to roles like this? Search Caio for free. If CV tailoring and application tracking get heavy, Full Caio Agent adds a human specialist.
View Full Agent