Back to search
Softest Consulting Services Limited Linkedin · Posted 8d ago

Senior Solution Architect - Big Data & Streaming Platforms

Ireland

Linkedin
Continue to application Add your email once, then Caio opens the original posting.

Indexed description

What you are expected to have:

  • 10+ years’ overall IT experience, with significant experience in data platform, integration, or distributed systems delivery.
  • 5+ years’ experience in solution architecture, technical architecture, or lead design roles.
  • Proven experience architecting streaming or real-time data applications using Kafka or equivalent event-streaming technologies.
  • Experience with Kafka consumer architecture, including consumer groups, offsets, retries, dead-letter handling, ordering, partitioning, and scalability.
  • Proven experience designing solutions on Cloudera CDH/CDP, or substantial experience with equivalent enterprise-scale distributed data platforms.
  • Experience designing and delivering large-scale data ingestion, transformation, storage, and consumption patterns.
  • Strong understanding of batch and real-time data processing architectures.
  • Experience working in complex enterprise environments with multiple systems, vendors, platforms, and governance processes.
  • Strong understanding of non-functional requirements including performance, scalability, resilience, security, observability, and operational support.
  • Experience providing architectural leadership across multiple workstreams, programmes or delivery teams.
  • Experience mentoring architects, senior engineers or technical leads and influencing technical decision-making.

Required Technical Skills

  • Distributed data platforms and data lake architecture on Cloudera CDH/CDP or equivalent platforms.
  • Event streaming and real-time integration technologies, including Kafka and related messaging patterns.
  • Large-scale data processing and transformation frameworks such as Spark, Flink, Hive, Impala or equivalent technologies.
  • API and service-based integration architectures using technologies such as Java, Spring Boot, and REST services.
  • NoSQL and distributed data storage technologies including HBase, Cassandra, or equivalent platforms.
  • Cloud-hosted data platforms and services, preferably on AWS.
  • Modern engineering practices including DevOps, CI/CD, observability, resilience, and operational support.

Desirable Experience

  • Financial services or banking experience.
  • Experience with regulated, secure, enterprise-scale data platforms.
  • Experience presenting to architecture governance boards.
  • Experience leading architecture communities, defining standards, or contributing to capability development within an architecture practice.
  • Exposure to enterprise data governance, lineage, metadata, and data quality tooling.
  • Experience with cloud-native data services on AWS.


What you will do:

  • Own the end-to-end solution architecture for large-scale distributed data, streaming, and data integration solutions.
  • Act as the lead architect for Data Solutions distributed data, integration and streaming platforms, providing architectural direction, governance, design assurance and technical leadership across initiatives, while influencing the evolution of the target architecture and ensuring alignment with enterprise technology strategy, engineering standards and long-term platform objectives.
  • Accountable for solution architecture across the Enterprise Data Lake, Operational Datastore and associated data platform services within the Cloudera CDP environment on AWS.
  • Design and document scalable distributed data and streaming solutions across Cloudera, Kafka, API, and cloud platforms, including ingestion, processing, storage, and consumption patterns.
  • Provide architectural oversight across solution delivery, ensuring consistency, quality and alignment with approved designs.
  • Work with engineering teams to ensure solutions are deliverable, scalable, secure, supportable, and aligned to enterprise architecture principles.
  • Review technical designs produced by engineering teams and ensure alignment with the approved solution architecture.
  • Identify technical risks, dependencies, assumptions, non-functional requirements, and design trade-offs.
  • Support delivery planning by helping break solutions into iterative delivery increments and sprint-level outcomes.
  • Represent solution designs at architecture review boards and governance forums, engaging effectively with business stakeholders, delivery teams, and enterprise architects.
  • Develop and promote architectural patterns, engineering standards and best practices across the data platform ecosystem.


You are good to apply if you are:

  • Irish or EU or British Citizen, or holding a Stamp 4 or Stamp 1G permit.
  • Residing in the specified job location currently


Free. 20 seconds. No password. See every match in this search.

Create a free Caio profile to unlock more results and save your role and location preferences.

Unlock free search
Want help applying to roles like this? Search Caio for free. If repetitive applications get heavy, Managed Job Search adds supervised execution for $99/month.
View Managed Job Search