Senior Data Engineer - Hadoop/Spark/OCP/Big Data

PNC Bank Senior Data Engineer - Hadoop/Spark/OCP/Big Data 11 Hours AgoSaved Hybrid Pittsburgh, PA, USA 50K-186K Annually Senior level 50K-186K Annually Senior levelMachine Learning • Payments • Security • Software • Financial ServicesDesign, build, and maintain scalable Spark/SQL data pipelines and ETL/ELT frameworks for batch and real-time processing. Deploy and manage containerized data workloads on Docker/Kubernetes/OpenShift, manage data lakes on object storage (S3/ADLS) using formats like Apache Iceberg, implement CI/CD for data workflows, optimize Spark performance, drive architecture and modernization, ensure governance/compliance, and provide technical leadership and mentorship.Top Skills: AdlsApache IcebergAzure DevopsBitbucketCi/CdDockerEtl/EltGitHadoopJenkinsKubernetesOpenshift (Ocp)S3SparkSQL