Big Data Developer

Skills : Big Data; CI/CD; ETL - Big Data / Data Warehousing; GCP; Python; SQL; Java

JD:

Senior hands-onGCP Data Engineer who can work independently across a variety of GCP Big Data services.Strong experience working with Google Cloud Platform (GCP) data services, including BigQuery and BigtableProficiency in Python programming (Java experience is a plus)Strong hands-on experience with Cloud Composer (Airflow) for workflow orchestrationHands-on experience with Dataproc for large-scale data processingGood to have experience in building messaging and event-driven data pipelines using Pub/SubExperience with CI/CD pipelines (GitHub Actions)Marketing Platforms team within US Consumer and Digital Technology division is responsible for enabling creation, execution and tracking of Marketing Campaigns across all Amex products and channels."Flywheel" initiative aims to modernize our technology stack to improve Marketer"s operational efficiency and bring campaigns to market quicker, creating more dynamic, personalized customer experience.An individual in this role will work on brining marketing data into Unified Marketing Data Layer on our GCP BigData platform to facilitate reporting and analytics of marketing campaign performance.