Consultant Specialist
Indexed description
We are currently seeking an experienced professional to join our team in the role of Consultant Specialist.
Business: CTO Data technology
Principal Responsibilities
Design and Build Data Processing Systems:
- Collaborate with cross-functional teams to understand data requirements and design efficient data pipelines.
- Implement data ingestion, transformation, and enrichment processes using GCP services (such as BigQuery, Dataflow, and Pub/Sub).
- Ensure scalability, reliability, and performance of data processing workflows.
- Collect and ingest data from various sources (both batch and real-time) into GCP.
- Cleanse, validate, and transform raw data to ensure its quality and consistency.
- Optimize data processing for speed and efficiency.
- Choose appropriate storage solutions (e.g., Bigtable, Cloud Storage) based on data characteristics and access patterns.
- Create and manage data warehouses, databases, and data lakes.
- Define data retention policies and archival strategies.
- Prepare data for downstream analytics, reporting, and machine learning.
- Collaborate with data scientists and analysts to understand their requirements.
- Ensure data is accessible, well-organized, and properly documented.
- Automate data workflows using tools like Apache Airflow or Cloud Composer.
- Monitor data pipelines, troubleshoot issues, and proactively address bottlenecks.
- Implement alerting mechanisms for data anomalies.
- Apply security best practices to protect sensitive data.
- Ensure compliance with industry regulations (e.g., GDPR, HIPAA) and internal policies.
- Collaborate with security teams to address vulnerabilities.
- Document data pipelines, architecture, and processes.
- Share knowledge with team members through documentation, training sessions, and workshops.
- Bachelor’s degree in Computer Science, Information Systems, or a related field.
- Minimum of 5 years of industry experience, cloud experience is a plus.
- Familiarity with GCP services (BigQuery, Dataflow, Pub/Sub, etc.) and related technologies.
- Experience with data modeling, ETL processes, and data warehousing, SQL
- Previous work in highly regulated or complex organizations is a plus
- Speak English fluently
- Proficiency in Python & Bash for data manipulation and scripting.
- Proficiency in SQL for querying and manipulating data.
- Knowledge of Terraform for infrastructure as code (IaC).
- Familiarity with Jenkins for continuous integration and deployment.
- Knowledge of Cloud platform, GCP is a plus
- Strong problem-solving skills and attention to detail.
Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.
***Issued By HSBC Software Development (GuangDong) Limited***
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search