Data Platform Engineer
Indexed description
As a Data Platform Engineer, you'd be able to work on and solve some of the many interesting challenges we are facing, learn new ways of working, and build delightful high-quality products for our customers.
Data Platform engineer is responsible for designing and implementing data platform by creating / provisioning Cloud Infrastructure (e.g., AWS), which will help our business make sense of the massive amounts of information available. This is a job that requires you to have a blend of business acumen and technical skills, especially on data platform on Cloud.
Key Responsibilities
- Design and build generic Data Platform with robust and sustainable solution, which gives data analyst team and domain team a unified foundation to process data further
- Organise, build and maintain data stores of structured and unstructured data (e.g., text, customer transactional data, workflow/ticket/log data) on a Cloud environment, e.g. AWS
- Build data pipelines to enable scalable processing of large volumes of data
- Work with stakeholders to identify and solve business needs related to advanced data processing
- Display exemplary conduct and live by the Group’s Values and Code of Conduct.
- Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct.
- Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.
- AWS
- Platform engineering skills
- Python
- SQL skills
- Bachelor’s Degree in Statistics, Mathematics, Computer Science
- At least 3-5 years of experience as a Data Platform Engineer, preferably in the financial services industry.
- Has strong hands-on experience with AWS, including S3, IAM, and Athena; or any other equivalent public Cloud services / products
- Platform engineering skills of provisioning Cloud resource is required
- Strong knowledge and experience in building and maintaining scalable data pipelines
- Strong experience with Python, Pandas, PySpark, in Airflow and building ETL workflows.
- Strong SQL skills and experience with relational and non-relational databases.
- Solid Knowledge and experience of using Terraform (Infrastructure as Code) is a plus
- Knowledge and hands-on experience of managing messaging tools, e.g. Kafka would be a bonus
- Experience with running containerised workloads on Kubernetes
- Worked in an Agile environment with continuous delivery
- Knowledge of data modelling, data warehousing, and BI concepts.
- Excellent problem-solving and communication skills.
- Ability to work effectively in a team-oriented environment and collaborate with cross-functional teams.
- Good working knowledge of Git and CI/CD pipelines
- Thorough knowledge of data security, privacy and compliance regulations
- Language: English
Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you'll see how we value difference and advocate inclusion.
Together We
- Do the right thing and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do
- Never settle, continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well
- Are better together, we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term
- Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations.
- Time-off including annual leave, parental/maternity (20 weeks), sabbatical (12 months maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum.
- Flexible working options based around home and office locations, with flexible working patterns.
- Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits
- A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning.
- Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search