Senior Data Platform Engineer

Position Summary:

We are looking for a talented Senior Data Platform Engineer to join our Data Engineering team, to participate in the development and maintenance of data pipelines for blockchain data processing. This is a remote role, and we are flexible with considering applications from anywhere in Europe.

More details: crystalblockchain.com

Duties and responsibilities:

• Active participation in development and maintenance of our data pipelines and backend services;

• Integration of blockchains, Automated Market Maker (AMM) protocols, and bridges within Crystal's platform;

• Integrate new technologies into our processes and tools;

• End-to-end feature designing and implementation;

• Code, debug, test and deliver features and improvements in a continuous manner;

• Provide code review, assistance, and feedback for other team members.

Required:

• 8+ years of experience in software engineering, developing backend services/APIs or data pipelines;

• Strong knowledge and experience with Python;

• Advanced knowledge of SQL - ability to write, understand and debug complex queries;

• Strong database architecture principles;

• Strong experience with data lakes, data warehouses, relational and analytical databases;

• POSIX/Unix/Linux ecosystem knowledge;

• Blockchain tech knowledge or willingness to learn;

• Experienced in Unit Testing principles;

• Experience with Docker containers and proven ability to migrate existing services;

• Independent and autonomous way of working;

• Team-oriented work and good communication skills are an asset.

Would be a plus:

• Practical experience in big data and frameworks – Kafka, Spark, Dask, Flink and Data Lakes;

• Experience with Kubernetes and Infrastructure as Code – Terraform and Ansible;

• Experience with API frameworks such as Flask or FastAPI;

• Experience with distributed systems;

• Experience with opensource solutions;

• Experience with Java or willingness to learn.

Originally posted on Himalayas