Senior Data Platform Engineer (Python & Databricks)
Indexed description
This is a remote position from Latam.
You will help build and evolve a financial data platform developed on top of Databricks and used by major enterprise clients. The platform supports the ingestion, transformation, modeling, and delivery of complex financial data.
This is primarily a backend and data-platform position. You will work across Python services, APIs, data pipelines, and data models while collaborating closely with an established engineering team in Edinburgh.
The ideal candidate has substantial hands-on Databricks experience and can become productive in a complex data environment. You should be comfortable taking ownership of well-defined areas of work while gradually building a broader understanding of the platform.
We process our payment in US dollars, however you can receive it in your local currency.
What You’ll Do
Data Platform Development
- Build and maintain components of a large-scale financial data platform.
- Develop reliable data pipelines for ingesting, transforming, and delivering financial data.
- Design data models that support enterprise reporting, analytics, and downstream integrations.
- Improve the performance, reliability, maintainability, and observability of existing data workflows.
- Troubleshoot complex issues across data-processing and application layers.
- Design, build, and maintain production-grade applications and services using Python.
- Develop well-structured APIs for accessing and managing data-platform capabilities.
- Write clean, testable, maintainable, and well-documented code.
- Participate in architectural and technical-design discussions.
- Review code and help maintain a high engineering standard across the team.
- Build and operate production workloads using Databricks.
- Help improve the organization and execution of Databricks-based data workflows.
- Work with large datasets and complex transformation requirements.
- Apply Databricks best practices to improve scalability, reliability, and developer productivity.
- Work directly with engineers and technical leaders from both Codelitt and our partner.
- Collaborate with a hybrid engineering team based in Edinburgh.
- Break complex requirements into clear and manageable technical tasks.
- Communicate progress, risks, dependencies, and blockers proactively.
- Take ownership of assigned initiatives from technical discovery through delivery.
- Contribute to documentation and internal knowledge sharing.
- Five or more years of professional software-engineering experience.
- Strong professional experience developing production applications with Python.
- Hands-on experience building production workloads with Databricks.
- Experience designing and maintaining data pipelines.
- Strong understanding of data modeling and data-processing concepts.
- Experience designing or consuming APIs in distributed systems.
- Experience working with relational databases and SQL.
- Strong automated-testing and software-quality practices.
- Experience working with version control, code review, and CI/CD workflows.
- Ability to understand and contribute to an established, complex codebase.
- Strong written and verbal English communication skills.
- Ability to work independently while collaborating closely with a broader engineering team.
- Ability to attend the Edinburgh office regularly, typically one to two days per week.
- Experience building data platforms for financial-services or other data-intensive industries.
- Experience with cloud-based data architectures.
- Familiarity with infrastructure-as-code tools such as Terraform.
- Experience improving the observability and operational reliability of data pipelines.
- Familiarity with modern data governance, access-control, and data-quality practices.
- Experience working in an enterprise environment with strict security and compliance requirements.
- Front-end experience with React or another modern JavaScript framework.
Who You Are
- Databricks Experienced
- Python Focused
- Data Oriented
- Proactive
- Comfortable with Complexity
- Collaborative
What We Offer
- Generous paid-time-off policy.
- Paid sick leave.
- Paid parental leave.
- Opportunities to work on challenging products with experienced international teams.
- A collaborative environment that values technical quality and personal ownership.
- Regular team-building activities throughout the year.
Departamento
TI / Informática
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search