Mid Data Engineer
Indexed description
Ignite the Future of Data Engineering — Shape Innovative Cloud and Big Data Solutions
Porto-based opportunity with remote work model (up to 3 days/week).
As a Mid Data Engineer – Big Data & Cloud Technologies, you will be working for our client, a leading player in the industry dedicated to transforming data into impactful insights. Your role will focus on developing scalable data pipelines, optimizing performance, and supporting enterprise-level Big Data solutions within a collaborative, international environment. This is a unique chance to contribute to cutting-edge projects that redefine data architecture and drive digital transformation.
Your main responsibilities:
- Develop and maintain Datalake pipelines using Python and PySpark to support large-scale data processing.
- Analyze requirements and propose robust architecture solutions within the Datalake framework.
- Gather, document, and manage application requirements in an Agile environment.
- Implement complex use cases, enhancing efficiency and promoting automation.
- Support and maintain existing data processes, troubleshooting issues as needed.
- Collaborate closely with business users, analysts, data engineers, and developers to deliver data-driven insights.
You're ideal for this role if you have:
- 3+ years of experience in Big Data and NoSQL technologies (Hadoop, HDFS, Hive, Kerberos, Starburst).
- Strong proficiency with Python and PySpark; Spark experience is a plus.
- Knowledge of Data Modeling principles and SQL.
- Experience with Visual Studio Code or similar development frameworks.
- Understanding of DevOps concepts, source code management (Git), build tools (Jenkins), and deployment tools (XL Deploy, XL Release).
- Fluent English communication skills (minimum B2 level).
It is a strong plus if you have: (optional)
- Performance optimization skills (Shell scripting, execution plans).
- Knowledge of PowerBI, PowerApps, and PowerAutomate.
- Certifications such as Microsoft PL series (PL-100, PL-200, etc.).
- Experience with SharePoint Online, REST APIs, SSAS, SSIS, or Azure.
- French language skills are highly valued.
Eligibility for the role:
Only candidates with an existing legal right to work in Europe will be considered for this position.
#MAKEYourCareerBETTER
Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search