Big Data

We are looking for a consultant to work in a transversal team composed of Data Engineers, BI Developers, Data Analysts, Business Analysts and Software Developers, in close cooperation with multiple stakeholders and teams in Porto and Paris, creating Data solutions for Technology & Operation within Corporate Function IT. The team is based at the Porto office.

Responsibilities:

• Work together with teams in Porto and Paris with openness and confidence to improve knowledge, practice, framework and ecosystem.
• Contribute to local initiatives and projects from assessment, use case identification, data preparation, implementation and industrialization.
• Think critically about existing processes and suggest new ideas and improvements, especially in the performance field.
• Develop Datalake pipelines using Python and PySpark.
• Analyze requirements and propose architecture solutions within the Datalake.
• Gather, document, examine and manage application requirements in an Agile environment.
• Implement from basic to complex use cases, bringing efficiency and promoting automation.
• Maintain existing processes and support other users’ technical needs.
• Work closely with business users, Business Analysts, Data Engineers and Developers to deliver data-driven solutions.

Requirements:

• At least 4 years of experience in Big Data and NoSQL technology, including Hadoop, HDFS, Hive, Kerberos and Starburst, at professional level.
• Experience with Visual Studio Code or similar frameworks.
• Experience with Python/PySpark, Spark is a plus.
• Knowledge of Data Modeling principles and SQL.
• Familiarity with DevOps concepts.
• Experience with source code management using Git.
• Experience with Jenkins, XL Deploy and XL Release.
• English B2

Nice to have:

• Optimization and performance improvement experience will be a plus (Shell Script; Execution plan) Knowledge in PowerBI, PowerApps and PowerAutomate;
• Microsoft Certifications: PL-100, PL-200, PL-300, PL-400, PL-500, PL-600, PL-700, PL-900 or DP-X00 Administration of SharePoint Online and Dataverse Environments;
• Experience with Rest API’s;
• SSAS, SSIS and Azure;
• French is highly valued.