Python Developer
Indexed description
Responsibilities
- Implement data transformations and analytics using Python and PySpark.
- Design, develop, and optimize scalable data pipelines and ETL processes using Azure Data Services and Databricks.
- Configure and manage Databricks Unity Catalog for secure data governance and access control.
- Orchestrate workflows using Apache Airflow for scheduling and automation.
- Collaborate with cross-functional teams to deliver high-quality data solutions in an Agile environment.
- Set up and maintain CI/CD pipelines for data workflows and deployments.
- Manage version control and branching strategies using Git.
- Write and execute unit tests to ensure code quality and reliability.
- Monitor, troubleshoot, and optimize data processes for performance and cost efficiency.
- Programming: Proficiency in Python and PySpark for data engineering tasks.
- Python - good understanding of basics (like OOP, functions, imports, exceptions, file handling). Pandas library knowledge
- Azure Knowledge: Strong experience with Azure Data Factory, Azure Data Lake, Azure Synapse, or related services.
- Databricks: Hands-on experience in building and managing workflows in Databricks, including Unity Catalog.
- Orchestration: Experience with Apache Airflow for workflow scheduling and automation.
- CI/CD: Familiarity with tools like Azure DevOps or Jenkins for automated deployments.
- Version Control: Expertise in Git for code management.
- Testing: Strong understanding of unit testing frameworks for data pipelines.
- Agile Methodology: Experience working in Agile teams and using tools like Jira or Azure Boards.
- Tools/Frameworks
- Java, Spark, Hive, Hadoop, Bash
- Job scheduler (Ctrl-M)
- High analytical skills
- A high degree of initiative and flexibility
- High customer orientation
- High quality awareness
- Excellent verbal and written communication skills
With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer clients, in 59 countries, as they navigate their digital transformation powered by cloud and AI. We enable them with an AI-first core, empower the business with agile digital at scale and drive continuous improvement with always-on learning through the transfer of digital skills, expertise, and ideas from our innovation ecosystem. We are deeply committed to being a well-governed, environmentally sustainable organization where diverse talent thrives in an inclusive workplace.
All aspects of employment at Infosys are based on merit, competence and performance. We are committed to embracing diversity and creating an inclusive environment for all employees. Infosys is proud to be an equal opportunity employer.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search