Data Engineer | Databricks Experience
Indexed description
Working at Avnet means being a part of a global team. We work collaboratively and with integrity, doing business the right way. For more than a century, we have partnered together to help our customers, suppliers and teammates realize the transformative possibilities of technology. Experience what’s next at Avnet!
Job Summary
Develops, maintains, and enhances business applications. Collaborates with stakeholders to validate user requirements, assess available technologies, and recommend solution options. Assesses objectives for assigned project phases and recommends technical strategies and tactics to achieve business needs.
Principal Responsibilities
- Uses process design technology methodologies, programming languages and tools and solutions design techniques to develop applications to meet business specifications.
- Validates functional specifications, builds technical specifications and develops application documentation.
- Performs analysis, design, development and testing of applications to solve business requirements.
- Integrates new or enhanced application components.
- Develops conversion and system implementation plans.
- Supports change readiness initiatives as needed.
- Other duties as assigned.
- Design, build, and maintain data pipelines in Databricks using PySpark, SQL, and Delta Lake
- Develop reusable data transformations following medallion architecture patterns (bronze/silver/gold)
- Validate data accuracy, completeness, and consistency across datasets and pipeline stages
- Optimize jobs for performance, scalability, and cost efficiency
- Collaborate with business analysts and business stakeholders to translate requirements into data models and datasets for analytics
- Troubleshoot and resolve data pipeline issues, including root-cause analysis in production environments
- Document data pipelines, data lineage, and transformation logic
- Apply best practices for version control (GitHub), testing, and deployment
- Identify and implement improvements to data quality, pipeline reliability, and overall architecture
- Typically 3+ years with bachelor's or equivalent.
- Bachelor's degree or equivalent experience from which comparable knowledge and job skills can be obtained.
- Experience with transitioning Alteryx workflows to Databricks
- Experience with PowerBI Visualizations
- Generous Paid Time Off
- Savings Fund
- Paid Holidays
- Medical, Dental, Vision and Life Insurance
- Education Assistance
- Employee Development Resources
- Employee Wellness, Leadership Development, and Mentorship Programs
- Year-End Bonus
- Food Coupons
The above statements are intended to describe the general nature and level of work being performed. They are not intended to be construed as an exhaustive list of all responsibilities, duties, and skills.
Avnet is an Equal Opportunity Employer committed to providing equal opportunities to all employees and applicants for employment without regard to race, color, religion, ancestry, national origin, sex (including pregnancy), age, marital status, sexual orientation, gender identity or expression, disability, veteran status, genetic information or any other characteristic protected by law. This policy of non-discrimination also applies to religious dress and grooming practices. Avnet will accommodate employee religious dress standards and grooming practices that do not result in undue hardship for the Company. If you are interested in applying for employment with Avnet and need special assistance or an accommodation to apply for a posted position contact our Human Resources Service Center at (888) 994-7669.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search