Data Engineer | Databricks Experience

Who We Are:

At Avnet, relationships matter. We are a global, FORTUNE ® 500 technology distributor and solutions company that delivers design, supply chain and logistics expertise to customers at every stage of a product’s lifecycle. Our employees have a front row seat to the latest innovations shaping the world we live in and the future we share. We’re driven to help our customers around the world succeed and we do so by earning the trust of some of the biggest names in technology.

Working at Avnet means being a part of a global team. We work collaboratively and with integrity, doing business the right way. For more than a century, we have partnered together to help our customers, suppliers and teammates realize the transformative possibilities of technology. Experience what’s next at Avnet!

Job Summary:

Develops, maintains, and enhances business applications. Collaborates with stakeholders to validate user requirements, assess available technologies, and recommend solution options. Assesses objectives for assigned project phases and recommends technical strategies and tactics to achieve business needs.

Principal Responsibilities:

• Uses process design technology methodologies, programming languages and tools and solutions design techniques to develop applications to meet business specifications.
• Validates functional specifications, builds technical specifications and develops application documentation.
• Performs analysis, design, development and testing of applications to solve business requirements.
• Integrates new or enhanced application components.
• Develops conversion and system implementation plans.
• Supports change readiness initiatives as needed.
• Other duties as assigned.

Job Specifications:

• Design, build, and maintain data pipelines in Databricks using PySpark, SQL, and Delta Lake 
• Develop reusable data transformations following medallion architecture patterns (bronze/silver/gold) 
• Validate data accuracy, completeness, and consistency across datasets and pipeline stages 
• Optimize jobs for performance, scalability, and cost efficiency 
• Collaborate with business analysts and business stakeholders to translate requirements into data models and datasets for analytics 
• Troubleshoot and resolve data pipeline issues, including root-cause analysis in production environments 
• Document data pipelines, data lineage, and transformation logic 
• Apply best practices for version control (GitHub), testing, and deployment 
• Identify and implement improvements to data quality, pipeline reliability, and overall architecture 

Work Experience:

• Typically 3+ years with bachelor's or equivalent.

Education and Certification(s):

• Bachelor's degree or equivalent experience from which comparable knowledge and job skills can be obtained.

Distinguishing Characteristics:

• Experience with transitioning Alteryx workflows to Databricks 
• Experience with PowerBI Visualizations

#LI-AMER

What We Offer:

Our employees work hard to live our values and help us grow. Our total rewards strategy supports Avnet’s ability to attract, engage, develop, and reward our employees, while promoting a diverse and inclusive environment. We offer competitive compensation and benefit programs — from time away and flexible working arrangements to programs supporting employee well-being and opportunities to give back to your community.

• Generous Paid Time Off

• Savings Fund

• Paid Holidays

• Medical, Dental, Vision and Life Insurance

• Education Assistance

• Employee Development Resources

• Employee Wellness, Leadership Development, and Mentorship Programs

• Year-End Bonus

• Food Coupons

Benefits listed above may vary depending on the nature of your employment with Avnet.

The above statements are intended to describe the general nature and level of work being performed. They are not intended to be construed as an exhaustive list of all responsibilities, duties, and skills.

Avnet is an Equal Opportunity Employer committed to providing equal opportunities to all employees and applicants for employment without regard to race, color, religion, ancestry, national origin, sex (including pregnancy), age, marital status, sexual orientation, gender identity or expression, disability, veteran status, genetic information or any other characteristic protected by law. This policy of non-discrimination also applies to religious dress and grooming practices. Avnet will accommodate employee religious dress standards and grooming practices that do not result in undue hardship for the Company.  If you are interested in applying for employment with Avnet and need special assistance or an accommodation to apply for a posted position contact our Human Resources Service Center at (888) 994-7669.