Hiring.Camp

Sr Databricks Engineer

HiNext

·

Yesterday

Location
(DEAI DS) US Dallas TX, United States of America
Workplace
Onsite
Type
Full-time
Department
Engineering
Source
Workday

Description

Function

IoT

Our Company

We’re Hitachi Digital Services, a global digital solutions and transformation business with a bold vision of our world’s potential. We’re people-centric and here to power good. Every day, we future-proof urban spaces, conserve natural resources, protect rainforests, and save lives. This is a world where innovation, technology, and deep expertise come together to take our company and customers from what’s now to what’s next. We make it happen through the power of acceleration.

Imagine the sheer breadth of talent it takes to bring a better tomorrow closer to today. We don’t expect you to ‘fit’ every requirement – your life experience, character, perspective, and passion for achieving great things in the world are equally as important to us.

Job description

Role Summary 
We are looking for a highly skilled Databricks Solution Architect to lead the design and implementation of scalable, enterprise-grade data platforms using Databricks. The ideal candidate will combine strong technical expertise in data engineering and cloud platforms (AWS/Azure/GCP) with architectural leadership, solution design capability, and strong stakeholder engagement skills. 

Key Responsibilities 

1. Solution Architecture & Design 
Design end-to-end data architectures using Databricks Lakehouse Platform. 
Architect scalable ETL/ELT pipelines, real-time streaming solutions, and advanced analytics platforms. 
Define data models, storage strategies, and integration patterns aligned with business and enterprise architecture standards. 
Provide guidance on cluster configuration, performance optimization, cost management, and workspace governance. 

2. Technical Leadership 
Lead technical discussions and design workshops with engineering teams and business stakeholders. 
Provide best practices, frameworks, and reusable component designs for consistent delivery. 
Perform code reviews and provide technical mentoring to data engineers and developers. 

3. Stakeholder & Project Engagement 
Collaborate with product owners, business leaders, and analytics teams to translate business requirements into scalable technical solutions. 
Create and present solution proposals, architectural diagrams, and implementation strategies. 
Support pre-sales or discovery phases with technical input when needed. 

4. Data Governance, Security & Compliance 
Define and implement governance standards across Databricks workspaces (data lineage, cataloging, access control, etc.). 
Ensure compliance with regulatory and organizational security frameworks. 
Implement best practices for monitoring, auditing, and data quality management. 

5. Continuous Improvement & Innovation 
Stay updated on Databricks features, roadmap, and industry trends. 
Recommend improvements, optimizations, and modernization opportunities across the data ecosystem. 
Evaluate integration of complementary technologies (Delta Live Tables, MLflow, Unity Catalog, streaming frameworks, etc.). 

Required Skills & Experience 
Technical Skills 
Databricks Expertise: Strong hands-on experience with Databricks (clusters, notebooks, Delta Lake, MLflow, Unity Catalog). 
Cloud Platforms: Experience with at least one cloud provider (AWS, Azure, GCP). 
Data Engineering: Strong proficiency in Spark, Python, SQL, and distributed data processing. 
Architecture: Experience designing large-scale data solutions including ingestion, transformation, storage, and analytics. 
Streaming: Experience with streaming technologies (Structured Streaming, Kafka, Kinesis, EventHub). 
DevOps: CI/CD practices for data pipelines (Azure DevOps, GitHub Actions, Jenkins, etc.). 

Soft Skills 
Strong communication skills with the ability to engage both technical and business teams. 
Experience working in Agile environments. 
Ability to simplify complex technical concepts for non-technical audiences. 
Strong analytical, problem-solving, and decision-making abilities. 

Preferred Qualifications 
Databricks Certified Data Engineer Professional / Architect certification. 
AWS/Azure/GCP cloud architect certifications. 
Experience with BI tools (Tableau, Power BI, Looker). 
Experience in machine learning workflows and ML operations. 
Background in large-scale data modernization or cloud migration projects. 

Why Join Us? 
Opportunity to lead high-impact data initiatives using cutting-edge Databricks capabilities. 
Work with a highly skilled team of engineers, architects, and analytics professionals. 
Professional growth opportunities including certifications and advanced architecture training. 
Collaborative environment that values innovation and continuous improvement. 

#LI-MS2

About us

We’re a global, team of innovators. Together, we harness engineering excellence and passion to co-create meaningful solutions to complex challenges. We turn organizations into data-driven leaders that can make a positive impact on their industries and society. If you believe that innovation can bring a better tomorrow closer to today, this is the place for you.

Fostering innovation through diverse perspectives

Hitachi is a global company operating across a wide range of industries and regions. One of the things that sets Hitachi apart is the diversity of our business and people, which drives our innovation and growth.

We are committed to building an inclusive culture based on mutual respect and merit-based systems. We believe that when people feel valued, heard, and safe to express themselves, they do their best work.

How we look after you

We help take care of your today and tomorrow with industry-leading benefits, support, and services that look after your holistic health and wellbeing. We’re also champions of life balance and offer flexible arrangements that work for you (role and location dependent). We’re always looking for new ways of working that bring out our best, which leads to unexpected ideas. So here, you’ll experience a sense of belonging, and discover autonomy, freedom, and ownership as you work alongside talented people you enjoy sharing knowledge with.

We’re proud to say we’re an equal opportunity employer and welcome all applicants for employment without attention to race, colour, religion, sex, sexual orientation, gender identity, national origin, veteran, age, disability status or any other protected characteristic. Should you need reasonable accommodations during the recruitment process, please let us know so that we can do our best to set you up for success.

Skills

PythonAWSAzureGCPJenkinsCI/CDSQLMachine LearningSparkDatabricksData EngineeringETLGitHubTableauPower BILookerAgileDevOpsCompliance

Similar Jobs

30

Senior Databricks Engineer

EXL Talent Acquisition Team · Chennai, Tamil Nadu, India · Hybrid

3 weeks ago

Senior Databricks Engineer

EXL · Chennai, Tamil Nadu, India · Hybrid

3 weeks ago

Senior Databricks Engineer

Koniag Government Services · Remote

1 month ago

Senior Databricks Developer

EXL Talent Acquisition Team · Gurugram, Haryana, India · Hybrid

1 month ago

Senior Databricks Developer

EXL · Gurugram, Haryana, India · Hybrid

1 month ago

Senior Databricks Engineer

Bounteous · United States · Remote

2 months ago

Senior Databricks Engineer

EXL Talent Acquisition Team · United States, US · Remote

2 months ago

Senior Databricks Engineer

EXL · United States, US · Remote

2 months ago

Senior Databricks Engineer

Rabobank · Utrecht Croeselaan 18, Netherlands · Hybrid

2 months ago

Databricks Engineer Sr

Sequoiaconnect · Remote

1+ year ago

[JOb - 31147] Senior Data Developer (Azure e Databricks), Brazil

Ciandt · Brazil · Remote

Today

Senior Data Engineer (GCP • Python • Iceberg • Delta Lake • Kafka • Snowflake • Databricks)

Railroad19 · U.S. Remote · Remote

Today

Senior / Lead Data Engineer - Azure Databricks

Blend · Hyderabad, TS, India

Yesterday

Senior Engineer - FullStack (Java/React) & Databricks

Ilabs · Battaramulla · Remote, Hybrid

Yesterday

ETS Senior Engineer - Azure Databricks & Data Platform Engineer

Navy Federal Financial Group · Vienna, VA, United States, US · Hybrid

2 days ago

DE&A - Sr. Data Engineer - Databricks

Zensar Technologies · Pune, Maharashtra, India

2 days ago

Data Engineer / Databricks Engineer-Senior

Nationwide IT Services · Joint Base Andrews, MD · Remote, Hybrid

2 days ago

Databricks Data Engineer Senior Analyst

Accenture · Brisbane, 10 Eagle Street, Australia +2

3 days ago

Databricks Engineer - Senior/ Lead

Blend · Hyderabad, TS, India · Remote

4 days ago

Senior Databricks Data Engineer

EXL Talent Acquisition Team · India · Hybrid

4 days ago

Senior Databricks Data Engineer

EXL · India · Hybrid

4 days ago

Senior Data Engineer (DBT and Databricks/Snowflake)

NCS Australia · Melbourne, VIC, Australia

4 days ago

Senior Data Engineer (Databricks)

Anova · Porto, Porto, Portugal

4 days ago

Senior Data Engineer - Azure Databricks

Encora · Bolivia; Colombia; Costa Rica; Peru · Remote, Hybrid

6 days ago

Data Engineer Senior - Databricks

Muttdata · Argentina · Remote

1 week ago

Senior Data Engineer (Azure Databricks + PySpark + ADF + Unity Catalog)

Referral Publicisgroupe · San Jose, CR

1 week ago

Sr Lead Software Engineer - IBM Planning Analytics/TM1 Solutions & Databricks

JPMorgan Chase · Mumbai, Maharashtra, India

1 week ago

Sr Lead Software Engineer - IBM Planning Analytics/TM1 Solutions & Databricks

JP Morgan Chase · Mumbai, Maharashtra, India

1 week ago

Sr. Staff Platform/Data Reliability Engineer, Databricks (R5537)

Shieldai · Remote · Remote

1 week ago

Senior Software Test Engineer (python, pyspark, SQL, databricks, playwright/ selenium)

NielsenIQ · Chennai, TN, India

1 week ago