- Location
- Short Hills, NJ
- Workplace
- Hybrid
- Type
- Full-time
- Department
- IT
- Seniority
- Senior
Description
Job Title: Senior Data Engineer
Location: Short Hills, NJ (2 days Hybrid)
Duration: 6 months CTH
Job Description:
- Senior Data Engineer, building ETL pipelines daily in
Azure and Databricks environment, working with SQL and Python
- Databricks
- Unity Catalogue
- They can write Python code for
pipelines within Databricks
- Spark Declarative pipelines -
need to know how to write these
- How to ingest data within
Databricks
- Data eng skillset - 3 main
things he is looking for
- Building pipelines, designing
projects and implementing them, hands-on
- Good understanding of the
data; if he gives you a data set, can they look at it and tell what story
it's telling
- Ability to learn and pick up
things quickly, basic analytical skills
Skills
PythonAzureSQLSparkDatabricksETL