Data Solution Engineer
ARETUM
·- Location
- McLean, Virginia, United States · published
- Type
- Full-time
- Department
- Engineering
- Source
- Workable
Description
DHS Suitability Required
About Aretum
Aretum is a mission-driven organization committed to delivering innovative, technology-enabled solutions to our customers across defense, civilian, and homeland security sectors. Our teams work at the intersection of strategy, technology, and transformation, helping agencies solve their most critical challenges. We believe in investing in our people and creating a culture where collaboration, inclusion, and professional growth are at the forefront.
Job Summary
Aretum is seeking a Data Solution Engineer that will provide delivery capacity to implement pilots and proof-of-concept solutions. The individual will also execute pipeline development, tagging, policy application, and testing across medallion layers.
Due to the nature of our work as a federal consulting organization, employees may be expected to handle Controlled Unclassified Information (CUI) and must adhere to applicable safeguarding and compliance requirements.
Responsibilities
- Develop, test and implement data pipelines in Databricks using SQL, Python, and Apache Spark to support pilot initiatives, proof-of-concept solutions, and production data workflows.
- Build and maintain data pipelines across bronze, silver, and gold layers of the medallion architecture, following established architecture, transformation, and governance standards.
- Implement data governance tagging, metadata standards, and classification roles in Unity Catalog in accordance with established designs and requirements.
- Apply established data protection policies including column masking, access controls and reference data lookups, to ensure data is handled appropriately throughout pipeline processing.
- Define and maintain pipeline and workflow configurations using YAML and other configurations as code practices to support consistent, repeatable, and maintainable deployments.
- Execute data quality testing and validation procedures to verify data accuracy, completeness, consistency, and compliance with established data contracts and business rules