Hiring.Camp

Senior / Staff Data Engineer

Burq

·

3 days ago

Location
Lahore, Punjab, Pakistan
Workplace
Onsite
Department
Engineering
Seniority
Senior
Source
Workable

Description

Role overview

Own the engineering foundation that turns complex enterprise, operational and platform data into reliable, secure, discoverable assets for analytics, machine learning and Burq Intelligence. Build production-grade ingestion and transformation systems, establish trusted identities across entities, and enable data products that scale across customers and delivery providers.

Key responsibilities

Enterprise ingestion and interoperability

  • Design resilient ingestion from enterprise customers and strategic partners using APIs, webhooks, SFTP/file drops, CDC and scheduled exports as appropriate.
  • Integrate OMS, WMS, TMS and FMS sources; normalize heterogeneous order, shipment, location, driver and provider records into documented contracts.
  • Define schema evolution, idempotency, backfills, reconciliation, late-arriving data, retries, dead-letter handling and auditability.
  • Build Snowflake ingestion and transformation patterns with clear SLAs and secure customer-specific isolation.

Data architecture, quality and identity

  • Build and optimize batch and near-real-time pipelines using SQL, Python and suitable orchestration/stream-processing frameworks.
  • Design canonical models and stable entity resolution across merchants, customers, orders, deliveries, drivers and providers; document confidence and exception handling.
  • Implement automated tests for completeness, accuracy, uniqueness, timeliness, referential integrity and contract compatibility.
  • Maintain data lineage, catalogs, ownership, observability, incident alerts and cost/performance telemetry.
  • Develop reusable dimensional, event-driven and data-product patterns for BI, enterprise reporting and operational intelligence.

ML and agent-ready data

  • Partner with ML engineering to produce reproducible, versioned training, validation and evaluation datasets with provenance and leakage controls.
  • Support feature pipelines, offline/online consistency, drift detection and retraining triggers; integrate quality gates into model/agent release workflows.
  • Expose trustworthy, permission-aware datasets and interfaces for AI agents, with freshness indicators, access logs and safe failure behavior.

Security, governance and operations

  • Implement least-privilege access, tenant separation, encryption practices, secrets management, PII minimization and retention/deletion enforcement in pipelines.
  • Create CI/CD, infrastructure-as-code where appropriate, automated deployment and rollback, operational runbooks and disaster recovery procedures.
  • Own SLOs, incident response, root-cause analysis, capacity planning, query optimization and warehouse spend efficiency for assigned data services.
  • Work with Security and Product to translate enterprise security requirements and customer contracts into verifiable technical controls.

Required qualifications

  • 5+ years of relevant data engineering/software engineering experience for Senior; typically 8+ years with demonstrable cross-team technical leadership for Staff (scope matters more than tenure).
  • Advanced SQL: window functions, query plans, indexing/clustering concepts, performance tuning, data modeling and analytical transformations.
  • Production Python: modular services, typing, testing, packaging, API integrations, logging, error handling and maintainability.
  • Hands-on experience building and operating cloud data pipelines and warehouses at meaningful scale, preferably Snowflake or a comparable platform.
  • Practical orchestration and transformation experience (e.g., Airflow, Dagster, dbt or equivalents) and experience with CI/CD and automated data testing.
  • Strong understanding of distributed data reliability: retries, idempotency, event time, schema changes, backfills and reconciliation.
  • Experience implementing access controls, PII protection and multi-tenant data boundaries.
  • Clear written technical communication, architecture documentation and cross-functional collaboration with product, analytics, platform and ML teams.

Preferred technical experience

  • Snowflake: Snowpipe, Streams/Tasks, dynamic tables, RBAC, resource monitors, clustering and query profiling.
  • Streaming/event systems such as Kafka, Kinesis, Pub/Sub or equivalent; CDC and event-driven architecture.
  • Cloud services on AWS, GCP or Azure; Terraform and containerized deployment.
  • Data observability/catalog tools (e.g., Monte Carlo, Great Expectations, OpenLineage, DataHub) or equivalent practices.
  • Feature stores, MLflow or comparable model/data versioning and evaluation workflows.
  • Enterprise logistics integrations (OMS/WMS/TMS/FMS), EDI, SFTP and API contract governance.
  • Security and compliance delivery in SOC 2 / ISO 27001 environments; privacy and deletion workflows.

Senior vs Staff expectations

  • Senior: independently delivers critical pipelines, owns operational quality, mentors peers and improves standards within a domain.
  • Staff: defines cross-domain architecture and data contracts, resolves complex tradeoffs, drives standards across teams, mentors senior engineers and influences multi-quarter technical strategy without direct people management.

What success looks like in your first year

  • Enterprise onboarding: agreed enterprise data integration milestones delivered with documented reconciliation and acceptance criteria.
  • Reliability: measurable freshness and availability SLOs; faster incident detection and recovery with owned runbooks.
  • Trust: automated quality coverage and documented lineage on critical datasets, so teams can rely on the data with confidence.
  • ML readiness: reproducible versioned datasets and quality gates adopted by model/agent teams.
  • Efficiency: transparent pipeline cost and resource usage with demonstrated optimization against baseline.
  • Governance: validated tenant access controls, retention/deletion workflows and auditable data access.

Who you’ll work with

Key partners: Data & BI, ML Engineering, Platform Engineering, Security, Enterprise Product and customer integration teams. You own the architecture, implementation and operational quality of the data systems you build, and partner with Product on priorities and with ML Engineering on model needs.

Skills

PythonAWSAzureGCPTerraformCI/CDSQLMachine LearningAirflowSnowflakeData EngineeringSOCComplianceWMSSOC 2ISO 27001dbtApache Kafka

Similar Jobs

30

Senior Staff Software Engineer, Backend - AI Native (Evergreen)

BILL | BILL·US·Remote

Senior Staff Accountant

Associated Energy Group·Miami, Florida·Onsite

Today

Staff/ Sr. Staff Product Engineer

Lightmatter·Toronto, Ontario·Hybrid

Today

Staff/ Sr. Staff Product Engineer

Lightmatter·Mountain View, California·Hybrid

Today

Sr Staff Technical Program Manager

Lightmatter·Mountain View, California·Hybrid

Today

Senior Staff Hydropower Engineer

Schnabel Engineering·Harrisburg, Pennsylvania

Today

Sr Staff Technology GRC Analyst

Thetradedesk·Los Angeles, California +1

Today

Senior Staff Technical Program Manager

COMPASS, Inc.·Bellevue, Washington +3

Senior Staff Research Scientist Google Research

Accounts

Senior Staff Editor, Opinion

The New York Times·New York City, New York·Onsite

Today

Senior Staff Engineer (MarTech Product Manager)

Nagarro·Hyderabad, Telangana·Onsite

Today

Senior/Staff Network Security Engineer

Groq·Dallas-Fort Worth Area +2·Onsite

Today

Senior Staff Engineer - Tunnels

Schnabel Engineering·Honolulu, Hawaii·Onsite

Today

Sr. Staff Product Designer, AI Control Tower

ServiceNow·Kirkland, Washington·Hybrid

Today

Staff/Sr. Staff Design Verification Engineer

Lightmatter·Toronto, Ontario·Hybrid

Today

Staff/Sr. Staff Design Verification Engineer

Lightmatter·Mountain View, California·Hybrid

Today

Staff/Sr. Staff Design Verification Engineer

Lightmatter·Boston, Massachusetts·Hybrid

Today

Senior Staff Software Engineer

ServiceNow·Santa Clara, California·Onsite

Today

Senior Staff Engineer, Chemical Engineering

Redwood Materials·Carson City, Nevada·Onsite

Today

Senior Staff Engineer (JD Edwards EnterpriseOne CNC Administrator)

Nagarro·Hyderabad, Telangana·Onsite

Today

Senior Staff Accountant

Weaver·Fort Worth, Texas

Today

Senior Staff Site Reliability Engineer

SecurityScorecard·Remote·Remote

Today

Senior Staff Software Engineer Mlquality Search

Google

Senior Staff Software Engineer Agent Registry

Google

Senior Staff Engineer Thermal Simulation (f/m/div)

Infineon·Munich, Bavaria

Today

Senior Staff Engineer (Infor M3 Technical Developer)

Nagarro·Mumbai, Maharashtra·Remote

1d ago

Senior Staff Software Engineer

FanDuel·Edinburgh, Scotland

Member of Technical Staff - Senior DevOps Engineer

Pure Storage·Mumbai, Maharashtra·Hybrid

1d ago

Sr. Staff Software Engineer, Systems Infrastructure

LinkedIn·Bengaluru, Karnataka·Hybrid

1d ago

Senior/Staff - Facilities Management

Robert Bosch·Petaling Jaya, Selangor·Hybrid

1d ago