Hiring.Camp

Data Platform Engineer – Inventory & Observability

Quberesearchandtechnologies

·

Today

Location
London · London, Greater London, England, United Kingdom
Department
Technology-Data Center
Source
Greenhouse

Description

Qube Research & Technologies (QRT) is a global quantitative and systematic investment manager, operating in all liquid asset classes across the world. We are a technology and data driven group implementing a scientific approach to investing. Combining data, research, technology and trading expertise has shaped QRT’s collaborative mindset which enables us to solve the most complex challenges. QRT’s culture of innovation continuously drives our ambition to deliver high-quality returns for our investors.

As QRT’s infrastructure estate grows, maintaining accurate data on its resources, ownership and performance is increasingly important. In this hands-on role, you will build and operate the data foundations underpinning our infrastructure inventory and observability capabilities. The focus extends beyond dashboard design to creating an accurate, consistent and reliable view of the platform, its ownership and its behaviour.

Your future role within QRT:

  • Design and build data models for infrastructure and operational data, defining canonical representations for resources, ownership, capacity and utilisation.
  • Integrate inventory, configuration, security and observability data from multiple systems into a coherent, queryable view.
  • Keep key counts and metrics consistent across different consumers, and make data lineage, ownership and limitations explicit.
  • Design data structures that are fast to query and easy to reason about at the scale of QRT’s estate.
  • Automate data processing, validation and delivery, and build the tooling to detect data-quality, freshness and performance issues before consumers do.
  • Investigate and resolve data-quality, freshness and performance issues, solving root causes rather than symptoms.
  • Collaborate closely with infrastructure, security, engineering and observability teams to onboard new sources and improve the accuracy of the platform view.
  • Take ownership of systems end-to-end, and adapt the platform as scale, requirements and underlying technologies change.

 

Your present skillset:

  • Experience building and operating production-grade data platforms, analytical data models, or large-scale data-processing applications.
  • Strong SQL and dimensional or analytical data modelling experience, including the design of schemas that are maintainable, performant and easy for consumers to reason about.
  • Strong Python software engineering experience, including the design of maintainable, tested production applications and scalable ETL/ELT pipelines.
  • Demonstrated rigour around data correctness: establishing provenance, reconciling conflicting or incomplete sources, and reasoning carefully about identity, ownership and source of truth.
  • Solid working understanding of infrastructure and observability concepts, and comfort working across data, infrastructure and observability domains.
  • Experience operating business-critical pipelines and diagnosing data, performance and reliability issues in production.
  • Familiarity with knowledge graphs, ontologies and taxonomies, and their application to modelling heterogeneous operational data.
  • A strong bias towards automating repetitive work, and pragmatism in balancing correctness, performance and delivery.
  • Excellent problem-solving and communication skills, and the ability to own outcomes across research, engineering and infrastructure teams.
  • Preferred:
    • A background in data science, statistics or applied machine learning, particularly applied to incomplete, noisy or inconsistent data, or to inferring missing information and identifying unusual behaviour.
    • Experience with SQL-based analytical platforms, dbt, object storage and data catalogues.
    • Experience with infrastructure inventory or CMDB data, ownership and capacity/utilisation modelling.
    • Experience with metrics, logs and vulnerability data, and with observability tooling.
    • Experience with Superset or comparable BI and data-exploration tools.
    • Experience with Linux, containers and GitLab CI/CD.
    • Experience with AWS services and cloud SDKs.

QRT is an equal opportunity employer. We welcome diversity as essential to our success. QRT empowers employees to work openly and respectfully to achieve collective success. In addition to professional achievement, we are offering initiatives and programs to enable employees achieve a healthy work-life balance.

Skills

PythonAWSCI/CDLinuxSQLMachine LearningData ScienceETLGitLab

Similar Jobs

30

Data Platform Engineer

Domino’s Pizza · Ann Arbor, MI, United States

Today

Data Platform Engineer

Accenture · Mumbai, MDC2B, India +1

Today

Data Platform Engineer

Accenture · Bengaluru, BDC7B, India

2 days ago

Data Platform Engineer

DMSi Software · Omaha, NE

2 days ago

Data Platform Engineer

Alfred H Knight Group · Liverpool, Merseyside, United Kingdom

3 days ago

Data Platform Engineer

Magentic · London · Hybrid

6 days ago

Data Platform Engineer

Tessera Labs · Remote in the U.S. +1 · Remote

6 days ago

Data Platform Engineer

firstorion · US AR, United States of America

1 week ago

Data Platform Engineer

Nngroup · Digital Hub Madrid, Spain

1 week ago

Data Platform Engineer

Mercor · San Francisco · Onsite

1 week ago

Data Platform Engineer

A1Group · София, ул. Кукуш 1, сграда 7, етаж 2, Bulgaria · Hybrid

1 week ago

Data Platform Engineer

Lendable · London · Hybrid

1 week ago

Data Platform Engineer

Banc of California · Durham, NC

2 weeks ago

Data Platform Engineer

B2spin · Poland +3 · Remote

2 weeks ago

Data Platform Engineer

Rhsc · RLHICA - Indianapolis, United States of America · Remote

2 weeks ago

Data Platform Engineer

Psecu · Elmerton Ave, United States of America · Onsite

2 weeks ago

Platform Engineer - Data

Professional Kyndryl · INMANBP Bangalore (INMANBP) Manyatha, India +1 · Remote, Hybrid

3 weeks ago

Platform Engineer - Data

Professional Kyndryl · INMANBP Bangalore (INMANBP) Manyatha, India +1 · Remote, Hybrid

3 weeks ago

Data Platform Engineer

Nrf · Newcastle, United Kingdom

3 weeks ago

Data Platform Engineer

Jack Entertainment · Cleveland, OH

1 month ago

Data Platform Engineer

Accenturefederalservices · Suitland, MD +1 · Onsite

1 month ago

Data Platform Engineer

Accenture · Hyderabad, HDC3B, India

1 month ago

Data Platform Engineer

Ebiquity · Netherlands - Remote · Remote

1 month ago

Data Platform Engineer

Asics Apps · Canada · Remote, Hybrid, Onsite

1 month ago

Data Platform Engineer

Hadrian Automation · Los Angeles, CA · Onsite

1 month ago

Data Platform Engineer

Greystar · Remote South Carolina, Remote South Carolina, SC, United States of America · Remote

1 month ago

Data Platform Engineer

Paxos · Remote - India · Remote

1 month ago

Data Platform Engineer

CHRIST PANOS FOOD CORPORATION · Itasca, IL

2 months ago

Data Platform Engineer

Accenture · Hyderabad, HDC3C, India

2 months ago

Data Platform Engineer

Accenture · Pune, PDC3B, India

2 months ago