Hiring.Camp

Engineering Manager - Software Security & AI Benchmark Delivery

Gramian Consulting Group

·

3 days ago

Location
Pakistan · Indonesia · Kenya · Nigeria · Turkey · Vietnam
Workplace
Remote
Type
Contract
Department
Talent Solutions
Seniority
Manager
Source
Workable

Description

About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About the Role

We are seeking an experienced Engineering Manager – Software Security to lead the development and delivery of security-focused training and evaluation tasks for frontier AI coding models. You will oversee multiple engineering pods, taking ownership of delivery performance, technical quality, team capacity, and client alignment.

The project focuses on transforming real-world software vulnerabilities into rigorous, reproducible tasks that evaluate whether AI models can identify, understand, reproduce, and securely remediate vulnerabilities across different programming languages and software ecosystems.

As the final quality gate, you will ensure that all delivered tasks meet the client's expectations for technical accuracy, difficulty, reproducibility, and evaluation robustness. This position combines software security expertise, multi-team leadership, operational management, and data-driven decision-making, with direct responsibility for delivering against Google's project expectations.

Engagement Type: Contractor assignment
Duration: 3 months
Start Date: Expected to start next week
Commitment: 40 hours per week
Work Arrangement: Fully remote
Time Zone Requirement: Minimum 4 hours of overlap with PST
Project Focus: Software security, AI coding model evaluation, engineering team management, and benchmark delivery.

Key Responsibilities

  • Multi-Pod Leadership: Own delivery, quality, and capacity across multiple engineering pods, coordinating Pod Leads and ensuring consistent execution.

  • Delivery Planning: Plan task batches, assign work to Pod Leads, and monitor daily throughput against phase-specific targets.

  • Performance Management: Ensure batches meet Google's expectations for task volume, technical difficulty, quality standards, and delivery timelines.

  • Client Communication: Lead weekly client reporting, communicate progress, provide delivery forecasts, and raise risks or dependencies proactively.

  • Risk Management: Identify and escalate tooling issues, rate limits, safety blocks, staffing constraints, and other delivery risks.

  • Scope Alignment: Work directly with Google to clarify requirements and align on task scope, timelines, task volume, and difficulty changes.

  • Final Quality Assurance: Conduct final reviews of security tasks before delivery, ensuring technical accuracy, reproducibility, and resistance to gaming or superficial solutions.

  • Technical Calibration: Train and calibrate Pod Leads on CWE classification, verifier robustness, task difficulty, technical quality, and acceptance criteria.

  • Recruitment & Hiring: Conduct interviews and make hiring decisions based on approved role requirements and project capacity needs.

  • Talent Development: Identify high-performing Trainers and support their development and promotion into Pod Lead positions.

  • Capacity Forecasting: Use throughput, workload, and quality data to forecast headcount requirements across project phases.

  • Workforce Planning: Initiate hiring waves approximately three weeks ahead of projected capacity requirements.

  • Operational Reporting: Use dashboards, performance indicators, and operational metrics to guide delivery decisions and staffing plans.

Skills

PythonJavaScriptTypeScriptJavaRustRubyPHPKotlinDockerLinuxGitRisk Management

Similar Jobs

30

Engineering Manager

NBCUniversal·New York City, New York·Hybrid

Today

Engineering Manager

FNA Group·Mesquite, Texas

Engineering Manager

Cloudflare·Hybrid·Hybrid

Today

Engineering Manager

HousingAnywhere Group·Rotterdam, South Holland·Hybrid

Today

Engineering Manager

Dunnhumby·Gurugram, Haryana·Hybrid

Today

Engineering Manager

Finanskandidaten·K&#xF8, Benhavn

Engineering Manager

Atalco Gramercy LLC·Gramercy, Louisiana

1d ago

Engineering Manager

Pepsi Co·Leicester, England

1d ago

Engineering Manager

Barclays·Czechia

1d ago

Manager Engineering

Cat·Chhatrapati Sambhaji Nagar, Maharashtra

1d ago

Engineering Manager

Fivetran·Bengaluru, Karnataka·Hybrid

Engineering Manager

Felix·Rio de Janeiro, Brazil·Hybrid

1d ago

Engineering Manager

Felix·São Paulo, Brazil·Hybrid

1d ago

Engineering Manager

Felix·Buenos Aires, Buenos Aires F.D.·Hybrid

1d ago

ENGINEERING MANAGER

Platform Aerospace·Hollywood, California

1d ago

Manager, Engineering

MongoDB·Dublin, Leinster·Hybrid

Manager, Engineering

NielsenIQ·Chennai, Tamil Nadu·Hybrid

1d ago

Engineering Manager

Delivery Hero·Dubai, United Arab Emirates·Onsite

1d ago

Engineering Manager

AECOM·Perth, Western Australia·Hybrid

2d ago

Manager, Engineering

Connect wise·Mumbai, Maharashtra

2d ago

Engineering Manager

Released·Auckland, New Zealand

2d ago

Engineering Manager

Top Hat·Toronto, Ontario·Remote

2d ago

Engineering Manager

Go-Ahead London·UNAVAILABLE

2d ago

Engineering Manager

Nexii Inc.·Squamish, British Columbia

2d ago

Engineering Manager

Davidson Hospitality Group·Salt Lake City, Utah

2d ago

Engineering Manager

Davidson Hospitality Group·Salt Lake City, Utah

2d ago

Engineering Manager

JLL employee·Vietnam·Onsite

2d ago

Manager Engineering

Cat·Wuxi, Jiangsu

2d ago

Manager Engineering

Cat·Wuxi, Jiangsu

2d ago

Engineering Manager

Goodyear·Thailand·Onsite

2d ago