Hiring.Camp

Cybersecurity Engineer - AI Benchmarking Lead

Gramian Consulting Group

·

3 days ago

Location
Pakistan · Indonesia · Kenya · Nigeria · Turkey · Vietnam
Workplace
Remote
Type
Contract
Department
Talent Solutions
Seniority
Lead
Experience
6+ years
Source
Workable

Description

About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About the Role

We are seeking an experienced Lead Software Security Engineer to lead a team of trainers developing high-quality training and evaluation tasks for frontier AI coding models. You will oversee project delivery, coordinate team capacity, maintain technical quality standards, and step in to perform hands-on vulnerability research and task development when workloads increase.

The project focuses on transforming real-world open-source vulnerabilities—including CVEs, security advisories, and bug reports—into Harbor-format audit-and-patch tasks across multiple programming languages. These tasks evaluate whether AI systems can identify, understand, reproduce, and securely remediate software vulnerabilities rather than relying on superficial pattern matching or copying known patches.

This position combines software security expertise, technical leadership, benchmark development, quality assurance, and delivery management. The ideal candidate is an experienced security-focused software engineer who can lead contributors, make sound technical decisions, manage delivery expectations, and maintain hands-on involvement in the work.

Engagement Type: Contractor assignment
Duration: 3 months
Start Date: Expected to start next week
Commitment: 40 hours per week
Work Arrangement: Fully remote
Time Zone Requirement: Minimum 4 hours of overlap with PST
Project Focus: Software security research, AI coding model training and evaluation, benchmark development, and technical team leadership.

Key Responsibilities

  • Team & Delivery Management: Plan task deliveries by batch, assign work across pod members, and track daily throughput against phase-specific targets.

  • Progress Monitoring: Monitor pod performance, identify bottlenecks, resolve delivery issues, and ensure tasks move through production stages on schedule.

  • Client Communication: Lead weekly client reporting, communicate delivery status, and proactively escalate risks involving tooling issues, rate limits, safety blocks, and resource constraints.

  • Scope & Requirements Alignment: Collaborate with the client to clarify requirements and align on task scope, volume, complexity, and difficulty changes.

  • Technical Quality Assurance: Conduct final reviews of completed tasks to ensure they meet required quality, security, reproducibility, and evaluation standards.

  • Team Calibration: Train and calibrate Pod Leads and trainers on CWE classification, verifier robustness, task difficulty, technical requirements, and acceptance criteria.

  • Capacity Planning: Use throughput and quality data to forecast staffing needs across project phases.

  • Recruitment & Onboarding: Initiate hiring and onboarding waves approximately three weeks ahead of projected capacity requirements.

  • Hands-on Technical Contribution: Step in to research vulnerabilities, reproduce security issues, develop proof-of-vulnerability tests, and create or review benchmark tasks during periods of high workload.

  • Documentation & Reporting: Maintain clear documentation of delivery plans, risks, quality findings, throughput metrics, staffing forecasts, and project decisions.

Skills

PythonJavaScriptTypeScriptJavaRustRubyPHPKotlinDockerLinuxGitTechnical Writing

Similar Jobs

30

Cybersecurity Engineer

Sourceability·Budapest, Hungary·Hybrid

Cybersecurity Engineer

Sourceability·Singapore·Hybrid

Cybersecurity Engineer

Infinity Systems Engineering·Colorado Springs, Colorado

Today

Cybersecurity Engineer

Eaton·Carnot-Moon, Pennsylvania

Today

Cybersecurity Engineer

Booz Allen Hamilton·Warner Robins, Georgia

1d ago

Cybersecurity Engineer

Workday·Pleasanton, California·Hybrid

1d ago

Cybersecurity Engineer

Visa·London, England·Hybrid

1d ago

Cybersecurity Engineer

Xpect Solutions·Washington, US

1d ago

Cybersecurity Engineer

Booz Allen Hamilton·Maryland, US +1

2d ago

CYBERSECURITY ENGINEER

Aero Simulation Inc·Dyess AFB, TX

2d ago

Cybersecurity Engineer

Wabtec·Suzhou, Jiangsu·Onsite

4d ago

Cybersecurity Engineer

Select Water Solutions·Houston, Texas

4d ago

Cybersecurity Engineer

Digital Check Corp·Northbrook, Illinois

4d ago

Cybersecurity Engineer

CACI Ltd·US·Onsite

4d ago

Cybersecurity Engineer

Mayvin, Inc·Fort Belvoir, Virginia·Hybrid

Cybersecurity Engineer

Rule4·Boulder, Colorado·Hybrid

1w ago

Cybersecurity Engineer

Tranetechnologies·US·Onsite

1w ago

Cybersecurity Engineer

Bertelsmann-Jobs·Romania·Hybrid

1w ago

Cybersecurity Engineer

VivSoft Technologies·Remote

1w ago

Cybersecurity Engineer

Visa·Austin, Texas·Hybrid

1w ago

Cybersecurity Engineer

Planet Technologies·Washington, District of Columbia·Onsite

2w ago

Cybersecurity Engineer

Talent Acquisition Team·Indianapolis, Indiana·Remote

2w ago

Cybersecurity Engineer

Georgia·US

2w ago

Cybersecurity Engineer 

Turium·Hyderabad, Telangana·Onsite

2w ago

Cybersecurity Engineer

Redwood Credit Union·Napa, California·Onsite

2w ago

Cybersecurity Engineer

VIDIZMO LLC·Karachi, Sindh

2w ago

Cybersecurity Engineer

TrekFed·Remote

Cybersecurity Engineer

Piedmont Healthcare Care·Statesville, North Carolina

2w ago

Cybersecurity Engineer

Clarios·Mexico·Hybrid

2w ago

Cybersecurity Engineer

SGS·Hanoi, Vietnam·Onsite

2w ago