Data Engineer

Department: Engineering

Employment Type: Permanent - Full Time

Location: New York

Compensation: $94,500 - $115,000 / year

Description

• Languages: SQL, Python, C#; scripting experience
• Databases: Microsoft SQL Server, Snowflake
• Data Engineering: ETL/ELT, Apache Airflow, data pipelines
• Cloud: AWS, including S3 and other AWS data services
• Development: Git, CI/CD, Liquibase, automated testing and deployment
• Data: Market data, trade data, transaction cost analysis, and financial data

Key Responsibilities

• Develop, maintain, and optimize complex SQL Server queries, stored procedures, functions, views, and data processing workflows.
• Design and develop scalable Snowflake data solutions, including data models, SQL transformations, loading processes, and analytical workloads.
• Participate in the migration of large volumes of data and processing from SQL Server to Snowflake.
• Analyze existing SQL Server logic and translate or redesign it for Snowflake where appropriate.
• Build and maintain ETL/ELT pipelines using SQL, Python, and workflow orchestration tools such as Apache Airflow.
• Develop data ingestion and processing workflows using AWS, including S3.
• Perform SQL Server and Snowflake performance tuning, including query optimization, execution plans, indexing, statistics, warehouse sizing, and workload optimization.
• Build data validation and reconciliation processes to ensure migrated and transformed data is accurate and complete.
• Troubleshoot production data issues, identify root causes, and implement reliable long-term solutions.
• Implement monitoring, logging, alerting, and operational controls for critical data pipelines.
• Collaborate with software engineers, service managers and implementation team, product teams, and DevOps.
• Support and enhance existing Transaction Cost Analysis (TCA) products and develop new functionality.
• Work with large-scale trade, market, benchmark, and financial data.

Skills, Knowledge and Expertise

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.

• Hands-on experience with Snowflake and AWS Cloud services (particularly S3 and data services).
• Strong hands-on SQL development experience.
• Python & C# scripting experience
• Strong experience with Microsoft SQL Server, including complex queries, stored procedures, performance tuning, and troubleshooting.
• Experience working with large datasets and production data systems.
• Strong analytical and problem-solving skills.

• Experience migrating SQL Server workloads to Snowflake or another cloud data platform.
• Experience with Apache Airflow or similar orchestration technologies.
• Experience with Git, CI/CD, Liquibase and automated deployment processes.
• Experience with data quality, reconciliation, and data governance.
• Knowledge of capital markets, trading, market data, or financial systems.
• Experience with Transaction Cost Analysis (TCA) or other financial analytics.
• Snowflake or AWS certification.

• We encourage engineers to use modern AI-assisted development tools, such as Claude Code to accelerate development, debugging, testing, refactoring, and migration work.
• Candidates should understand how to use AI effectively while independently validating generated code for correctness, security, performance, and maintainability.

Benefits

• Health & Financial Security:
  • Medical, Dental, and Vision insurance
  • Flexible Spending Accounts (FSA) & Health Savings Accounts (HSA)
  • 401(k) retirement plan
  • Pre-tax transit and parking benefits
• Time Off & Flexibility:
  • Enjoy the best of both worlds: the energy and collaboration of in-person work, combined with the convenience and focus of remote days. This is a hybrid position requiring three days of in-office collaboration per week, with the flexibility to work remotely for the remaining two days. Our hybrid model is designed to balance individual flexibility with the benefits of in-person collaboration, enhanced team cohesion, spontaneous innovation, hands-on mentorship opportunities and strengthens our company culture.
  • 22 days of Paid Time Off (PTO) per year, with the option to roll over unused days.
  • One dedicated day per year for volunteering.
  • Two professional development days per year to allow uninterrupted professional development.
  • An additional PTO day added during milestone anniversary years.
  • Robust paid holiday schedule with early dismissal.
  • Generous parental leave for all parents (including adoptive parents).
• Work-Life Support & Resources:
  • Budget for tech accessories, including monitors, headphones, keyboards, and other office equipment.
  • Backup child and pet care, as well as tutoring services.
  • Milestone anniversary bonuses.
• Wellness & Lifestyle Perks:
  • Stipend and subsidy contributions toward personally-owned cell phones
  • Contributions for gym memberships and health/wellness initiatives.
  • Discounted healthcare premiums.
  • Healthy meal delivery program subsidies.