Hiring.Camp

Backend/Data Engineer

Sweetspot

·
Salary
$130k – $200k
Location
New York, New York, US
Type
Internship
Department
Engineering
Education
Bachelor
Source
Y Combinator

Description

As a Backend Engineer at Sweetspot, you will join a team dedicated to pushing the boundaries of LLM usage over disparate and unstructured data sources across United States federal and state governments. You will play a critical role in building and integrating data pipelines that feed directly into a framework built for the aforementioned. More broadly, you will join a team that is highly focused on building a product that bolsters the American economy and provides every business, regardless of size, the tools they need to secure government opportunities.

Please note that this is role is only open to US citizens.

Things you should know about us

  • We work extensively with industry experts to build software that is useful for our clients. This means frequent customer calls and a constant level of iteration.
  • Talent density is far more important than team size. We want to hire the absolute best, and are willing to wait to find the right person.
  • If you’re early in your career and/or don’t come from a “prestigious” background, don’t be afraid to apply - we all went to a state school and don’t place a large emphasis on prestige.
  • Our office is in Manhattan.

What you’ll do

  • Design, develop, and maintain scalable and efficient data pipelines to process and transform large volumes of data from disparate sources across the internet
  • Implement and optimize data pipelines using Python/SQLAlchemy and Dagster, ensuring high performance, reliability, and scalability
  • Work with PostgreSQL databases, including design, optimization, and troubleshooting
  • Collaborate with teammates to build and maintain software that can query hundreds of millions of vectors in a single request
  • Participate in code reviews, testing, and deployment processes to ensure code quality and maintainability
  • Monitor and troubleshoot data infrastructure to identify and resolve issues proactively
  • Stay up-to-date with industry trends and best practices in data engineering and incorporate them into your work

Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related field
  • Strong proficiency in Python programming language
  • Solid experience with PostgreSQL databases, including writing efficient queries, performance tuning, and database administration
  • Familiarity with data pipeline frameworks such as Dagster, Airflow, Luigi, or similar
  • Knowledge of data processing and transformation techniques, including ETL processes
  • Experience with Git
  • Experience with Docker
  • Excellent problem-solving skills and ability to debug complex systems
  • Strong communication and collaboration skills, with the ability to work effectively in a team environment
  • US citizen

Preferred qualifications

  • Experience with cloud platforms such as AWS, GCP, or Azure
  • Experience with data engineering best practices
  • Experience with FastAPI and asynchronous programming
  • Experience with SQLAlchemy
  • Experience with data warehousing and business intelligence tools

We offer a competitive salary, comprehensive benefits package, and opportunities for growth and development within a fast-paced and innovative company.

If you are passionate data engineering, have a strong foundation in software development, and are interested in contributing to the growth of the American economy, we would love to hear from you. Sweetspot Chat, Inc. is an equal opportunity employer and values diversity in the workplace. We encourage all qualified applicants to apply.

Skills

PythonFastAPIAWSAzureGCPDockerPostgreSQLAirflowData EngineeringETLGit

Similar Jobs

30

Backend Engineer, Data

Minerva·New York City, New York·Onsite

3w ago

Backend & Data Engineer

AccelOne·Buenos Aires, Buenos Aires F.D.·Remote

1mo ago

Backend Engineer, Data

Stripe·Toronto, Ontario

Backend Engineer, Data & Integrations

Solen Software Group·Remote

Senior Backend Engineer, Real-time Data

Clera·Munich, Bavaria·Onsite

4d ago

Senior Backend Engineer, Data & Integrations

Buzz Solutions·Remote·Remote

4d ago

Staff Backend Engineer (Fintech Data Platform)

Coupang·Seoul, South Korea

Senior Backend Engineer (Data serving)

Pleo·Denmark +3·Remote

5d ago

Principal Data Engineer – Python Backend

Amgen is committed to unlocking·Mumbai, Maharashtra·Onsite

6d ago

Software Engineer – Backend / Data Platform (TypeScript) (m/f/d)

EnOcean·Munich, Bavaria +1·Hybrid

1w ago

Software Engineer – Backend / Data Platform (TypeScript) (m/f/d)

EnOcean·Munich, Bavaria +1·Hybrid

1w ago

Senior Data Engineer, Back End Systems (Remote)

Firstam·Georgia, US +2·Remote

1w ago

Backend Engineer – Data (m/w/d)

Smight Gmbh·Karlsruhe, Baden-Wurttemberg·Hybrid

1w ago

Backend Engineer III, Data Onboarding, NG-SIEM (Hybrid)

Crowdstrike·US·Remote, Hybrid, Onsite

1w ago

ID 4521 – Senior Backend Engineer – Data Platform

Conexion Hr·Buenos Aires, Buenos Aires F.D.·Remote

1w ago

Backend Software Engineer - Data Connectors

Palantir·New York City, New York·Hybrid

1w ago

Software Engineer -Data Processing Backend

The Morning Star Company·Toronto, Ontario·Hybrid

2w ago

Senior/Staff Backend Software Engineer - Data Platform

GridCARE·Redwood City, California·Hybrid

2w ago

Backend Engineer, Data Ingestion

Scribe·San Francisco, California·Hybrid

3w ago

Senior Backend Engineer - Data Platforms

Context Labs·Amsterdam, North Holland

3w ago

Software Engineer, Backend & Data

Vital Lyfe·Los Angeles, California·Onsite

3w ago

Software Engineer III - Backend & Data Systems (AI Solutions)

Blueorigin·Landmark, Arkansas·Onsite

4w ago

Lead Backend Engineer – DPS Core & Data Engine Squad

cccis·Chicago, Illinois·Remote

4w ago

Senior Backend Engineer/Data Engineer

MainStreaming·Remote

Principal Backend / Big Data Engineer

Akamai·Poland·Remote

4w ago

Software Engineer III - Backend/Data Engineer

Gh R·Charlotte, North Carolina·Onsite

1mo ago

Senior Staff Engineer - Backend & Data Engineering

Netradyne·Bengaluru, Karnataka

DATA ENGINEER- BACK END DEVELOPER

Irion·Italy

1mo ago

Software Engineer III - Backend / Data Engineer - Java, Python, Databricks

JP Morgan Chase·London, England

1mo ago

Software Engineer III - Backend / Data Engineer - Java, Python, Databricks

JP Morgan Chase·London, England

1mo ago