AI Infrastructure / Product Engineer

About the Role

As an AI Infrastructure / Product Engineer, you will work at the intersection of AI research and product development at a healthtech company building AI products. You will help turn experiments into dependable systems and features, and build ways to measure and improve their quality.

What You'll Do

• Build repeatable benchmarks and evaluation pipelines to measure model accuracy, hallucinations, retrieval quality, latency, and cost.

• Create dashboards that make changes in system performance visible to the team.

• Develop production retrieval, drafting, document, and agent workflows from research prototypes.

• Build backend services, APIs, and internal tools to help test and release improvements.

• Deploy and operate cloud infrastructure, including monitoring, databases, delivery pipelines, and reliable operations.

• Collaborate with AI research while staying connected to product and user needs.

What We're Looking For

• At least 3 years of experience as a software, infrastructure, or product engineer building and deploying production systems.

• Strong Python skills and hands-on cloud deployment experience.

• Experience with APIs, databases, backend services, deployment pipelines, and production monitoring.

• Experience building evaluation pipelines, benchmarks, or assessment systems for machine learning or AI systems.

• Ability to turn ambiguous ideas and experimental code into usable, maintainable products.

• Interest or experience in LLMs, retrieval-augmented generation, agents, AI benchmarks, or document automation.

• Full-stack experience is helpful. Familiarity with FastAPI, Docker, React, Next.js, Postgres, or vector databases is a plus.

Compensation & Benefits

Annual base salary is $180,000 to $260,000 USD, depending on skills, experience, and role scope. Visa sponsorship is not available.

Location

Remote within the United States.