Principal Product Manager, AI Platform
Angi · Remote · Remote - United States ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Fully remote
- Principal level
- AI Platform focus
- Infrastructure as product
- $190k-$280k salary
You will own the vision and roadmap for Angi's AI Platform, serving as the centralized gateway for all generative AI and agent traffic. The team builds common infrastructure for routing, cost attribution, quality evaluation, and guardrails, enabling product engineering and data science teams to scale safely.
This role treats infrastructure as a product, requiring a strong technical thesis on how AI reshapes software development. You will manage the platform that supports model-agnostic gateways, prompt management, and self-hosted model serving, ensuring internal teams can build and serve models efficiently.
What you'll do
- Define vision for a governed, model-agnostic AI Gateway with cost attribution and routing
- Build roadmap for eval engines and pass/fail gates to catch quality regressions early
- Establish trust-and-autonomy ladder criteria for agent independence and accountability
- Consolidate self-hosted LLM and traditional ML workloads into one observable platform
- Instrument metrics to track platform health, business impact, and ROI telemetry
- Partner with engineering and data science to drive adoption and reflect real usage
- Manage complex platform backlog and communicate trade-offs to business stakeholders
What you'll need
- 8+ years in Product Management with 4+ years in infrastructure or AI/ML systems
- Proven track record scaling technical platforms for internal engineering customers
- Technical fluency in model serving, API gateways, eval frameworks, and Kubernetes
- Ability to use telemetry and cost data to diagnose bottlenecks and drive strategy
- Experience balancing revenue-critical stabilization with new strategic build-outs
Nice to have
- Familiarity with LLM gateways like LiteLLM and observability tools like Langfuse
- Experience with prompt management, versioning, and LLM fine-tuning in production
- Knowledge of agent governance concepts including guardrails and PII controls
- History of influencing cross-functional teams without direct authority
Stack
- LiteLLM
- Langfuse
- KServe
- SageMaker
- Bedrock
- Ray
- Kubernetes
How you'll work
- Fully remote position
- Global company with employees worldwide
What you get
- Salary range $190,000 – $280,000
- Year-end performance bonus and equity package
- Full medical, dental, and vision coverage
- Flexible vacation policy
- Pet discount plans
- Retirement plan with company match (401K)