Senior AI Agent Engineer
Planera · Remote · United States ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Senior AI Agent Engineer
- Fully remote position
- Python + LangGraph
- LLM integration & eval
- Work with CTO
You will own agent features end-to-end for Manny, Planera's AI scheduling assistant built on a Critical Path Method platform. Responsibilities include evolving the LangGraph/LangChain agent, engineering prompts, and integrating LLMs across providers like Anthropic and OpenAI.
The role requires a strong software engineering foundation with a focus on reliability and user impact. You will collaborate with product and engineering teams to deliver AI features, utilizing observability tools to debug and improve behavior in production.
What you'll do
- Design and build Manny features across agent backend, tools, and UI
- Improve agent reliability and answer quality via prompt engineering
- Evolve agent architecture including ReAct loops and routing logic
- Integrate and tune LLMs across providers balancing cost and latency
- Extend tool surface through MCP server connecting to scheduling services
- Build evaluation loops with golden datasets and automated evaluators
- Implement observability with tracing and structured logging for debugging
- Ensure safe sandboxed execution of model-generated code
What you'll need
- 4+ years software engineering experience with production LLM features
- Strong proficiency in Python for building production services
- Hands-on experience with agentic systems and LangChain/LangGraph
- Practical prompt engineering skills for reliable model behavior
- Experience evaluating LLM systems using datasets and tracing tools
- Experience with Model Context Protocol or function-calling integrations
- Solid understanding of API design including REST and streaming
- Excellent remote communication skills and product mindset
Nice to have
- Experience with MongoDB and Redis
- Cloud experience with AWS or GCP and containers
- Go experience for backend systems and MCP tool server
- Practical experience with RAG, embeddings, and vector stores
- Familiarity with LangSmith or comparable evaluation platforms
- Frontend or React familiarity for agent UI work
- Domain knowledge in construction tech or project management
Stack
- Python
- Flask
- Go
- LangGraph
- LangChain
- LangSmith
- MongoDB
- Redis
- S3
- Docker
- AWS
- GCP
- Terraform
- GitLab CI/CD
What you get
- Competitive salary
- Stock options
- Benefits package
- Dynamic work environment