Technical Project Manager
LILT · Remote · USA ·
COMPENSATION
$130k – $163k
Listed on the employer's job board (Ashby)
- Fully remote
- Applied AI & LLMs
- SQL proficiency required
- 3-5+ years experience
- Global team collaboration
Join the Applied AI team at LILT to manage large-scale projects involving human-in-the-loop workflows and LLM evaluation. You will translate technical requirements into high-throughput data pipelines, working closely with AI specialists, engineers, and global subject matter experts to improve model quality and efficiency.
What you'll do
- Manage AI data collection and evaluation projects from scoping to delivery
- Translate technical AI needs into structured data specs and annotation plans
- Coordinate supervised fine-tuning and RLHF data collection efforts
- Partner with engineering to validate data workflows and system integrations
- Operationalize hybrid evaluation methods using human review and automated tools
- Analyze throughput, quality, and unit economics using SQL and BI tools
- Define quality standards including inter-annotator agreement and gold-set performance
- Communicate technical risks and project status to diverse stakeholders
What you'll need
- 3-5+ years in technical project management for AI/ML or data platforms
- Strong understanding of LLM training concepts like SFT and RLHF
- Proficiency in SQL for analyzing data quality and cost structures
- Working knowledge of data pipelines, APIs, and structured data formats
- Experience partnering with engineers on technical requirements and dependencies
- Ability to track and optimize project unit economics and delivery velocity
- Strong communication skills for translating technical details to global teams
- Experience managing complex workflows using Agile, Scrum, or Kanban
Nice to have
- Experience with Python or scripting for data analysis and automation
- Background in managing high-skill Subject Matter Experts or contributor networks
- Familiarity with annotation platforms, BI tools, and Jira
- Experience delivering complex multilingual or multimodal data projects
- Degree in computer science, data science, engineering, or equivalent experience
- Fluency in an additional language
Stack
- SQL
- Python
- Jira
- LLM frameworks
- BI tools