Evaluations Team Lead
Fundamental · Remote · Europe · Israel (remote) ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Team Lead role
- Fully remote
- Python + SQL
- ML evaluation focus
- Visa sponsorship
Fundamental seeks a Team Lead to own how its flagship AI model, NEXUS, is measured. You will build the evaluation platform used by engineering, research, and Applied AI teams to ensure consistent benchmarks and prevent data leakage.
This player-coach position involves hiring and managing a small team while remaining hands-on with code and experiment design. You will turn benchmark findings into research priorities and release recommendations for enterprise decision-making tools.
What you'll do
- Build a shared evaluation platform for engineering and research teams
- Define standards for metrics, data splits, and leakage prevention
- Create reproducible pipelines with versioned inputs and artifacts
- Benchmark NEXUS against competitors using fair tuning budgets
- Support customer proof-of-concept evaluations with tooling and analysis
- Measure predictive quality, latency, and cost across configurations
- Hire, develop, and manage the evaluation team
What you'll need
- Experience owning evaluation for production tabular ML systems
- Strong statistical judgment for metrics and validation schemes
- Practical experience detecting data leakage in preprocessing
- Proficient in Python and SQL with scikit-learn knowledge
- Experience designing fair model comparisons and resource budgets
- Prior people management experience including hiring and coaching
- Clear communication skills with researchers and engineers
Nice to have
- Experience evaluating tabular foundation models or AutoML
- Knowledge of relational or multi-table data environments
- Familiarity with Snowflake or Databricks platforms
- Experience evaluating automated or agent-driven ML workflows
Stack
- Python
- SQL
- scikit-learn
- NEXUS
How you'll work
- Fully remote position
- Relocation support available for office locations
What you get
- Competitive salary and equity package
- Comprehensive health coverage for dependents
- Paid parental leave for all new parents
- Relocation support for joining the team