AI Benchmark Engineer | Native Language Specialist - Dutch - Remote
LILT (Production) · Remote · Netherlands (Remote) ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Native Dutch required
- Fully remote freelance
- Python + Shell scripting
- AI benchmark testing
- Flexible schedule
Join LILT as an independent contractor to build rigorous evaluation suites for Terminal-Bench tasks. You will create high-quality assets in Dutch to measure how well AI models handle multilingual environments, focusing on prompt language effects and complex locale issues without relying on English translations.
What you'll do
- Design realistic task environments using Dutch datasets and files
- Identify failure points where AI struggles with native language prompts
- Write deterministic verifier scripts and reference implementations
- Calibrate task difficulty from Easy to Very Hard against model tiers
- Participate in a four-layer human quality control and audit process
What you'll need
- Native or near-native fluency in Dutch with deep grammatical knowledge
- High proficiency in English for communication and documentation
- At least one year of industry experience in software engineering
- Strong skills in Python, standard shell scripting, and data processing
- Extensive experience with Terminal/CLI-based development workflows
- Understanding of Unicode normalization and encoding robustness
- Familiarity with locale-dependent conventions and text I/O operations
Nice to have
- Background from leading technology companies or top-tier universities
- Experience with bidirectional text handling or font fallbacks
Stack
- Python
- Shell scripting
- Terminal-Bench
- Coding agents
How you'll work
- Fully remote freelance position
- Flexible hours with no fixed schedule or micromanagement
- Requires reliable availability for accepted tasks
- Minimum commitment of 2 hours daily or 15-20 hours weekly
- Contractors manage their own tax obligations
What you get
- Competitive rates with prompt payment processing
- Access to diverse AI and language technology projects
- Opportunity to join a global community of experts
- Work on impactful projects shaping human-machine communication
Hiring process
- Submit application with updated CV in English
- Complete GenAI assessment to evaluate technical skills
- Finalize onboarding and profile setup in the system