Director, Data & AI Evaluation

Job description

"

• Build a company-wide ""data factory"" — an end-to-end loop for data collection, processing, annotation, and feedback across edge and cloud
• Design a full-stack automated evaluation system spanning foundation models, domain models, and application layers
• Define data quality standards and model evaluation benchmarks; publish regular capability leaderboards
• Develop intelligent data mining and augmentation techniques to maximize data utility in sparse scenarios
• Lead AI compliance and ethical review programs to ensure data and model governance" "
• Deep experience in large-scale data engineering and AI evaluation system design; fluency in data closed-loop processes
• Proficiency in automated annotation, data cleaning, hard negative mining, and synthetic data generation
• Led the design of an automated model evaluation platform supporting multi-dimensional assessment
• Familiar with benchmark construction methodologies; prior experience building proprietary eval sets is a plus
• Systematic understanding of data compliance, privacy protection, and AI ethics"