Human Data - Engineer
xAIGenerative AI company
Palo Alto, United States$144,000 - $270,000Mid
Valor Equity Partners
Andreessen Horowitz
Sequoia Capital
Vy Capital
Fidelity Management & Research Company
Prince Alwaleed Bin Talal
Data & AI
About the role
TL;DR
Craft and execute high-value Human Data projects to provide engineering teams with quality data and evaluations.
- •You will ensure engineering teams get the right data they need—high-quality tasks and evaluations—by crafting and executing high-value Human Data projects.
- •You sit at the intersection of engineering and data operations: partnering with model teams, designing projects that capture meaningful signals, and driving data yield and eval lift.
- •Key Responsibilities Partner with model and engineering teams to understand needs and translate them into high-value data projects and evaluation strategies.
- •Own end-to-end delivery of critical data and eval projects that capture meaningful training signals and support rapid model development.
- •Build tools and systems to measure data effectiveness and run evaluations yourself to continuously improve quality.
- •Maintain rigorous data integrity and truthfulness, including validation processes for factual accuracy; prioritize quality over quantity.
- •Research, implement, and evaluate techniques for data collection, annotation, generation, and multi-modal integration.
- •Requirements Bachelor's degree in engineering, computer science, or a related STEM discipline, or 4+ years of experience in lieu of a degree Experience collaborating with cross-functional teams (engineering, research, product, or annotation/operations groups) Demonstrated experience analyzing datasets to identify trends, anomalies, quality issues, or integrity problems
Required skills
PythonSQLAWSGoogle CloudAzureDockerKubernetesGit
Nice-to-have skills
PandasNumPySparkTensorFlowPyTorchscikit-learnOpenAI APILangChainHugging FaceNLP
Domain expertise
deeptechai
Benefits & perks
equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, various other discounts and perks
Tech stack
PythonSQLAWSGoogle CloudAzureDockerKubernetesGit