LLM evaluation Jobs

Manager

Machine learning LLM Security Mentoring Ownership Segment Large language models Prompt engineering LLM evaluation AI safety

10+ years technical experience 5+ years managing AI technical teams in hypergrowth (ideally from 0 to 30+) Previous experience leading solutions architect or…

Manager, Solutions Architect

Anthropic

Seoul, South Korea8d ago

Manager

Machine learning LLM Ownership Large language models Prompt engineering Fine-tuning LLM evaluation AI safety

Build and manage the foundational team of Applied AI professionals in Seoul (Solutions Architects and Product Engineers) providing both technical guidance and…

Lead AI Engineer

Upwork

Lisbon, Portugal8d ago

Python SQL Snowflake Machine learning LLM Large language models Prompt engineering AI agents LLM evaluation

Since its founding, Upwork Inc. has facilitated more than $30 billion in total transactions and services as it fulfills its purpose to create opportunity in…

Lead AI Engineer

Upwork

Palo Alto, California, United States8d ago

Python SQL Snowflake Machine learning LLM Large language models Prompt engineering AI agents LLM evaluation

Design and implement scalable agentic frameworks that coordinate multiple AI agents to deliver accurate and reliable outcomes. Build and optimize natural…

Staff AI Scientist

HackerRank Careers

Hybrid in Bangalore, India8d ago

Staff

Linear Machine learning LLM A/B testing Mentoring RAG Large language models Embeddings Retrieval-augmented generation LLM evaluation+1

HackerRank helps companies like NVIDIA, Amazon, and Microsoft hire and upskill the next generation of developers based on skills, not pedigree. Our platform…

AI Automation Engineer / Developer

ShyftLabs

Toronto, Ontario2d ago

United States - Remote8d ago

Python JavaScript Node.js FastAPI AWS GCP Kubernetes Docker Lambda LLM+10

Design and implement AI automation pipelines using Python (FastAPI, LangChain, spaCy) or Node.js (LLM API wrappers, task automation frameworks). Build and…

Machine Learning Engineer, PhD Intern

Instacart

Intern

Python Go Machine learning TensorFlow PyTorch LLM Large language models LLM evaluation

Ph.D. student in computer science, mathematics, statistics, economics, or related areas. Strong programming (Python, Golang) and algorithmic skills. Solid…

Manager of Solutions Architecture, Applied AI (Industries)

Anthropic

Machine learning LLM Security Mentoring Ownership Segment Large language models Prompt engineering LLM evaluation AI safety

10+ years technical experience 5+ years managing AI technical teams in hypergrowth (ideally from 10 to 50+) Previous experience leading solutions architect or…

Lead QA AI Engineer

Anaplan

Manchester, United Kingdom8d ago

Python JavaScript REST CI/CD Jira Selenium Pytest Machine learning LLM Security+6

QA or test engineering experience, preferably with AI/ML systems. Strong understanding of GenAI technologies including LLMs, prompt engineering, and AI…

SDET - I

Mindtickle

Pune, Maharashtra2d ago

Python Java AWS GCP Azure Docker CI/CD Jenkins GitHub Actions Git+12

Design, build, and maintain scalable automation frameworks to qualify projects pre- and post-release, ensuring consistent product quality. Develop…

Applied Safety Research Engineer, Safeguards

Anthropic

San Francisco, CA8d ago

Python Machine learning LLM Data analysis Large language models Prompt engineering LLM evaluation AI safety Red teaming Synthetic data+1

Red teaming, adversarial testing, or jailbreak research on AI systems Building or contributing to LLM evaluation frameworks or benchmarks Trust and safety,…

Sr. Software Engineer - Applied AI Engineering

Clari

Bengaluru, India2d ago

Python Elasticsearch AWS Kubernetes Docker Machine learning PyTorch LLM Mentoring Code review+16

On a day-to-day basis, you will be responsible to - Architect and lead the design of complex AI systems involving multi-agent orchestration, large-scale RAG…

Head of Solution Architects, India

Anthropic

Bangalore, India8d ago

Machine learning LLM Ownership Large language models Prompt engineering Fine-tuning LLM evaluation AI safety

Build and manage the foundational team of Applied AI professionals in Bengaluru (Solutions Architects and Product Engineers) providing both technical guidance…

Manager of Solutions Architecture, Applied AI (Industries)

Anthropic

Machine learning LLM Security Mentoring Ownership Segment Large language models Prompt engineering LLM evaluation AI safety

10+ years technical experience 5+ years managing AI technical teams in hypergrowth (ideally from 10 to 50+) Previous experience leading solutions architect or…

Lead AI Test Automation Specialist

DevRev

Cebu, Philippines8d ago