Inference optimization Jobs

Manager

Python SQL Slack Machine learning LLM Ownership RAG Large language models Prompt engineering Retrieval-augmented generation+1

If you’re looking for a place where your work matters, where you can push boundaries, and where your career can thrive—Apollo is the place for you. Learn more…

Research Engineer/Research Scientist, Audio

Anthropic

San Francisco, CA8d ago

Kubernetes Machine learning PyTorch LLM Large language models Fine-tuning Inference optimization Distributed training AI safety

Large language model pretraining and finetuning Training diffusion models for image and audio generation Reinforcement learning for large language models and…

Special Projects - OCTO

Moveworks

Mountain View, CA8d ago

San Francisco, CA | New York City, NY | Seattle, WA8d ago

Python JavaScript TypeScript AWS GCP Azure Kubernetes Docker Machine learning Deep learning+22

Experience in enterprise software environments and understanding of B2B customer needs Deep specialization in one or more AI domains: NLP, computer vision,…

Staff + Senior Software Engineer, Inference

Anthropic

San Francisco, CA | New York City, NY | Seattle, WA8d ago

Python Rust AWS GCP Azure Kubernetes Slack Machine learning LLM Large language models+2

High-performance, large-scale distributed systems Implementing and deploying machine learning systems at scale Load balancing, request routing, or traffic…

Staff + Senior Software Engineer, Cloud Inference

Anthropic

Noida, Uttar Pradesh2d ago

Python Rust AWS GCP Azure Kubernetes Docker CI/CD Slack Machine learning+6

Direct experience working with CSP partner teams to scale infrastructure or products across multiple platforms, navigating differences in networking,…

AI Engineer

ShyftLabs

LangChain Agent orchestration Inference optimization

Python Flask FastAPI REST PostgreSQL Redis AWS GCP Azure Kubernetes+22

4–8 years of relevant experience in LLMs, Backend Engineering, and MLOps. LLM Expertise Model Fine-tuning: Experience with parameter-efficient fine-tuning…

Sr Principal Product Management

Twilio

Twilio values diverse experiences from all kinds of industries, and we encourage everyone who meets the required qualifications to apply. If your career is…

Hardware Machine Learning Engineer

IMC

Chicago, United States; New York, United States8d ago

Python SQL Machine learning TensorFlow Computer vision Looker Security Ownership Inference optimization TensorRT

Python C++Machine learning Deep learning ASIC design RTL design FPGA SystemVerilog Verilog VHDL+3

Extensive experience with FPGA or ASIC technologies, including proficiency in either VHDL, Verilog, or SystemVerilog Solid understanding of digital design…

Senior Technical Program Manager, Caper Machine Learning

Instacart

6+ years of technical program management experience, ideally leading end-to-end ML/AI programs from data to production. 3+ years working on computer vision or…

Senior AI Engineering Manager

Duolingo

REST Machine learning Deep learning LLM NLP A/B testing Mentoring Ownership Large language models Model serving+2

Lead and mentor an 8–10 person team of ML engineers and researchers; recruit and develop top talent as the team grows. Drive the technical roadmap for our AI…

Research Engineer, Discovery

Anthropic

San Francisco, CA8d ago

AWS GCP Kubernetes Docker Machine learning PyTorch Spark A/B testing Inference optimization AI safety

Experience with language model training infrastructure and distributed ML frameworks (PyTorch, JAX, etc.) Background in building infrastructure for AI…

Staff Software Engineer, Inference

Anthropic

Python Rust AWS GCP Kubernetes Slack Machine learning LLM Large language models Inference optimization+1

High-performance, large-scale distributed systems Implementing and deploying machine learning systems at scale Load balancing, request routing, or traffic…

Principal Software Engineer - Core GenAI Platform

Upstart

United States | Remote8d ago

Machine learning LLM A/B testing Mentoring Large language models Inference optimization

Python TypeScript Kotlin React FastAPI Spring Kubernetes Docker Terraform Machine learning+11

10+ years of professional software engineering experience, with at least 3 years leading large-scale, cross-team technical initiatives Proven track record of…

Senior AI/ML Engineer (AI Platform)

Whoop

3+ years of experience in applied machine learning, AI engineering, or ML-focused software engineering roles, including significant work in production…

Software Engineer (Data & ML) - Mountain View, CA

Aeva

Mountain View, CA2d ago

Python C++SQL CI/CD Machine learning TensorFlow PyTorch Data pipelines Inference optimization ONNX+2

5+ years industry experience (or 3+ with a Master’s) in software, ML, or robotics systems. Strong Python and C++ skills, with experience in PyTorch/TensorFlow…

Senior AI Engineering Manager

Duolingo

REST Machine learning Deep learning LLM NLP A/B testing Mentoring Ownership Large language models Model serving+2

Lead and mentor an 8–10 person team of ML engineers and researchers; recruit and develop top talent as the team grows. Drive the technical roadmap for our AI…

Staff/Senior Applied Scientist, AI/GenAI & ML Systems

TraceLink, Inc

US - MA - Wilmington8d ago

Python AWS GCP Azure CI/CD Machine learning NLP A/B testing Security Mentoring+11

Familiarity with enterprise constraints: privacy, security, data governance, permissions, auditability Experience designing and running GenAI observability:…

Sr. Software Engineer - Applied AI Engineering

Clari

Bengaluru, India2d ago