ByteDance logo

Senior Software Engineer, AI Infrastructure - Developer Tooling

ByteDance

Posted 21 days ago

About the Team
We're building the AI-powered backbone of our developer tools. You'll work on three core systems: a retrieval infrastructure powering our AI products, a coding agent that assists users in writing code, and the evaluation frameworks that measure their effectiveness.

Responsibilities
Retrieval Systems (RAG Infrastructure)
- Design and scale retrieval pipelines including vector search, BM25, and hybrid retrieval strategies
- Build and optimize embedding pipelines, chunking strategies, and re-ranking systems
- Develop query understanding and rewriting components to improve retrieval relevance
- Manage vector database infrastructure at production scale

Coding Agent Development
- Build agent architectures that support multi-step code generation, refactoring, debugging, and diagnostics
- Implement tool-use patterns (function calling, code execution sandboxing, file system interaction)
- Develop context management strategies for long-form code understanding

Evaluation & Benchmarking
- Design and maintain evaluation frameworks for retrieval quality and agent task completion
- Build custom benchmark suites for real-world coding task assessment
- Create reproducible testing infrastructure with automated regression detection

The base salary range for this position in the selected city is $212800 - $387600 annually.

Job details

Workplace

Office

Location

San Jose, California, United States

Job type

Full Time

Experience

SE

Salary

213k - 388k USD

per year

Similar
ByteDance logo

ByteDance

Online Presence

Jobr Assistant extension

Get the extension →