ByteDance logo

Senior Software Engineer, AI Infrastructure - Developer Tooling

ByteDance

Posted 6 days ago

About this role

Full Time Senior Senior Software Engineer, AI Infrastructure - Developer Tooling in AI at ByteDance in San Jose, California, United States. Apply directly through the link below.

At a glance

Work mode
Office
Employment
Full Time
Location
San Jose, California, United States
Salary
213k - 388k USD
Experience
Senior

Core stack

  • Vector Database
  • Infrastructure
  • Debugging
  • Design
  • RAG
  • AI

Quick answers

  • What is the salary range?

    The salary range is 213k - 388k USD annually.

  • What skills are required?

    Vector Database, Infrastructure, Debugging, Design, RAG, AI.

ByteDance is hiring for this role. Visit career page

San Jose, United States

About the Team
We're building the AI-powered backbone of our developer tools. You'll work on three core systems: a retrieval infrastructure powering our AI products, a coding agent that assists users in writing code, and the evaluation frameworks that measure their effectiveness.

Responsibilities
Retrieval Systems (RAG Infrastructure)
- Design and scale retrieval pipelines including vector search, BM25, and hybrid retrieval strategies
- Build and optimize embedding pipelines, chunking strategies, and re-ranking systems
- Develop query understanding and rewriting components to improve retrieval relevance
- Manage vector database infrastructure at production scale

Coding Agent Development
- Build agent architectures that support multi-step code generation, refactoring, debugging, and diagnostics
- Implement tool-use patterns (function calling, code execution sandboxing, file system interaction)
- Develop context management strategies for long-form code understanding

Evaluation & Benchmarking
- Design and maintain evaluation frameworks for retrieval quality and agent task completion
- Build custom benchmark suites for real-world coding task assessment
- Create reproducible testing infrastructure with automated regression detection

The base salary range for this position in the selected city is $212800 - $387600 annually.

Job details

Workplace

Office

Location

San Jose, California, United States

Job type

Full Time

Experience

Senior

Salary

213k - 388k USD

per year

Similar

Company

ByteDance

Jobr Assistant extension

Get the extension →