Minimum qualifications:

Bachelor’s degree or equivalent practical experience.
5 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.
3 years of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field.
3 year of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).
3 years of experience with Large Language Models.

Preferred qualifications:

Master's degree or PhD in Computer Science or related technical fields.
5 years of experience with data structures or algorithms.
Experience developing accessible technologies.
Experience with reinforcement learning.
Expertise in Deep machine learning, especially with Large Language Models.

Expertise in Deep machine learning, especially with Large Language Models.Expertise in Deep machine learning, especially with Large Language Models.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

The team works on new ways to search, with a focus on LLM modeling. In this role, you will be building new ways to use LLMs in Search. You will help develop new ways to do things and apply modeling techniques in the real world.

Our work revolves around training LLM models, reinforcement learning (RL), multi-step reasoning to various distillation techniques and contribute to different projects, over shorter timelines, our team is not tied to a specific user facing product, You will come up with new ideas, run experiments, new ways to do retrieval, tool calling, or generate fresh content and test them end-to-end in user-facing products.
You will find new under-explored opportunities to apply LLMs, make them work in the real world, and collaborate with other teams.

In Google Search, we're reimagining what it means to search for information – any way and anywhere. To do that, we need to solve complex engineering challenges and expand our infrastructure, while maintaining a universally accessible and useful experience that people around the world rely on. In joining the Search team, you'll have an opportunity to make an impact on billions of people globally.

Responsibilities

Propose new modeling ideas and test them in the real world.
Collect training data, and evaluate its quality.
Design and build robust evaluations.
Deploy models to production, measure and optimize their latency.
Run end-to-end evaluations, analyze results and suggest modeling improvements.

Software Engineer III, AI/ML, LLM Modeling

Google