Software Engineer, Inference Optimization - Trust and Safety

The Trust and Safety(TnS) engineering team is responsible for protecting our users from harmful content and abusive behaviors. With the continuous efforts of our trust and safety engineering team, TikTok can provide the best user experience and bring joy to everyone in the world. Our team is responsible for achieving goals by building content moderation process systems, rule engine, strategy systems, feature engine, human moderation platforms, risk insight systems and all kinds of supportive platforms across TnS organization.

Responsibilities:
- Work closely with business teams to optimize the integration plan for algorithm applications, improve efficiency in evaluating and using algorithm applications across various business scenarios, and reduce the cost of managing and optimizing algorithm applications in different business scenarios.
- Responsible for the architectural design, development, and performance tuning of algorithm applications, solving technical challenges such as high concurrency, high reliability, and high scalability. Work includes multiple sub-areas: ML model training and evaluation, model optimization, model inference, model management, dataset management, workflow orchestration, etc.
- Responsible for the design and development of Machine Learning infrastructure for LLM/AIGC, etc
- Responsible for researching and implementing cutting-edge engineering technologies related to LLM, NLP, CV.