Generative AI Lead Engineer - Vice President

Responsibilities:

• Design, prototype, and implement Generative AI applications, ensuring robust, scalable, and secure solutions.
• LangChain & Orchestration: Drive the practical implementation and advanced utilization of LangChain (or similar orchestration frameworks) for building complex LLM applications, managing conversational flows, agentic behaviors, and tool integration.
• Vector Databases: Architect, select, and manage vector databases (e.g., Pinecone, Weaviate, Chroma, Milvus) for efficient similarity search, RAG (Retrieval Augmented Generation), and knowledge management, ensuring optimal performance and data freshness.
• LLM Validation & Evaluation: Establish and implement rigorous methodologies for the validation, testing, and continuous evaluation of LLMs (e.g., perplexity, factual consistency, safety, bias, performance metrics, A/B testing of prompt variations). Develop automated pipelines for tracking and reporting LLM performance.
• Practical LLM Platform Knowledge: Demonstrate and apply deep practical knowledge of various LLM platforms and versions (e.g., Gemini, OpenAI GPT-3.5/4, open-source models like Llama 2, Mistral). This includes understanding their respective strengths, limitations, APIs, fine-tuning capabilities, and cost implications.
• Expertise in AI  and Machine learning algorithms and related business usecases/applications
• Architecture Implementation: Lead the practical implementation of end-to-end architectures for Generative AI use cases, encompassing data ingestion, pre-processing, model serving, prompt engineering, RAG pipelines, output post-processing, and integration with existing enterprise systems.
• Provide expert-level guidance on Generative AI best practices, model selection, and prompt engineering techniques.
• Work with cross-functional teams in the practical application of LangChain, vector databases, and LLM evaluation.

Qualifications:

• 12 - 14 years of relevant experience in the Financial Service industry
• Experience as Applications Development Lead/manager
• Competent in Gen AI skills
• Expertise in prompt engineering / Open AI / Vertex models
• Stakeholder and people management experience
• Demonstrated leadership skills
• Proven project management skills
• Basic knowledge of industry practices and standards
• Consistently demonstrates clear and concise written and verbal communication

Education:

• Bachelor’s degree/University degree or equivalent experience
• Master’s degree preferred

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

 

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.