
Technical Architect - AI
Encora
Posted about 3 hours ago
Job Description
Platform Architecture and Governance
- Design the enterprise AI platform architecture spanning the LLM API gateway, GPU and compute allocation pools, sandbox provisioning, model registry, and security gate automation
- Define infrastructure standards, API gateway patterns, and reference architectures consumed by all AI delivery towers and partner integrations
- Establish guardrails for token metering, rate limiting, audit logging, DLP validation, SAST, DAST, dependency scanning, and model card review embedded in CI/CD
- Review security posture across all AI workloads with mapping to NIST AI RMF, AWS Well-Architected (including the Machine Learning Lens), and applicable enterprise compliance baselines
Agentic AI and LLM Engineering
- Architect multi-agent systems using LangGraph, LangChain, and Model Context Protocol (MCP) for complex workflow orchestration, planning, and tool use
- Define patterns for ReAct, Chain-of-Thought, Tree-of-Thoughts, and agent-to-agent coordination across enterprise and customer-facing use cases
- Design and optimize Retrieval-Augmented Generation (RAG) systems, embedding strategies, and semantic search across structured and unstructured enterprise data
- Establish MLOps and AgentOps practices for deployment, evaluation, observability, and continuous improvement of agents and models in production
AWS-Native Implementation
- Architect solutions on Amazon Bedrock, Amazon SageMaker, Amazon Q, Bedrock Agents, and Bedrock Knowledge Bases
- Define infrastructure patterns using Amazon EKS, AWS Lambda, ECS Fargate, API Gateway, EventBridge, SNS/SQS, Kinesis, S3, DynamoDB, Aurora, Redshift, Athena, OpenSearch, and Kendra
- Establish CloudFormation and AWS CDK templates and Terraform modules for isolated VPC sandboxes provisioned per project and per third-party partner
- Implement observability and FinOps using CloudWatch, AWS Cost Explorer, AWS Budgets, and chargeback reporting by team, project, and model
Salesforce and SaaS AI Integration
- Define integration architecture with Salesforce Agentforce, Einstein, Data Cloud, and Service Cloud, including Apex, Flow, and Platform Event integration patterns with AWS-hosted agents and APIs
- Establish governance over enterprise SaaS AI licenses, including usage tracking, renewal governance, and redundancy elimination across business units
- Architect cross-system identity, authorization, and data exchange patterns spanning Salesforce, AWS, and partner endpoints
Stakeholder and Delivery Leadership
- Partner with AIDO leadership, delivery tower leads, security, compliance, procurement, and program management to ensure platform adoption and consistent operating standards
- Produce enterprise-grade architecture artifacts, decision records, and operating model documentation suitable
- Mentor engineers across delivery towers and partner teams; lead architecture reviews and technical due diligence on partner-built systems
Required Skills
Core AI Frameworks
- Expert proficiency with LangGraph, LangChain, and agent orchestration frameworks
- Deep experience with Amazon Bedrock, SageMaker, and Amazon Q, including Bedrock Agents and Knowledge Bases
- Hands-on experience with Model Context Protocol (MCP), function calling, tool use, and structured output patterns
- Strong command of prompt engineering, evaluation harnesses, fine-tuning, and model optimization
- Working knowledge of transformer architectures, attention mechanisms, and multi-modal systems
Machine Learning
- Classical ML (regression, tree-based ensembles, gradient boosting, clustering) and deep learning (CNNs, RNNs, transformers) across supervised, unsupervised, and reinforcement paradigms; feature engineering, hyperparameter optimization, cross-validation, drift detection, and model evaluation
- End-to-end ML lifecycle on SageMaker spanning data preparation, training, deployment, monitoring, and retraining
AWS Platform
- SageMaker (Studio, Pipelines, Model Registry, Inference), Bedrock, EKS, Lambda, ECS Fargate, API Gateway, Step Functions
- S3, DynamoDB, Aurora, Redshift, Athena, OpenSearch, Kendra
- EventBridge, SNS/SQS, Kinesis, MSK
- CloudWatch, X-Ray, CloudTrail, AWS Config, GuardDuty, Macie, Security Hub
- IAM, KMS, PrivateLink, VPC design, and AWS Organizations governance
Salesforce and Enterprise SaaS
- Salesforce Agentforce, Einstein, Data Cloud, Service Cloud, and Sales Cloud integration patterns
- Apex, Flow, Platform Events, and REST/Bulk API integration with external AI services
- Familiarity with enterprise identity providers, SSO, OAuth, and SCIM provisioning across SaaS estates
Programming and Development
- Advanced Python with deep FastAPI experience for scalable, async API development
- Java proficiency sufficient to integrate with existing enterprise backend services
- Strong CI/CD background using AWS CodePipeline, CodeBuild, GitHub Actions, and Infrastructure as Code via Terraform and AWS CDK
- Containerization with Docker and orchestration with Kubernetes (EKS)
Data and Vector Systems
- Vector store architectures using OpenSearch, Bedrock Knowledge Bases, Pinecone, Weaviate, or Chroma
- Embedding model selection, hybrid search, and reranking strategies
- Graph database experience (Amazon Neptune, Neo4j) for knowledge representation
- Data ingestion, masking, synthetic data generation, and DLP validation pipelines
Ideal Years Of Experience
- 20+ years in software engineering with 5+ years focused on AI/ML systems
- 3+ years hands-on experience architecting and shipping production LLM and agentic AI applications
Education
- Bachelor's or Master's degree in Computer Science, AI/ML, or a related technical field
- AWS Certified Solutions Architect Professional or AWS Certified Machine Learning Specialty preferred
- Salesforce Certified AI Associate, AI Specialist, or Application Architect credentials is a plus
Additional Requirements
Job details
Jobr Assistant extension
Get the extension →