Senior Manager

Job Summary:

Capital One is seeking a Senior Manager in Generative AI Product Engineering to lead a team in building and maintaining APIs and SDKs for training, fine-tuning, and accessing AI models at scale. In this role, you will collaborate with the Enterprise AI team to enable users to work with Large-Language Models (LLMs) and Foundation Models (FMs) using public cloud infrastructure. You will lead a team of AI engineers and researchers to design and implement key API products and services, empowering real-time customer-facing applications.

Job Duties and Responsibilities:

• Architect, build, and deploy well-managed core APIs and SDKs to access LLMs and proprietary FMs, including training, fine-tuning, and prompting tasks, along with orchestration SDKs.
• Design APIs for performance, real-time applications, scale, ease of use, and governance automation.
• Develop application-specific interfaces leveraging LLMs and FMs to enhance the associate and customer experience.
• Enable users to build new AI capabilities.
• Develop tools and processes to monitor API access patterns and operational health.
• Design and implement AI safety and guardrails in the API layer, collaborating closely with researchers.

Qualifications and Experience:

• Bachelor’s degree in Computer Science, Computer Engineering, or a technical field.
• At least 8 years of experience programming with Python, Go, Scala, or C/C++.
• At least 5 years of experience designing, building, and deploying ML applications.
• At least 2 years of experience mentoring and leading teams developing AI and Machine Learning solutions.
• At least 4 years of people management experience.

Preferred Qualifications:

• Familiarity with building large-scale AI products or platforms for NLP, speech, computer vision, or recommendation systems serving millions of users.
• Ability to thrive in a fast-paced environment with ambiguity and competing priorities and deadlines.
• Experience at tech and product-driven companies/startups preferred.
• Ability to iterate rapidly with researchers and engineers to improve product experience while building foundational capabilities.

Benefits:

• Performance-based incentive compensation, including cash bonuses and long-term incentives.
• Comprehensive health, financial, and other benefits supporting total well-being.
• Opportunities for career growth and development within Capital One.
• Inclusive and supportive work environment fostering personal and professional growth.

About Comapny:

Join Capital One in its mission to create trustworthy, reliable, and human-in-the-loop AI systems, transforming the banking industry for good. Lead a team in building cutting-edge AI capabilities that reimagine how we serve our customers and businesses.