Sr. Technical Product Manager – AWS Neuron, Annapurna Labs

Amazon Web Services
September 22, 2022
Cupertino, CA
Job Type



Job summary

The Product: AWS Machine Learning chips are at the forefront of AWS innovation. Inferentia delivers best-in-class ML inference performance at the lowest cost in the cloud to our AWS customers. Trainium is designed to deliver the best-in-class ML training performance at the lowest training cost in the cloud, and its all being enabled by cutting edge software including an ML compiler and native integration into popular ML frameworks called Neuron. Our products are being used at scale with external customers like Snap, Anthem, Sprinklr, Airbnb, Conde Nast and Autodesk as well as internal customers like Alexa, Amazon Robotics, Amazon Ads, Amazon Rekognition and many more.

The Team: the Amazon Annapurna Labs team is a responsible for building innovation in silicon and software for our AWS customers. We are at the forefront of innovation by combining cloud scale with the worlds most talented engineers. Our team covers multiple disciplines including silicon engineering, hardware design and verification, software and operations. Because of our teams breadth of talent, we have been able to improve AWS cloud infrastructure in networking and security with products such as AWS Nitro, Enhanced Network Adapter (ENA), and Elastic Fabric Adapter (EFA), in computing with AWS Graviton and F1 EC2 instances, and high-performance machine learning with AWS Neuron, Inferentia and Trainium ML accelerators.

You: Were seeking a hands-on product manager who have a passion for developer-focused cloud software and hardware products, and are willing to work hard for their customers. Product Management in Annapurna is an opportunity to collaborate with engineering, design, and sales/business development teams to create state of the art cloud services.

In your role as Neuron product manager, you will be in charge of the customer voice within our team, tirelessly working closely with multiple internal teams and customers to develop the new Neuron features and support our growing eco-system. Your mission will be to ensure our customers find new cutting edge offerings pleasing and useful to achieve their aggressive business goals.

As a member of the Annapurna team youll dive on our technology and work closely with our internal teams, engage with leading developers and customers, and help support Annapurna's products scale to large deployments. We are looking for self-driven individuals who can collaborate with others, and that will continuously work to deliver a world-class customer experience. This is a fast-paced, hands-on, intellectually challenging position, and youll work with thought leaders in multiple business and technology areas.

Youre a good fit if (a) you can think big and are able to break down the big picture into measurable goals, (b) you have an instinctive understanding of what makes products successful and easy to deploy, and can raise the bar on delivering features beneficial to our customer, (c) you can dive into technical details and ask engineers insightful questions about the services that you own, and finally (d) you can think long-term, can balance conflicting interests and priorities, and converge on outcomes that earn trust and customer loyalty.

In this role you will:

  • Work directly with software engineering teams to define and execute on new features.

  • Produce clear, concise documents such as functional or technical specifications.

  • Write user stories and perform user acceptance testing.

  • Anticipate bottlenecks, manage risk and escalations, and balance business needs against technical constraints.

  • Find opportunities to innovate on behalf of our customers, design features related to these opportunities, and always push to improve our product user experience.

  • Drive feature discussions with customers, engineering, and other stakeholders.

  • Stay connected with industry counterparts and gain insights on technology trends.

About Us

Inclusive Team Culture

Here at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazons culture of inclusion is reinforced within our 14 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust.

Work/Life Balance

Our team puts a high value on work-life balance. It isnt about how many hours you spend at home or at work; its about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives.

Mentorship & Career Growth

Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and were building an environment that celebrates knowledge sharing and mentorship. Our senior members enjoy one-on-one mentoring. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded engineer and enable them to take on more complex tasks in the future.


  • Bachelors degree or higher in Computer Science or related field

  • 8+ years of industry experience, with 4+ years in product management, or customer facing roles. Knowledge in full product life cycles, including technical specifications, development, go-to-market, pricing, customer facing presentations and collaboration with engineering and sales teams.

  • Solid knowledge in computer architecture fundamentals, operating systems and cloud infrastructure engineering concepts

  • Ability to work in a fast paced and agile work environment with demonstrated collaboration skills and demonstrated strengths in driving through complexity, ambiguity, and unknowns in early-stage programs

  • Proven experience in delivering modern software products, preferably collaborative open-source projects


  • Have experience delivering technology products/services in a high growth environment where priorities shift fast

  • Proven experience developing products in cloud environments, especially around new services involving inter-disciplinary capabilities and knowledgeability to define high-quality roadmaps based on team strategy and vision

  • Familiarity with AWS services

  • Hands on experience with at least one major ML framework: TensorFlow, or PyTorch

  • Experience with Machine Learning acceleration, model optimization and profiling

  • Meets/exceeds Amazons leadership principles requirements for this role

  • Meets/exceeds Amazons functional/technical depth and complexity for this role

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit

Only registered members can apply for jobs.