Senior ML Backend Engineer

As a
Senior Machine Learning Backend Engineer
, you'll architect and build the high-performance backend systems that power Gong's AI at massive scale, craft real-time ML serving innovative solutions, and play a pivotal role in our mission to revolutionize the way companies understand their customer interactions. We're seeking a Java professional who can leverage their deep knowledge to drive our backend development to new heights.

You Will Be Responsible For

• ML Serving Architecture: Design and implement high-performance inference APIs and model serving backends using Java & Python.
• Model Lifecycle Management: Build systems for model versioning, A/B testing, canary deployments, and automated rollbacks.
• Integration Platform: Create robust APIs and SDKs that enable product teams to seamlessly integrate AI capabilities.
• Observability & Monitoring: Build comprehensive metrics, logging, and tracing systems for ML workloads.
• Cross-team Leadership: Mentor engineers & researchers, drive technical decisions, and influence platform architecture across the organization.

You Should Apply If You Have

• 6+ years of hands-on experience in large-scale backend development, with strong emphasis on Java programming and building high-performance AI/ML inference systems.
• Strong analytical and problem-solving skills, with the ability to debug and resolve complex technical issues in AI applications serving millions of requests daily.
• Experience with cloud platforms (AWS preferred, Azure, or Google Cloud) and building scalable microservices architectures for AI model serving and data processing pipelines.
• Advantageous experience with ML frameworks (TensorFlow, PyTorch), model serving platforms (Triton, TorchServe, KServe), and building high-throughput AI-powered APIs and data processing systems.
• Excellent communication skills, both verbal and written, with the ability to articulate technical AI system design decisions clearly and collaborate effectively with ML engineers, data scientists, and DevOps teams.
• A Bachelor's degree in Computer Science, Engineering, or a related field is preferred. Experience with AI/ML systems in production environments is highly valued.
• We operate in a flexible hybrid work model.

What makes the Model-Serving team at Gong unique?
AI is central to Gong's value delivery, and our team sits at the heart of this mission. We bridge research and infrastructure—developing both cutting-edge AI models and the robust serving platform that powers them at scale.

Our focus is building a unified, high-performance AI serving platform that enables seamless deployment from research to production. We're scaling our team to support Gong's rapid evolution into an AI-first company.

About Us
Gong empowers everyone in revenue teams to improve productivity, increase predictability, and drive revenue growth by deeply understanding customers and business trends; driving impactful decisions and actions. The Gong Revenue AI Platform captures and contextualizes customer interactions, surfaces insights and predictions, and powers actions and workflows that are essential for business success. More than 4,500 companies around the world rely on Gong to unlock their revenue potential. For more information, visit

Gong is an equal-opportunity employer. We believe that diversity is integral to our success, and do not discriminate based on race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, military status, genetic information, or any other basis protected by applicable law.
To review Gong's privacy policy, visit

for more details.