Senior ML Backend Engineer

7 days ago

Tel Aviv, Tel Aviv, Israel Gong Full time ₪104,000 - ₪130,878 per year

As a
Senior Machine Learning Backend Engineer
, you'll architect and build the high-performance backend systems that power Gong's AI at massive scale, craft real-time ML serving innovative solutions, and play a pivotal role in our mission to revolutionize the way companies understand their customer interactions. We're seeking a Java professional who can leverage their deep knowledge to drive our backend development to new heights.

You Will Be Responsible For

  • ML Serving Architecture: Design and implement high-performance inference APIs and model serving backends using Java & Python.
  • Model Lifecycle Management: Build systems for model versioning, A/B testing, canary deployments, and automated rollbacks.
  • Integration Platform: Create robust APIs and SDKs that enable product teams to seamlessly integrate AI capabilities.
  • Observability & Monitoring: Build comprehensive metrics, logging, and tracing systems for ML workloads.
  • Cross-team Leadership: Mentor engineers & researchers, drive technical decisions, and influence platform architecture across the organization.

You Should Apply If You Have

  • 6+ years of hands-on experience in large-scale backend development, with strong emphasis on Java programming and building high-performance AI/ML inference systems.
  • Strong analytical and problem-solving skills, with the ability to debug and resolve complex technical issues in AI applications serving millions of requests daily.
  • Experience with cloud platforms (AWS preferred, Azure, or Google Cloud) and building scalable microservices architectures for AI model serving and data processing pipelines.
  • Advantageous experience with ML frameworks (TensorFlow, PyTorch), model serving platforms (Triton, TorchServe, KServe), and building high-throughput AI-powered APIs and data processing systems.
  • Excellent communication skills, both verbal and written, with the ability to articulate technical AI system design decisions clearly and collaborate effectively with ML engineers, data scientists, and DevOps teams.
  • A Bachelor's degree in Computer Science, Engineering, or a related field is preferred. Experience with AI/ML systems in production environments is highly valued.
  • We operate in a flexible hybrid work model.

What makes the Model-Serving team at Gong unique?
AI is central to Gong's value delivery, and our team sits at the heart of this mission. We bridge research and infrastructure—developing both cutting-edge AI models and the robust serving platform that powers them at scale.

Our focus is building a unified, high-performance AI serving platform that enables seamless deployment from research to production. We're scaling our team to support Gong's rapid evolution into an AI-first company.

About Us
Gong empowers everyone in revenue teams to improve productivity, increase predictability, and drive revenue growth by deeply understanding customers and business trends; driving impactful decisions and actions. The Gong Revenue AI Platform captures and contextualizes customer interactions, surfaces insights and predictions, and powers actions and workflows that are essential for business success. More than 4,500 companies around the world rely on Gong to unlock their revenue potential. For more information, visit

Gong is an equal-opportunity employer. We believe that diversity is integral to our success, and do not discriminate based on race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, military status, genetic information, or any other basis protected by applicable law.
To review Gong's privacy policy, visit

for more details.

  • Senior Backend Engineer

    1 week ago

    Tel Aviv, Tel Aviv, Israel my team Full time ₪120,000 - ₪180,000 per year

    We are seeking a highly motivated and talented Senior Backend Engineer to join our growing engineering team. In this role, you will play a crucial part in designing, developing, and maintaining the core backend infrastructure of our platform. You will be responsible for building scalable, high-performance systems that leverage the latest AI/ML technologies...

  • Senior Backend Engineer

    7 days ago

    Tel Aviv, Tel Aviv, Israel Rhino Federated Computing Full time ₪80,000 - ₪160,000 per year

    About the roleThe Senior Backend Engineer will be responsible for enhancing and scaling Rhino's Federated Computing Platform (FCP), used around the world to power cutting edge AI/ML research and development for healthcare and other regulated industries, ultimately driving a shift in innovation and delivery in these industries. You will be responsible for...

  • Senior Backend Engineer

    5 days ago

    Tel Aviv, Tel Aviv, Israel Rhino Federated Computing Full time ₪60,000 - ₪180,000 per year

    About the role The Senior Backend Engineer will be responsible for enhancing and scaling Rhino's Federated Computing Platform (FCP), used around the world to power cutting edge AI/ML research and development for healthcare and other regulated industries, ultimately driving a shift in innovation and delivery in these industries. You will be responsible for...

  • Senior Backend Engineer

    5 days ago

    Tel Aviv, Tel Aviv, Israel Rhino Federated Computing Full time ₪80,000 - ₪120,000 per year

    About Rhino Federated ComputingRhino Federated Computing Rhino solves one of the biggest challenges in AI: seamlessly connecting siloed data through federated computing. The Rhino Federated Computing Platform (Rhino FCP) serves as the 'data collaboration tech stack', extending from providing computing resources to data preparation & discoverability, to model...

  • Senior BackEnd Engineer

    2 weeks ago

    Tel Aviv, Tel Aviv, Israel QuantHealth Full time ₪90,000 - ₪120,000 per year

    Senior BackEnd Engineer (Python)QuantHealth (QH) is an AI startup in the clinical trial space, leveraging AI and big data to simulate and optimize trials for pharmaceutical companies. Our ability to combine large biomedical datasets with vast amounts of patient data allows our customers to simulate their clinical trials in a SaaS environment to make them...

  • Senior Backend Engineer

    2 weeks ago

    Tel Aviv, Tel Aviv, Israel Sedric Full time ₪120,000 - ₪180,000 per year

    We are seeking an experienced Senior Backend Developer with deep Data Engineering expertise to join Sedric in building next-generation, AI-powered financial products. You'll architect robust data pipelines, design scalable data systems, and work directly with leading global financial institutions as they adopt cutting-edge AI solutions....

  • Senior ML Engineer

    5 days ago

    Tel Aviv, Tel Aviv, Israel ZENITY Full time ₪120,000 - ₪180,000 per year

    About Us: Zenity is the first and only holistic platform built to secure and govern AI Agents from buildtime to runtime. We help organizations defend against security threats, meet compliance, and drive business productivity. Trusted by many of the world's F500 companies, Zenity provides centralized visibility, vulnerability assessments, and governance by...

  • Senior Backend Engineer

    3 days ago

    Tel Aviv, Tel Aviv, Israel Navan Full time ₪120,000 - ₪240,000 per year

    We are seeking a skilled Senior Backend Engineer to join our team and help us build Navan Cognition, a multi-agent AI platform. The ideal candidate will have strong backend engineering expertise and enthusiasm for working with cutting-edge AI technologies.About the Role:You'll be responsible for designing and implementing backend services that integrate AI...

  • Senior Backend Engineer

    3 days ago

    Tel Aviv, Tel Aviv, Israel Navan Full time ₪120,000 - ₪200,000 per year

    We are seeking a skilled Senior Backend Engineer to join our team and help us build Navan Cognition, a multi-agent AI platform. The ideal candidate will have strong backend engineering expertise and enthusiasm for working with cutting-edge AI technologies.About The RoleYou'll be responsible for designing and implementing backend services that integrate AI...

  • Senior Backend Engineer

    1 day ago

    Tel Aviv, Tel Aviv, Israel Check Point Software Full time ₪120,000 - ₪180,000 per year

    We are looking for an experiencedSenior Backend Engineerto join ourSaaS platform team.As part of our platform team, you'll design and implement high-impact backend services, collaborate with frontend, DevOps, and product teams, and play a key role in shaping the next generation of Check Point's SaaS security architecture.You'll help build and evolve the...