Senior Software Engineer

4 days ago

Tel Aviv, Tel Aviv, Israel Impala AI Full time ₪80,000 - ₪120,000 per year

About the Job

Join Impala AI, an innovative startup building a fully-managed LLM-inference platform, that enables data heavy enterprises to perform any AI task at any scale without limits.

We're looking for an
Experienced Software Engineer
to join our founding team. You'll be responsible for building and optimizing scalable cloud infrastructure solutions tailored for AI workloads. This role offers a unique opportunity to directly shape our infrastructure strategy, improve system reliability and performance, and contribute to establishing Impala AI as a leader in adaptive AI compute management.

Join us to tackle the magic that make AI tick under the hood and build the backbone powering the AI revolution.

What You'll Do

  • Design and implement the control plane that orchestrates distributed inference across cloud GPU infrastructure.
  • Own backend systems responsible for job scheduling, SLA tracking, usage metering, tenancy, auth, and data coordination.
  • Build robust APIs that glue together infra automation, ML workloads, and user-facing dashboards.
  • Work across multiple cloud providers and BYOC environments—build systems that expect chaos and still work.
  • Collaborate with infra, ML, and product teams to abstract complex infra flows into clean interfaces.
  • Help define system architecture and lay the groundwork for a platform that adapts to varied customer deployments.

What You'll Bring

  • 5+ years of experience building backend systems and APIs in cloud production environments.
  • Fluency in Python, with solid experience in designing clean service boundaries.
  • Experience building distributed systems or control planes—Kubernetes operators, service meshes, autoscaling logic, etc.
  • Familiarity with cloud-native tooling: Terraform, Docker, Helm, Prometheus, etc.
  • Strong systems thinking: ability to model complex workflows and build abstractions that last.
  • Comfort navigating messy multi-cloud (AWS - Must), multi-tenant, BYOC architectures.
  • Ability to thrive in ambiguity and take ownership from idea to deployment.
  • Self-motivated and able to operate independently in a fast-moving startup environment.
  • A collaborative team player with strong interpersonal skills, a positive and easygoing attitude, and the potential to grow into a leadership role.

Bonus Points

  • Background in infrastructure, DevOps, or ML platforms.
  • Experience with serverless orchestration and async compute models.
  • Passion for building developer tools and internal platforms.
  • Contributions to open-source infra projects or devtools.
  • Familiarity with SLA-driven compute or HPC-style schedulers.

  • Senior Software Engineer

    1 week ago

    Tel Aviv, Tel Aviv, Israel Siemens EDA (Siemens Digital Industries Software) Full time ₪90,000 - ₪120,000 per year

    We are SiemensTo create a better future, you need to think outside the box. That's why we at Siemens need innovators who aren't afraid to push boundaries to join our diverse team of tech gurus. Got what it takes? Then help us create lasting, positive impactSiemens EDA, is a global technology leader in Electronic Design Automation, providing software...

  • Senior Software Engineer

    1 week ago

    Tel Aviv, Tel Aviv, Israel Galil Software Ltd. Full time ₪90,000 - ₪120,000 per year

    We are Galil Software, Israel's premier onshore outsourcing option for R&D and software services.Located in Nazareth Industrial Park, Galil Software is Israel's leading provider of software R&D Extension, QA Automation, DevOps services and Web and Mobile Projects.Since its founding in 2008, Galil Software has successfully established a proven track record...

  • Senior Software Engineer

    2 weeks ago

    Tel Aviv, Tel Aviv, Israel JFrog Full time ₪120,000 - ₪180,000 per year

    At JFrog, we're reinventing DevOps to help the world's greatest companies innovate -- and we want you along for the ride. This is a special place with a unique combination of brilliance, spirit, and just all-around great people. Here, if you're willing to do more, your career can take off. And since software plays a central role in everyone's lives, you'll...

  • Senior Software Engineer

    1 week ago

    Tel Aviv, Tel Aviv, Israel Tweezr Full time

    Company DescriptionTweezr is a pioneering AI-powered surgical code assistant that enhances developer productivity in legacy environments. By accurately identifying necessary changes across millions of lines of code without disrupting critical functionality, Tweezr offers a solution to the limitations of legacy systems and the risks of expensive and...

  • Senior Software Engineer

    2 weeks ago

    Tel Aviv, Tel Aviv, Israel Caura-AI Full time ₪90,000 - ₪120,000 per year

    Company DescriptionCaura-AI is revolutionizing AI interactions by building the identity and long-term memory operating system for AI. Our platform enables AI systems to remember user interactions and emotional context, creating deeply personalized experiences that persist over time. We offer persistent memory infrastructure, a LLM-agnostic API, an emotional...

  • Senior Software Engineer

    2 weeks ago

    Tel Aviv, Tel Aviv, Israel Nucleai Full time $90,000 - $120,000 per year

    Role DescriptionWe're building the fastest brain in digital pathology and we need you.We work with the greatest pharma companies, the most distinguished academic institutions, and the best hospitals on the planet. From cancer to psoriasis to IBD, join our AI-powered app & services software team and help advance precision medicine matching the right...

  • Senior Software Engineer

    4 days ago

    Tel Aviv, Tel Aviv, Israel Check Point Software Full time ₪80,000 - ₪150,000 per year

    Why Join Us?You'll join a high-impact team defining the future of mobile protection through cutting-edge research, smart engineering, and large-scale data-driven and AI based detection.If you're ready to push boundaries, grow your expertise, and build technology that defines the standard for mobile cybersecurity, come lead with us.Major ResponsibilitiesJoin...

  • Senior Software and Algorithm Engineer

    1 week ago

    Tel Aviv, Tel Aviv, Israel Ultima Genomics Full time ₪80,000 - ₪120,000 per year

    We are looking for a highly motivated Senior Software and Algorithm Engineer to join our team As a Senior Software and Algorithm Engineer you will help us with implementing innovative bioinformatics algorithms and extracting more insights from the data our product generates. How You'll ContributeParticipate in the architecture and software design of...

  • Senior Software Engineer

    4 days ago

    Tel Aviv, Tel Aviv, Israel Walmart Aspectiva Full time

    Senior Software EngineerAspectiva is Walmart's first acquisition in Israel, and has become an integrated part of the core of Walmart's e-commerce, the largest retailer in the worldWe develop state-of-the-art NLP solutions that enable millions of Walmart's shoppers to make smarter and more confident buying decisions.We're growing and are currently looking for...

  • Senior Quantization Software Engineer

    2 weeks ago

    Tel Aviv, Tel Aviv, Israel Experis Israel Full time ₪120,000 - ₪240,000 per year

    #WeAreHiring - Senior Quantization Software Engineer Tel-Aviv I HybridThe GroupOur Deep Learning group is dedicated to developing cutting-edge AI HW & SW solutions for computer vision in the embedded world. We play a major role in the development and integration of key features for smartphones, the automotive industry, and more.What will your day-to-day...