AI Infra Engineer

2 weeks ago

Tel Aviv, Tel Aviv, Israel ScaleOps Full time $120,000 - $160,000 per year

About ScaleOps
ScaleOps is the leader in real-time automated cloud resource management, helping enterprises revolutionize the way they manage cloud-native application infrastructures. Our platform dynamically allocates application resources, delivering up to 80% in cloud cost savings while boosting performance and eliminating manual intervention. With $80M+ in backing and over 50 global enterprise customers (including Wiz, SentinelOne, Orca Security, and Playtika), ScaleOps is scaling fast – and now, we are expanding into
AI Infrastructure
.

We are looking for an
AI Infra Engineer
to design, build, and optimize the infrastructure that powers large-scale AI/ML workloads in the cloud. This role is highly technical and hands-on, ideal for engineers with deep expertise in distributed systems, GPUs, and ML infra who want to shape the future of AI performance and cost efficiency.

What You'll Do

  • Design and implement infrastructure for training and serving large-scale AI/ML models.
  • Build systems for GPU/accelerator scheduling, orchestration, and optimization on Kubernetes-based environments.
  • Develop solutions for efficient resource management, workload scheduling, and cost optimization in AI workloads.
  • Collaborate with backend and product teams to integrate AI infrastructure into ScaleOps's core platform.
  • Evaluate and adopt cutting-edge technologies in AI infra (distributed training, inference acceleration, multi-cloud GPU scaling).
  • Ensure reliability, scalability, and performance of AI/ML pipelines in production.

Requirements:

What You'll Bring

  • 5+ years of hands-on software development experience, with a strong focus on infrastructure, distributed systems, or performance engineering.
  • Proven hands-on experience in GPU orchestration and distributed training at scale.
  • Strong expertise with Kubernetes, Docker, and multi-cloud environments.
  • Experience with ML frameworks (PyTorch, TensorFlow, JAX) and large-scale training/inference pipelines.
  • Solid programming skills (Python, Go, Bash).
  • Previous experience in a company whose core product is in the AI domain
  • Familiarity with cloud cost optimization for compute- and GPU-intensive workloads – an advantage.
  • Strong ownership, problem-solving ability, and passion for building infra that powers AI.
  • Full professional fluency in English (Hebrew – advantage).

  • Senior Software Engineer

    4 days ago

    Tel Aviv, Tel Aviv, Israel Impala AI Full time ₪80,000 - ₪120,000 per year

    About the JobJoin Impala AI, an innovative startup building a fully-managed LLM-inference platform, that enables data heavy enterprises to perform any AI task at any scale without limits.We're looking for anExperienced Software Engineerto join our founding team. You'll be responsible for building and optimizing scalable cloud infrastructure solutions...

  • Data Engineering Team Lead

    13 hours ago

    Tel Aviv, Tel Aviv, Israel Orca AI Full time

    Orca AI is revolutionizing maritime operations with cutting-edge computer vision, augmented reality, and autonomous technologies. Our mission is bold: make ocean shipping safer, more efficient, and significantly greener.From real-time navigation assistance to AI-driven insights that reduce fuel consumption and prevent collisions, we're building a future...

  • Senior/VP AI/ML Engineer for video analysis

    1 week ago

    Tel Aviv, Tel Aviv, Israel Argu AI Full time ₪120,000 - ₪240,000 per year

    Senior Computer Vision Engineer - Scalable Video Intelligence SystemsLocation: Tel-Aviv / Israel (On-site)Type: Full-timeSeniority: Senior / VP / Team leaderThe MissionWe're building AI systems that watch the real world at scale - intelligently, securely, and fast. This is not just another CV startup. We're working with real-time video at the edge,...

  • AI Engineer

    2 days ago

    Tel Aviv, Tel Aviv, Israel Spacial AI Full time ₪70,000 - ₪120,000 per year

    About Spacial:Spacial is revolutionizing the construction and design industry with an all-in-one platform that connects architects, engineers, builders, and homeowners.Our mission is to empower professionals with cutting-edge technology that streamlines workflows, reduces costs, and boosts productivity.By offering a unified solution covering the entire...

  • AI Engineering Manager

    2 weeks ago

    Tel Aviv, Tel Aviv, Israel Latent AI Full time $125,000 - $175,000 per year

    About UsLatent AI is a leading AI solutions implementation partner, dedicated to helping our diverse clients solve their most complex challenges with cutting-edge technology. Our strength lies in our small, agile, and expert teams who deliver bespoke AI and machine learning solutions. We foster a culture of collaboration, innovation, and deep technical...

  • Researcher

    4 days ago

    Tel Aviv, Tel Aviv, Israel Impala AI Full time ₪80,000 - ₪120,000 per year

    About the Joboin Impala AI, an innovative startup building a fully-managed LLM-inference platform, that enables data heavy enterprises to perform any AI task at any scale without limits.We're looking for anExperienced Performance Researcherto join our founding team. You'll be responsible for building and optimizing scalable cloud infrastructure solutions...

  • AI Platform Engineer

    2 weeks ago

    Tel Aviv, Tel Aviv, Israel XM Cyber Full time ₪90,000 - ₪120,000 per year

    XM Cyber is a global leader in hybrid cloud security. XM Cyber brings a new approach that uses the attacker's perspective to find and remediate critical attack paths across on-premises and multi-cloud networks. The XM Cyber platform enables companies to rapidly prioritize and respond to cyber risks affecting their business-sensitive systems.We are seeking a...

  • AI Platform Engineer

    2 weeks ago

    Tel Aviv, Tel Aviv, Israel XM Cyber Full time ₪90,000 - ₪120,000 per year

    XM Cyber is a global leader in hybrid cloud security. XM Cyber brings a new approach that uses the attacker's perspective to find and remediate critical attack paths across on-premises and multi-cloud networks. The XM Cyber platform enables companies to rapidly prioritize and respond to cyber risks affecting their business-sensitive systems.We are seeking a...

  • Senior Python and Infra Developer

    2 weeks ago

    Tel Aviv, Tel Aviv, Israel Argu AI Full time ₪104,000 - ₪130,878 per year

    We're Hiring: Senior Python Developer (8-10 years exp) Location: Tel-Aviv / Israel Start: Immediate – Quick Hire Company: Argu Full-Time | Equity plans availableArgu is building the world's first generative engine for video analysis.Backed by the world's top-tier VCs and already deployed with national and enterprise customers, we help organizations go...

  • Software Engineer for AI

    2 weeks ago

    Tel Aviv, Tel Aviv, Israel Majestic Labs ai Full time

    Role Description:We are looking for an experienced, highly skilled and motivated Software Engineer to join our core team. In this role, you will be responsible for designing, developing, and maintaining critical components of our AI-driven software stack. You will work on the core interfaces that allow applications, frameworks, and APIs to communicate...