AI/ML Infrastructure Engineer

4 days ago


Tel Aviv, Tel Aviv, Israel Millennium Full time ₪120,000 - ₪240,000 per year

This role is a member of the AI/ML Infrastructure Engineering team and will be dedicated to implementing and supporting AI/ML infrastructure solutions in cloud and on-premise environments. The role will work directly with infrastructure teams and potentially face off with data scientists, machine learning engineers, application developers, and quantitative analysts by functioning as both a solutions architect, helping them implement their own AI/ML solutions, and as a professional services engineer, implementing solutions for them in cloud environments such as AWS, GCP, and Kubernetes.

This is a hands-on developer role and candidates ideally have had experience deploying and supporting their own production-ready AI/ML models in cloud environments as well as automating the build and management of a broad range of cloud infrastructure using tools like Terraform. Candidates should be familiar with developing unit and functional tests, have experience designing and implementing CI/CD tools with infrastructure as code pipelines, and have knowledge of Linux systems administration, containerization, networking, security, automated configuration and state management, cross-system orchestration, configuration management, logging, metrics, monitoring, and alerting.

Principal Responsibilities

  • Architect, develop and maintain internal AI/ML infrastructure components, frameworks, and offerings
  • Architect, develop and maintain AI/ML solutions for customers in cloud environments
  • Help customers architect, develop and maintain their own AI/ML solutions in cloud environments
  • Implement CI/CD pipelines which include application tests, security tests, and gates
  • Implement availability, security, performance monitoring, and alerting of AI/ML solutions
  • Automate data resiliency and replication for AI/ML models
  • Manage multiple environments and promote code between them
  • Automate systems configuration and orchestration using tools such as Terraform, Chef, Ansible, or Salt
  • Automate creation of machine images and containers

Required Qualifications/Skills

  • 6+ years of experience designing and supporting production cloud environments
  • Experience consulting with customers to develop AI/ML solutions
  • Experience developing collaboratively, including infrastructure as code, preferably in Python
  • Systems engineering knowledge, including understanding of Linux, security, and networking
  • Cloud templating tools such as Terraform
  • Experience with AI/ML frameworks (e.g., TensorFlow, PyTorch)
  • Experience with distributed computing tools (e.g., Ray, Dask)
  • Experience with model serving tools (e.g., vLLM, KFServing)
  • Experience with building, monitoring, and alerting on logs and metrics
  • Cloud Networking including connectivity, routing, DNS, VPCs, proxies, and load balancers
  • Cloud Security including IAM, Certificate Management, and Key Management
  • Excellent written and verbal communications
  • Excellent troubleshooting and analytical skills
  • Self-starter able to execute independently, on a deadline, and under pressure


  • Tel Aviv, Tel Aviv, Israel Millennium Management Full time ₪100,000 - ₪200,000 per year

    AI/ML Infrastructure EngineerThis role is a member of the AI/ML Infrastructure Engineering team and will be dedicated to implementing and supporting AI/ML infrastructure solutions in cloud and on-premise environments. The role will work directly with infrastructure teams and potentially face off with data scientists, machine learning engineers, application...


  • Tel Aviv, Tel Aviv, Israel Millennium Full time ₪120,000 - ₪180,000 per year

    AI/ML Infrastructure EngineerThis role is a member of the AI/ML Infrastructure Engineering team and will be dedicated to implementing and supporting AI/ML infrastructure solutions in cloud and on-premise environments. The role will work directly with infrastructure teams and potentially face off with data scientists, machine learning engineers, application...

  • AI/ML Engineer

    2 weeks ago


    Tel Aviv, Tel Aviv, Israel Dream Full time ₪120,000 - ₪180,000 per year

    Dream is a pioneering AI cybersecurity company delivering revolutionary defense through artificial intelligence. Our proprietary AI platform creates a unified security system safeguarding assets against existing and emerging generative cyber threats. Dream's advanced AI automates discovery, calculates risks, performs real-time threat detection, and plans an...

  • AI/ML Engineer

    4 days ago


    Tel Aviv, Tel Aviv, Israel Dream Full time ₪120,000 - ₪180,000 per year

    Dream is a pioneering AI cybersecurity company delivering revolutionary defense through artificial intelligence. Our proprietary AI platform creates a unified security system safeguarding assets against existing and emerging generative cyber threats. Dream's advanced AI automates discovery, calculates risks, performs real-time threat detection, and plans an...

  • AI/ML Engineer

    1 week ago


    Tel Aviv, Tel Aviv, Israel Dream Full time ₪60,000 - ₪180,000 per year

    Dream is a pioneering AI cybersecurity company delivering revolutionary defense through artificial intelligence. Our proprietary AI platform creates a unified security system safeguarding assets against existing and emerging generative cyber threats. Dream's advanced AI automates discovery, calculates risks, performs real-time threat detection, and plans an...


  • Tel Aviv, Tel Aviv, Israel Dream Full time ₪120,000 - ₪180,000 per year

    Dream is a pioneering AI cybersecurity company delivering revolutionary defense through artificial intelligence. Our proprietary AI platform creates a unified security system safeguarding assets against existing and emerging generative cyber threats. Dream's advanced AI automates discovery, calculates risks, performs real-time threat detection, and plans an...


  • Tel Aviv, Tel Aviv, Israel Unframe Full time ₪90,000 - ₪120,000 per year

    Job Summary As an AI Infrastructure Engineer, you'll work on the core of Unframe - building reusable AI services, scalable APIs, dynamic UI engine, and shared infrastructure that powers every solution we deliver. ResponsibilitiesDesign and implement core AI building blocks, backend services and frontend components. Work on platform-wide features such as...


  • Tel Aviv, Tel Aviv, Israel Cisco Full time ₪120,000 - ₪180,000 per year

    We welcome AI Researchers, Applied Scientists, Machine Learning Engineers, and Software Engineers with experience in large-scale systems and AI/ML to join Foundation AI, a Cisco's new group focused on developing open-source large language models (LLMs) for cybersecurity.Meet the TeamFoundation AI's mission is to secure AI transformation. The Foundation AI...


  • Tel Aviv, Tel Aviv, Israel Unframe Full time ₪90,000 - ₪120,000 per year

    Job SummaryAs an AI Infrastructure Engineer, you'll work on the core of Unframe - building reusable AI services, scalable APIs, dynamic UI engine, and shared infrastructure that powers every solution we deliver.ResponsibilitiesDesign and implement core AI building blocks, backend services and frontend components.Work on platform-wide features such as user...


  • Tel Aviv, Tel Aviv, Israel HiBob Full time ₪90,000 - ₪120,000 per year

    Job DescriptionAbout UsHiBob helps modern, mid-size businesses transform the way they manage people, giving HR and managers all they need to connect, engage, develop, and retain top talent. Since 2015, we've achieved consecutive triple-digit year-over-year growth, all backed by our amazing team of Bobbers from across the globe, making us the choice HRIS of...