Senior Developer, AI Inference Storage Systems

2 weeks ago

Center District, Israel Lightbits Labs Full time ₪120,000 - ₪180,000 per year

Senior Developer, AI Inference Storage Systems

Position Overview

We are looking for an experienced senior developer to design and build high-performance storage & networking systems optimized for AI inference workloads, particularly large language models (LLMs). This role involves developing scalable, GPU-accelerated solutions integrated with storage infrastructure that integrates tightly with modern AI inference frameworks and distributed architectures.

Key Responsibilities

  • Design and implement scalable storage solutions tailored for AI/ML inference pipelines.
  • Optimize data pipelines, caching, and I/O patterns to maximize GPU utilization and minimize inference latency.
  • Research and prototype innovative storage–compute co-design approaches for transformer-based models.
  • Stay current with advancements in distributed storage, high-performance networking, and AI inference technologies.
  • Contribute to open-source AI infrastructure projects where applicable.
  • Experience with high scale distributed systems and ML systems.

Required Qualifications

  • Expert-level Python and proficient Rust programming skills.
  • Strong knowledge of distributed storage architectures, object storage, and high-performance filesystems.
  • Hands-on experience with GPU acceleration technologies (CUDA, NCCL, NIXL, RoCM) and GPU memory management.
  • Familiarity with AI/ML frameworks and transformer model architectures.
  • Excellent problem-solving, debugging, and performance optimization skills.
  • Self-motivated, able to work independently in fast-paced, innovative environments.

Way to stand out

  • Experience with high-performance networking protocols (InfiniBand, RoCE).
  • Knowledge of HPC technologies (MPI, NVLink).
  • Experience with LLM frameworks like
    vLLM
    /
    TensorRT-LLM
    /
    ai-dynamo
    .
  • Experience with LMCache

  • Senior Storage Engineer

    1 week ago

    Raanana, Center District, Israel Unilink Ltd. Full time ₪80,000 - ₪120,000 per year

    Storage EngineerWe are looking for an experiencedStorage Engineerto join ourCore Infrastructure Department, responsible for the company's servers, storage, networking, and database systems.In this role, you will design, manage, and maintain enterprise storage systems usingNetAppandDellEMCtechnologies. You'll ensure optimal performance, high availability, and...

  • System and Storage Engineer

    6 days ago

    Gan Soreq, Center District, Israel Ampstek Full time ₪90,000 - ₪150,000 per year

    Job Title: System and Storage EngineerLocation: Gan Sorek and Haifa, Israel - OnsiteEmployment Type: ContractDescription:Mandatory : Trellix suite implementation, Virtualization, Backup and Storage, PKI implementation.Work with technical teams and end users to understand business requirements to implement the designed infrastructure solutions• Work with...

  • Generative AI Engineer

    1 week ago

    Raanana, Center District, Israel AllCloud Full time ₪120,000 - ₪240,000 per year

    About AllCloudAllCloud is a global professional services company that provides organizations with cloud enablement and transformation tools. As an AWS Premier Consulting Partner and audited MSP, a Salesforce Platinum Partner, and a Snowflake Premier Partner, AllCloud helps clients connect their front and back offices by building a new operating model to...

  • Generative AI Engineer

    5 days ago

    Raanana, Center District, Israel Integress, Inc. Full time ₪120,000 - ₪180,000 per year

    About The PositionAbout AllCloudAllCloud is a global professional services company that provides organizations with cloud enablement and transformation tools. As an AWS Premier Consulting Partner and audited MSP, a Salesforce Platinum Partner, and a Snowflake Premier Partner, AllCloud helps clients connect their front and back offices by building a new...

  • Senior AI Developer

    2 weeks ago

    Raanana, Center District, Israel Unilink Ltd. Full time ₪90,000 - ₪120,000 per year

    We're Hiring:Senior AI Developer – Agentic AI SolutionsAre you passionate about building next-generation AI systems that drive real business impact? Join our growing Agentic AI team as a Senior AI Developer and help architect and develop intelligent, production-grade agents and RAG systems that transform how enterprises operate.What You'll Do:Design and...

  • Senior AI

    3 days ago

    Netanya, Center District, Israel Start Full time ₪120,000 - ₪240,000 per year

    We're looking for a highly skilled, independent, and driven Artificial Intelligence Engineer to lead the design and development of our next-generation real-time inference services - the core engine powering 's algorithmic decision-making at scale. This is a rare opportunity to own the system at the heart of our product, serving billions of daily requests...

  • Storage Specialist 5134

    2 weeks ago

    Center District, Israel INGIMA Full time ₪60,000 - ₪120,000 per year

    We are looking for a skilled Storage Specialist to join the System Team.In this role, you will be responsible for designing, managing, and maintaining the company's storage systems based on technologies from NetApp, DellEMC, ensuring high performance, availability, and maximum data security. This expert will be responsible for the ongoing management and...

  • Storage Engineer

    6 days ago

    Yaqum, Center District, Israel Datacube Full time ₪80,000 - ₪120,000 per year

    Experienced Linux Storage Engineer for a Large OrganizationKey Responsibilities:Perform ongoing maintenance, troubleshooting, and version upgrades for storage systems.Optimize and improve storage performance.Design and implement backup and recovery solutions (Snapshot, SnapMirror, SnapVault).Monitor system performance and manage storage capacity.Collaborate...

  • System and Storage Engineer

    2 weeks ago

    Gan Soreq, Center District, Israel Ampstek Full time ₪90,000 - ₪120,000 per year

    Location: Israel (Customer premises in Gan Sorek and Haïfa)Mandatory : Trellix suite implementation, Virtualization, Backup and Storage, PKI implementation.Work with technical teams and end users to understand business requirements to implement the designed infrastructure solutions• Work with the project delivery manager and act as an IT System expert for...

  • Engineer – System and Storage

    18 hours ago

    Gan Soreq, Center District, Israel Ampstek Full time ₪90,000 - ₪120,000 per year

    Job Details:Mandatory :• Trellix suite implementation, Virtualization, Backup and Storage, PKI implementation.• Work with technical teams and end users to understand business requirements to implement the designed infrastructure solutions• Work with the project delivery manager and act as an IT System expert for delivering the infrastructure solution...