Senior Developer, AI Inference Storage Systems

5 days ago

Center District, Israel Lightbits Labs Full time $104,000 - $130,878 per year

Senior Developer, AI Inference Storage Systems

Position Overview

We are looking for an experienced senior developer to design and build high-performance storage & networking systems optimized for AI inference workloads, particularly large language models (LLMs). This role involves developing scalable, GPU-accelerated solutions integrated with storage infrastructure that integrates tightly with modern AI inference frameworks and distributed architectures.

Key Responsibilities

  • Design and implement scalable storage solutions tailored for AI/ML inference pipelines.
  • Optimize data pipelines, caching, and I/O patterns to maximize GPU utilization and minimize inference latency.
  • Research and prototype innovative storage–compute co-design approaches for transformer-based models.
  • Stay current with advancements in distributed storage, high-performance networking, and AI inference technologies.
  • Contribute to open-source AI infrastructure projects where applicable.
  • Experience with high scale distributed systems and ML systems.

Required Qualifications

  • Expert-level Python and proficient Rust programming skills.
  • Strong knowledge of distributed storage architectures, object storage, and high-performance filesystems.
  • Hands-on experience with GPU acceleration technologies (CUDA, NCCL, NIXL, RoCM) and GPU memory management.
  • Familiarity with AI/ML frameworks and transformer model architectures.
  • Excellent problem-solving, debugging, and performance optimization skills.
  • Self-motivated, able to work independently in fast-paced, innovative environments.

Way to stand out

  • Experience with high-performance networking protocols (InfiniBand, RoCE).
  • Knowledge of HPC technologies (MPI, NVLink).
  • Experience with LLM frameworks like
    vLLM
    /
    TensorRT-LLM
    /
    ai-dynamo
    .
  • Experience with LMCache

  • Storage Specialist

    2 weeks ago

    Center District, Israel MalamTeam Full time ₪104,000 - ₪130,878 per year

    About Malam TeamMalam Team, the largest and leading IT services group in Israel, provides a comprehensive range of computer services in information technology. We keep constantly growing as an Israeli multi-culture company with a range of people and technologies. We believe in balancing family life and career, allowing our employees flexibility. The...

  • Backup & Storage Specialist (1004747)

    2 weeks ago

    Rishon LeZion, Center District, Israel Elad Software Systems Full time $90,000 - $120,000 per year

    Elad Software Systems specializein managing and executing end-to-end projects and offer business solutions in order to help companies strengthen their relationship with end-client and improve the company's customer experience using impeccable innovative and quality solutions. We work through three different channels:Data | CRM | DigitalOur Advantage– As a...

  • Senior ML Engineer, AI Infrastructure

    2 weeks ago

    Raanana, Center District, Israel Red Hat Full time $150,000 - $200,000 per year

    The Senior Machine Learning Engineer – GenAIis responsible for designing, implementing, and operating large-scale systems and tools for AI model benchmarking, optimization, and validation. Unlike a traditional ML Engineer focused primarily on model training, this role centers onbuilding the infrastructure, automation, and services that enable systematic...

  • Backup & Storage Specialist

    2 weeks ago

    Center District, Israel comblack Full time $90,000 - $120,000 per year

    COMBLACK is recruiting a Backup & Storage SpecialistAn opportunity to join a team of experts inBackup and STORAGE, in an advanced and dynamic technological environment.What are we looking for?3+ years of experience with enterprise backup systems such as Commvault, NetBackup, or TSM – requiredExperience in backup and recovery of operating systems,...

  • Senior System Administrator

    2 weeks ago

    Lod, Center District, Israel Unilink Full time $90,000 - $120,000 per year

    We're Hiring: Senior System Administrator (On-Prem Environment)We are looking for an experiencedSystem Administrator to join our IT Infrastructureteam and take ownership of advanced on-prem environments. This is a hands-on role for someone passionate about systems, security, and automation.Responsibilities:Manage and maintain Windows Server environments...

  • Senior System Engineer

    2 weeks ago

    Petah Tikva, Center District, Israel Pixellot - AI-Automated Sports Video and Analytics Full time $125,000 - $175,000 per year

    Are you passionate about building smart, multidisciplinary systems that combine cutting-edge hardware, software, computer vision, and AI? Do you enjoy shaping product architecture and leading complex technological processes from concept to delivery?Pixellot, the global leader in AI-automated sports production, is looking for an experienced Senior System...

  • Senior Data Scientist

    2 weeks ago

    Center District, Israel comblack Full time $90,000 - $120,000 per year

    COMBLACK is hiring a Senior Data Scientist & Data ArchitectAn opportunity to lead the design and implementation of advanced data infrastructures in cloud and hybrid environments, with integration into AI, BI, and core systems in a leading government organizationWhat we are looking for:5+ years of experience in data-related roles, including at least 2 years...

  • Senior Data Scientist

    2 weeks ago

    Center District, Israel comblack Full time ₪90,000 - ₪120,000 per year

    COMBLACK is hiring a Senior Data Scientist & Data Architect An exciting opportunity to lead the design and implementation of advanced data infrastructures in a cloud and hybrid environment, with strong integration into AI, BI, and core systems within a leading government organization.What are we looking for?5+ years of experience in data-related roles,...

  • AI Engineer

    6 days ago

    Karmiel, North District, Israel LMNTiX AI Full time ₪104,000 - ₪130,878 per year

    Role OverviewWe are looking for aSoftware AI Engineerwith2-4 years of experiencewho can build and deploy AI systems with minimal supervision. You'll join at a critical pre-launch stage where your code directly shapes our AI-powered platform and architecture.Daily work involves building production AI agents, RAG systems, agentic AI workflows and LLM...

  • Senior Generative AI Engineer

    2 weeks ago

    Lod, Center District, Israel Bank Leumi בנק לאומי Full time ₪104,000 - ₪130,878 per year

    Senior Generative AI EngineerBank Leumi is seeking a highly skilled Senior Generative AI Engineer to join our data science team and shape the future of banking with cutting-edge AI solutions. This hands-on role combines deep technical expertise with strategic vision, driving the development and deployment of next-generation Generative AI applications at...