AI/ML Engineer – Microcode Generation Tools

5 days ago

Tel Aviv, Tel Aviv, Israel GSI Technology Full time ₪80,000 - ₪120,000 per year

AI/ML Engineer – Microcode Generation Tools

Location: Ramat Hahayal, Tel Aviv

Employer: GSI Israel

Term: Full-time Position

GSI is pioneering the Gemini APU — a next-generation Associative Processing Unit designed to accelerate AI workloads including large language models, deep learning inference, and high-throughput data processing.

We are seeking an inventive and technically strong AI/ML Engineer to develop intelligent tooling that automates and optimizes microcode generation for GSI's APL (Associative Processing Language).

This role blends machine learning, compiler design, and low-level systems expertise to transform how firmware and microcode are written for our custom APU architecture
.

What You'll Be Owning

  • Design and implement AI-assisted tools that generate or optimize APL microcode for the Gemini APU.
  • Develop ML-driven and heuristic-based models to map high-level operations into efficient APL syntax.
  • Build and fine-tune Retrieval-Augmented Generation (RAG) models that leverage technical documentation, instruction manuals, and code repositories to generate accurate and hardware-aware microcode.
  • Collaborate closely with firmware, compiler, and architecture teams to understand instruction constraints, dataflow, and scheduling.
  • Prototype code-generation pipelines combining C++ and Python for hybrid AI-assisted toolchains.
  • Profile and analyze generated code to ensure optimal utilization of compute units, memory, and bandwidth.
  • Build automation, validation, and visualization frameworks to accelerate microcode development.
  • Continuously refine generation quality and intelligence using performance feedback and hardware traces.

Qualifications

  • B.Sc. or M.Sc. in Computer Science, Electrical Engineering, or Software Engineering.
  • 5+ years of hands-on experience in C++ systems development, compiler internals, or firmware/toolchain engineering.
  • 2+ years of hands-on AI/ML engineering experience, including model development, fine-tuning, or application for automation and code generation.
  • Strong understanding of processor architecture, vectorization, and memory hierarchies.
  • Experience with code generation, compiler backends, or low-level optimization.

Preferred Qualifications

  • Understanding hardware-aware optimization, scheduling algorithms, and GPU architecture.
  • Proficiency in C++ and familiarity with Python-based ML frameworks (e.g., PyTorch, TensorFlow, scikit-learn).
  • Experience developing or integrating RAG pipelines for contextual model reasoning or code synthesis.
  • Experience integrating AI-assisted code generation into production tool chains.
  • Familiarity with retrieval systems, embedding-based search, or domain adaptation for LLMs.

Why Join Us

Join a team shaping the intersection of AI and hardware design. At GSI, you'll pioneer tools that combine retrieval-augmented intelligence with deep architectural understanding, redefining how microcode is built and optimized for associative computing.

Privacy Statement

All applications will be handled with strict confidentiality. Your information will not be shared without your consent.

  • Microcode SW Engineer

    5 days ago

    Tel Aviv, Tel Aviv, Israel GSI Technology Full time ₪120,000 - ₪240,000 per year

    Microcode SW Engineer for LLM / VLM applicationsLocation: Ramat Hahayal , Tel -AvivEmployer: GSI IsraelTerm: Full-time PositionGSI is pioneering the Gemini APU—a cutting-edge, game-changing processor designed to accelerate compute-intensive tasks like large language models, machine learning, advanced image processing, and radar imaging.If you're passionate...

  • AI Engineer

    3 days ago

    Tel Aviv, Tel Aviv, Israel Spacial AI Full time ₪70,000 - ₪120,000 per year

    About Spacial:Spacial is revolutionizing the construction and design industry with an all-in-one platform that connects architects, engineers, builders, and homeowners.Our mission is to empower professionals with cutting-edge technology that streamlines workflows, reduces costs, and boosts productivity.By offering a unified solution covering the entire...

  • AI/ML Engineer

    2 weeks ago

    Tel Aviv, Tel Aviv, Israel Dream Full time ₪120,000 - ₪180,000 per year

    Dream is a pioneering AI cybersecurity company delivering revolutionary defense through artificial intelligence. Our proprietary AI platform creates a unified security system safeguarding assets against existing and emerging generative cyber threats. Dream's advanced AI automates discovery, calculates risks, performs real-time threat detection, and plans an...

  • AI/ML Infrastructure Engineer

    2 weeks ago

    Tel Aviv, Tel Aviv, Israel Millennium Management Full time ₪100,000 - ₪200,000 per year

    AI/ML Infrastructure EngineerThis role is a member of the AI/ML Infrastructure Engineering team and will be dedicated to implementing and supporting AI/ML infrastructure solutions in cloud and on-premise environments. The role will work directly with infrastructure teams and potentially face off with data scientists, machine learning engineers, application...

  • AI/ML Infrastructure Engineer

    2 weeks ago

    Tel Aviv, Tel Aviv, Israel Millennium Full time ₪120,000 - ₪180,000 per year

    AI/ML Infrastructure EngineerThis role is a member of the AI/ML Infrastructure Engineering team and will be dedicated to implementing and supporting AI/ML infrastructure solutions in cloud and on-premise environments. The role will work directly with infrastructure teams and potentially face off with data scientists, machine learning engineers, application...

  • AI/ML Infrastructure Engineer

    2 weeks ago

    Tel Aviv, Tel Aviv, Israel Millennium Full time ₪120,000 - ₪240,000 per year

    This role is a member of the AI/ML Infrastructure Engineering team and will be dedicated to implementing and supporting AI/ML infrastructure solutions in cloud and on-premise environments. The role will work directly with infrastructure teams and potentially face off with data scientists, machine learning engineers, application developers, and quantitative...

  • Generative AI QA Engineer

    3 days ago

    Tel Aviv, Tel Aviv, Israel Rekor Full time ₪100,000 - ₪150,000 per year

    Rekor Systems, Inc.) (NASDAQ: REKR) is a trusted global authority on Roadside Intelligence, providing innovative solutions that make the world safer, smarter, and more efficient. Rekor's products combine IoT technology, connected vehicle telemetry data, computer vision, and machine learning to power the future of Public Safety, Urban Mobility, and Traffic...

  • AI Chip Software Embedded Engineer

    3 days ago

    Tel Aviv, Tel Aviv, Israel GSI Technology Full time ₪90,000 - ₪120,000 per year

    AI Chip Software Embedded EngineerLocation: Ramat Hahayal, Tel AvivEmployer: GSI IsraelTerm: Full-time PositionGSI is pioneering the Gemini APU — a next-generation Associative Processing Unit designed to accelerate AI workloads including large language models, deep learning inference, and high-throughput data processing.We are seeking an inventive and...

  • Generative AI QA Engineer

    3 days ago

    Tel Aviv, Tel Aviv, Israel Rekor Full time $120,000 - $180,000 per year

    Rekor Systems, Inc. ) (NASDAQ: REKR) is a trusted global authority on Roadside Intelligence, providing innovative solutions that make the world safer, smarter, and more efficient. Rekor's products combine IoT technology, connected vehicle telemetry data, computer vision, and machine learning to power the future of Public Safety, Urban Mobility, and Traffic...

  • Generative AI QA Engineer

    3 days ago

    Tel Aviv, Tel Aviv, Israel Rekor Systems, Inc. Full time $80,000 - $120,000 per year

    DESCRIPTIONRekor Systems, Inc. ) (NASDAQ: REKR) is a trusted global authority on Roadside Intelligence, providing innovative solutions that make the world safer, smarter, and more efficient. Rekor's products combine IoT technology, connected vehicle telemetry data, computer vision, and machine learning to power the future of Public Safety, Urban Mobility,...