Ascend Device Plugin

English | 中文

Introduction

This Ascend device plugin is implemented for NPU-Slicing for HAMi and volcano. It supports two modes:

1. Template-based Hard Slicing (vNPU)

Memory slicing is supported based on virtualization template. For detailed information, check template

2. Soft Slicing with Runtime Interception (hami-vnpu-core)

This project implements a soft slicing mechanism based on libvnpu.so interception and limiter token scheduling. For detailed information, check hami-vnpu-core

Note: hami-vnpu-core currently only supports ARM platforms.

Deployment & Usage

Prerequisites, deployment steps and usage examples differ depending on which scheduler you use:

• HAMi
• Volcano

Compile

update submodule:

git submodule update --init --recursive

make all

Build image

docker buildx build -t $IMAGE_NAME .

License