Seamless Performance Acceleration for AI Developers Everywhere
To scale the AI opportunity, developers need access to the fastest methods of AI deployment, together with optimal performance for the most demanding next-generation workloads. Arm Kleidi, inspired by the Greek word for ‘key,’ aims to provide the key to effortless AI acceleration on Arm for every developer, every model, and every workload. Kleidi intends to encompass a broad program of software and community engagements for accelerating AI.
The First Deliverable of Arm Kleidi: Arm Kleidi Libraries
The Arm Kleidi program begins with our new KleidiAI and KleidiCV performance libraries – lightweight kernels designed for rapid and easy integration into the most popular AI frameworks.
Arm Kleidi Libraries are a lightweight suite of highly performant open-source Arm routines that make it easy for any machine learning (ML) and computer vision (CV) framework to target optimum performance and leverage the latest features for enhancing AI and CV in initially Arm Cortex-A CPU designs. The libraries are designed for ease of adoption into C or C++ ML and AI frameworks and to achieve significant acceleration for the models that run on them.
Arm Kleidi can help ensure that frameworks and compilers now accelerate AI so that developers don’t have to.
Features and Benefits of Arm Kleidi Libraries
Flexible Kernel Assortment
Arm Kleidi provides a flexible assortment of kernels for enhancing AI on frameworks. It offers broad scope for multifaceted AI advancement on Arm, from enabling more capability or accuracy for AI, to achieving accelerations or reducing memory overhead.