This is the Arduino® compatible port of the AIfES machine learning framework, developed and maintained by Fraunhofer Institute for Microelectronic Circuits and Systems.
AIfES for Arduino®
AIfES (Artificial Intelligence for Embedded Systems) is a platform-independent and standalone AI software framework optimized for embedded systems.
The Feedforward Neural Networks (FNN) and Convolutional Neural Networks (CNN) implemented in AIfES can be freely parameterized, trained, modified or reloaded at runtime.
In this version, it is optimized for the Arduino IDE and compatible to almost any Arduino board.
AIfES is developed in the C programming language and uses only standard libraries based on the GNU Compiler Collection (GCC).
AIfES thus runs on almost any hardware from 8-bit microcontrollers over Raspberry PI to smartphones or PCs.
Not only inference of FNN and CNN is possible, but also training directly in the device. Furthermore, compatibility to other AI software frameworks such as Keras or TensorFlow is also given.
AIfES was developed by the Fraunhofer Institute for Microelectronic Circuits and Systems IMS. Additional information can be found at <www.aifes.ai>
The Fraunhofer IMS with AIfES and Arduino preapare to enter a partnership.
We are also at the Arduino Project Hub. Here you can find our new AIfES projects and examples:
https://create.arduino.cc/projecthub/aifes_team
Follow us on LinkedIn to get all the latest news about AIfES:
https://www.linkedin.com/showcase/aifes-ai
Dual License
For Maker and Open-Source-Projects (GNU AGPLv3):
For private projects or developers of Free Open Source Software (FOSS) under version 3 of the GNU Affero General Public License (AGPL), the AIfES version offered here can be used free of charge.
For use in commercial applications:
If AIfES is to be combined and distributed with commercially licensed software and/or if you do not wish to distribute the AIfES source code
for the commercially licensed software under version 3 of the GNU Affero General Public License (AGPL), you must conclude a license agreement with Fraunhofer IMS.
For more information and contact, refer to our homepage
Compatibility
AIfES in the current version supports almost all microcontroller types and Arduino boards:
- 8-Bit-Microcontroller
- 16-Bit-Microcontroller
- 32-Bit-Microcontroller
- 64-Bit-Microcontroller
Installation guides for various IDEs
We have already put the first guides to integrate AIfES in various IDEs in our GitHub repository which you can find here.
Guides for the following IDEs are available by now:
- Code::Blocks
- STMCubeIDE
- Wokwi - the simulator for Arduino / ESP32
You can help us by downloading the *.docx template and write a manual for your favourite IDE.
Send it as a PDF to aifes(at)ims.fraunhofer.de
Wokwi - Online Arduino and ESP32 Simulator
If you don’t have any hardware available, you can also test some AIfES examples in Wokwi. The simulation is slower, of course. Here are a few examples:
- AIfES_Express_XOR_F32_Inference (Arduino UNO 8-Bit)
- AIfES_Express_XOR_F32_training (Arduino Mega 8-Bit)
- AIfES_Express_XOR_F32_training (ESP32)
- TicTacToe_Q7 (Arduino UNO 8-Bit)
ARM CMSIS
AIfES also supports the Cortex Microcontroller Software Interface Standard (CMSIS) of the ARM Cortex controllers.
This standard can speed up inference and training for large FNNs.
Please read the README.md in https://github.com/Fraunhofer-IMS/AIfES_for_Arduino/tree/main/src/CMSIS for more information on how to add the CMSIS library.
Python
To get you startet we developed the AIfES-Converter. It can export your FNN from Python and create the suitable AIfES code.
Furthermore, it helps you with the quantization of your neural network.
You can install it via pip with:
pip install AIfES-Converter
The quantization can also be done manually by using the provided Python tools in this repository. You can install them via pip with:
pip install https://github.com/Fraunhofer-IMS/AIfES_for_Arduino/raw/main/etc/python/aifes_tools.zip
Please read the README.md in https://github.com/Fraunhofer-IMS/AIfES_for_Arduino/tree/main/etc/python for more information
on the AIfES pytools.
We also created some examples to show you how a tf.Keras and a PyTorch neural network can be quantized for AIfES, using the pytools
https://github.com/Fraunhofer-IMS/AIfES_for_Arduino/tree/main/etc/python/examples.
Features
Have a look at our documentation for a detailed overview of the provided features with code examples.
Data types and quantization
AIfES supports the following data types:
- F32: 32 Bit float
- Q31: 32 Bit integer
- Q7: 8 Bit integer
Neural network types
AIfES supports in the current version:
- Feedforward Neural Network (FNN) inference and training
- Other network types are in progress (see roadmap)
The number of neurons and the number of different layers can be adapted individually. Inference and training can be performed on the controller.
Inference layer
| Layer | f32 | q31 | q7 |
|---|---|---|---|
| Dense | ailayer_dense_f32_default() ailayer_dense_f32_cmsis() ailayer_dense_f32_avr_pgm() |
ailayer_dense_q31_default() | ailayer_dense_q7_default() ailayer_dense_wt_q7_default() ailayer_dense_wt_q7_cmsis() ailayer_dense_q7_avr_pgm() ailayer_dense_wt_q7_avr_pgm() |
| Input | ailayer_input_f32_default() | ailayer_input_q31_default() | ailayer_input_q7_default() |
| ReLU | ailayer_relu_f32_default() | ailayer_relu_q31_default() | ailayer_relu_q7_default() ailayer_relu_q7_avr_pgm() |
| Sigmoid | ailayer_sigmoid_f32_default() | ailayer_sigmoid_q31_default() | ailayer_sigmoid_q7_default() ailayer_sigmoid_q7_avr_pgm() |
| Softmax | ailayer_softmax_f32_default() | ailayer_softmax_q31_default() | ailayer_softmax_q7_default() ailayer_softmax_q7_avr_pgm() |
| Leaky ReLU | ailayer_leaky_relu_f32_default() | ailayer_leaky_relu_q31_default() | ailayer_leaky_relu_q7_default() ailayer_leaky_relu_q7_avr_pgm() |
| ELU | ailayer_elu_f32_default() | ailayer_elu_q31_default() | ailayer_elu_q7_default() ailayer_elu_q7_avr_pgm() |
| Tanh | ailayer_tanh_f32_default() | ailayer_tanh_q31_default() | ailayer_tanh_q7_default() ailayer_tanh_q7_avr_pgm() |
| Softsign | ailayer_softsign_f32_default() | ailayer_softsign_q31_default() | ailayer_softsign_q7_default() ailayer_softsign_q7_avr_pgm() |
| Conv2D | ailayer_conv2d_f32_default() | ||
| Batch Normalization | ailayer_batch_norm_f32_default() | ||
| MaxPool2D | ailayer_maxpool2d_f32_default() | ||
| Reshape | ailayer_reshape_f32_default() | ||
| Flatten | ailayer_flatten_f32_default() |
Training layer
| Layer | f32 | q31 | q7 |
|---|---|---|---|
| Dense | ailayer_dense_f32_default() ailayer_dense_f32_cmsis() ailayer_dense_f32_avr_pgm() |
ailayer_dense_q31_default() | |
| Input | ailayer_input_f32_default() | ailayer_input_q31_default() | ailayer_input_q7_default() |
| ReLU | ailayer_relu_f32_default() | ailayer_relu_q31_default() | ailayer_relu_q7_default() |
| Sigmoid | ailayer_sigmoid_f32_default() | ailayer_sigmoid_q31_default() | |
| Softmax | ailayer_softmax_f32_default() | ailayer_softmax_q31_default() | |
| Leaky ReLU | ailayer_leaky_relu_f32_default() | ailayer_leaky_relu_q31_default() | |
| ELU | ailayer_elu_f32_default() | ailayer_elu_q31_default() | |
| Tanh | ailayer_tanh_f32_default() | ailayer_tanh_q31_default() | |
| Softsign | ailayer_softsign_f32_default() | ailayer_softsign_q31_default() | |
| Conv2D | ailayer_conv2d_f32_default() | ||
| Batch Normalization | ailayer_batch_norm_f32_default() | ||
| MaxPool2D | ailayer_maxpool2d_f32_default() | ||
| Reshape | ailayer_reshape_f32_default() | ||
| Flatten | ailayer_flatten_f32_default() |
Loss:
| Loss | f32 | q31 | q7 |
|---|---|---|---|
| Mean Squared Error (MSE) | ailoss_mse_f32_default() | ailoss_mse_q31_default() | |
| Crossentropy | ailoss_crossentropy_f32_default() ailoss_crossentropy_sparse8_f32_default() |
Optimizer:
| Optimizer | f32 | q31 | q7 |
|---|---|---|---|
| Stochastic Gradient Descent (SGD) | aiopti_sgd_f32_default() | aiopti_sgd_q31_default() | |
| Adam | aiopti_adam_f32_default() |
Installation
You can download and install AIfES® (search for “aifes”) with the Arduino library manager.
https://www.arduino.cc/en/guide/libraries
Alternatively, the manual download is also possible:
Download the AIfES repository as a ZIP archive and follow these instructions:
https://www.arduino.cc/en/guide/libraries
Citation
If you use this software in your work please cite it.
For your scientific work you can cite the following paper:
Plain Text:
L. Wulfert et al., "AIfES: A Next-Generation Edge AI Framework," in IEEE Transactions on Pattern Analysis and Machine Intelligence, doi: 10.1109/TPAMI.2024.3355495.
keywords: {Training;Data models;Artificial intelligence;Support vector machines;Hardware acceleration;Libraries;Performance evaluation;Machine Learning Framework;Edge AI Framework;On-Device Training;Embedded Systems;Resource-Constrained Devices;TinyML}
BibTex:
@ARTICLE{10403985,
author={Wulfert, Lars and Kühnel, Johannes and Krupp, Lukas and Viga, Justus and Wiede, Christian and Gembaczka, Pierre and Grabmaier, Anton},
journal={IEEE Transactions on Pattern Analysis and Machine Intelligence},
title={AIfES: A Next-Generation Edge AI Framework},
year={2024},
volume={},
number={},
pages={1-16},
keywords={Training;Data models;Artificial intelligence;Support vector machines;Hardware acceleration;Libraries;Performance evaluation;Machine Learning Framework;Edge AI Framework;On-Device Training;Embedded Systems;Resource-Constrained Devices;TinyML},
doi={10.1109/TPAMI.2024.3355495}}
Roadmap
The AIfES team at Fraunhofer IMS is constantly working on new features and network types.