Recent updates:
-
AnalogNAS-Bench:** We have integrated AnalogNAS-Bench, a dedicated NAS benchmark tailored specifically for Analog In-Memory Computing (AIMC). This benchmark enables fair and systematic comparisons of NAS methodologies under realistic AIMC conditions, providing valuable insights into architectural robustness against AIMC-induced noise and drift.
-
AnalogNas is a modular and flexible framework to facilitate the implementation of Analog-aware Neural Architecture Search. It offers high-level classes to define: the search space, the accuracy evaluator, and the search strategy. It leverages the aihwkit framework to apply hardware-aware training with analog non-idealities and noise included. AnalogNAS obtained architectures are more robust during inference on Analog Hardware. We also include two evaluators trained to rank the architectures according to their analog training accuracy.
While installing the repository, creating a new conda environment is recomended.
Firstly, refer to AIHWKit installation to install Pytorch and the AIHWKit toolkit.
Install the additional requirements, using:
pip install -r requirements.txt
Afterwards, install AnalogNAS by running the setup.py file:
python setup.py install
Alternatively, you can also download the package through pip:
pip install analogainas
from analogainas.search_spaces.config_space import ConfigSpace
from analogainas.evaluators.xgboost import XGBoostEvaluator
from analogainas.search_algorithms.ea_optimized import EAOptimizer
from analogainas.search_algorithms.worker import Worker
CS = ConfigSpace('CIFAR-10') # define search space, by default a resnet-like search space
evaluator = XGBoostEvaluator() # load the evaluators
optimizer = EAOptimizer(evaluator, population_size=20, nb_iter=10) # define the optimizer with its parameters
NB_RUN = 2
worker = Worker(CS, optimizer=optimizer, runs=NB_RUN) # The global runner
worker.search() # start search
worker.result_summary() # print results To get started, check out nas_search_demo.py and starter_notebook.ipynb to ensure the installation went well.
AnalogNAS has been developed by IBM Research,
with Hadjer Benmeziane, Corey Lammie, Irem Boybat, Malte Rasch, Manuel Le Gallo, Smail Niar, Hamza Ouarnoughi, Ramachandran Muralidhar, Sidney Tsai, Vijay Narayanan, Abu Sebastian, and Kaoutar El Maghraoui
You can contact us by opening a new issue in the repository.
In case you are using the AnalogNas toolkit for your research, please cite the IEEE Edge 2023 paper that describes the toolkit:
Hadjer Benmeziane, Corey Lammie, Irem Boybat, Malte Rasch, Manuel Le Gallo, Hsinyu Tsai, Ramachandran Muralidhar, Smail Niar, Ouarnoughi Hamza, Vijay Narayanan, Abu Sebastian and Kaoutar El Maghraoui "AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computing" (2023 IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING & COMMUNICATIONS (IEEE Edge))
- We are proud to share that AnalogNAS open source project the prestigious IEEE OPEN SOURCE SCIENCE in 2023 at the IEEE 2023 Services Computing Congress.
-
AnalogNAS paper received the Best Paper Award at 2023 IEEE EDGE (INTERNATIONAL CONFERENCE ON EDGE COMPUTING & COMMUNICATIONS)
This project is licensed under Apache License 2.0.