nn-Meter/examples
Jiahang Xu 29b7f9a073
Update customized workspace create doc (#84)
2022-10-25 16:40:35 +08:00
..
nn-meter_builder_examples Update customized workspace create doc (#84) 2022-10-25 16:40:35 +08:00
nn-meter_quick_start change link 2022-03-07 20:20:55 -05:00
README.md add doc for bench dataset 2021-11-09 15:41:27 +08:00
nn-meter_dataset_for_gnn.ipynb refine example name 2021-11-09 15:20:23 +08:00
nn-meter_predictor_for_bench_dataset.ipynb refine example name 2021-11-09 15:20:23 +08:00
nn-meter_predictor_for_different_model_format.ipynb Update nn-meter_predictor_for_different_model_format.ipynb (#52) 2021-12-23 17:22:44 +08:00

README.md

Examples for nn-Meter

In this folder, we provide several examples to show the usage of nn-Meter package.

The first example 1. Use nn-Meter Predictor for models with different format shows the basic python binding usage of nn-meter with models with different format of Tensorflow, PyTorch and ONNX model.

To evaluate the effectiveness of a prediction model on an arbitrary DNN model, we need a representative dataset that covers a large prediction scope. nn-Meter collects and generates 26k CNN models. (Please refer the paper for the dataset generation method.)

We release the dataset, and provide an interface of nn_meter.dataset for users to get access to the dataset. Users can also download the data from the Download Link on their own.

Example 2. Use nn-Meter with the bench dataset shows how to use nn-Meter to predict latency for the bench dataset.

Since the dataset is encoded in a graph format, we also provide an example 3. Use nn-Meter bench dataset for GNN training of using GNN to predict the model latency with the bench dataset.

Finally, we provide more hardware-ware NAS examples in NNI.

Examples list

  1. Use nn-Meter for models with different format
  2. Use nn-Meter with the bench dataset
  3. Use bench dataset for GNN training
  4. Use nn-Meter to construct latency constraint in SPOS NAS
  5. Use nn-Meter to construct latency penalty in ProxylessNAS