Skip to content

Commit ae4cf01

Browse files
committed
refactoring models
1 parent 91a0f18 commit ae4cf01

File tree

10 files changed

+320
-426
lines changed

10 files changed

+320
-426
lines changed

README.md

Lines changed: 12 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -2,24 +2,31 @@
22

33
This repository includes the code used to generate numerical results in the ICASSP 2020 conference paper titled "Decentralized optimization with non-identical sampling in presence of stragglers".
44

5-
<img src="data/archive10_icassp_final_results/run_mnist_linear1_distinct_10_PWG_perfect_amb_iclr_10_bern_08_60_10_metro.png?raw=true"/>
6-
<img src="data/archive10_icassp_final_results/run_mnist_linear1_distinct_10_PWG_rand_walk_amb_iclr_10_bern_08_60_10_metro.png?raw=true"/>
7-
<img src="data/archive10_icassp_final_results/run_mnist_relu1_distinct_10_PWG_rand_walk_amb_iclr_10_bern_08_60_10_metro.png?raw=true"/>
5+
| MNIST | Fashion-MNIST |
6+
|:-------------------------:|:-------------------------:|
7+
| <img width="100%" src="data/archive10_icassp_final_results/run_mnist_linear1_distinct_10_PWG_perfect_amb_iclr_10_bern_08_60_10_metro.png?raw=true"> | <img width="100%" src="data/archive10_icassp_final_results/run_fashion_mnist_linear1_distinct_10_PWG_perfect_amb_iclr_10_bern_08_60_10_metro.png?raw=true">|
8+
|<img width="100%" src="data/archive10_icassp_final_results/run_mnist_linear1_distinct_10_PWG_rand_walk_amb_iclr_10_bern_08_60_10_metro.png?raw=true"> | <img width="100%" src="data/archive10_icassp_final_results/run_fashion_mnist_linear1_distinct_10_PWG_rand_walk_amb_iclr_10_bern_08_60_10_metro.png?raw=true">|
9+
|<img width="100%" src="data/archive10_icassp_final_results/run_mnist_relu1_distinct_10_PWG_rand_walk_amb_iclr_10_bern_08_60_10_metro.png?raw=true"> | <img width="100%" src="data/archive10_icassp_final_results/run_fashion_mnist_relu1_distinct_10_PWG_perfect_amb_iclr_10_bern_08_60_10_metro.png?raw=true">|
810

911
## Recreating results in paper
10-
#### Generate data:
12+
#### Generating data:
1113
* Sample usage: `python -u run_main.py --model fashion_mnist --data_dist distinct_10 --func linear1 --opt PWG --consensus perfect --strag_dist bern --strag_dist_param 0.8 --num_samples 60 --grad_combine Equal Proportional --save --graph_def amb_iclr_10 --num_iters 5000`
1214
* `python -u run_main.py --model cifar10 --data_dist distinct_10 --func conv --opt PWG --consensus perfect --strag_dist bern --strag_dist_param 0.8 --num_samples 60 --grad_combine Equal Proportional --save --graph_def amb_iclr_10 --num_iters 5000 --max_loss_eval_size 2 --lrate_start 0.001 --lrate_end 0.0001 --weights_scale 0.08`
1315
* Execute [`run_main.sh`](run_main.sh) to run all simulations included in the paper.
1416

15-
#### Generate plots:
17+
#### Generating plots:
1618
Use the following to generate all plots.
1719
* `python plot_run_main.py --ylog --num_iters 100000 --no_dots --silent --save --keywords linear1 perfect --xhide --fig_size 6.5 2.08 --ylim 0.25 100`
1820
* `python plot_run_main.py --ylog --num_iters 100000 --no_dots --silent --save --keywords linear1 rand_walk --all_workers --xhide --fig_size 6.5 2.08 --ylim 0.35 100 --filter_sigma 5`
1921
* `python plot_run_main.py --ylog --num_iters 100000 --no_dots --silent --save --keywords relu1 perfect --fig_size 6.5 2.52 --ylim 0.2 1`
2022

2123

2224

25+
26+
-----
27+
28+
29+
2330
## Other experiments
2431

2532
#### Useful commands:

src/model_cifar10.py

Lines changed: 0 additions & 245 deletions
This file was deleted.

0 commit comments

Comments
 (0)