Merge pull request #226 from mldiego/master

DSN tutorial + archcomp 2024

Author: mldiego

README.md

@@ -77,22 +77,21 @@ To get started with NNV, let's take a look at a tutorial containing examples dem
 __NN__
 
 * Robustness verification on the MNIST dataset.
-    * [Robustness verification of whole dataset](code/nnv/examples/Tutorial/NN/MNIST/verify_fc_allTest.m) using a [model with fully-connected and ReLU layers](code/nnv/examples/Tutorial/NN/MNIST/training_fc.m).
-    * [Robustness verification of a single image](code/nnv/examples/Tutorial/NN/MNIST/verify_fc.m) using a [model with fully-connected and ReLU layers](code/nnv/examples/Tutorial/NN/MNIST/training_fc.m).
-    * [Robustness verification of a single image](code/nnv/examples/Tutorial/NN/MNIST/verify.m) using a [model with Convolutional, Pooling, Batch Normalization, ReLU, and fully-connected layers](code/nnv/examples/Tutorial/NN/MNIST/training.m)
+    * Includes model training and several verification examples.
 * Robustness verification on the GTSRB dataset.
-    * Includes [training](code/nnv/examples/Tutorial/NN/GTSRB/train.m) and [verification](code/nnv/examples/Tutorial/NN/GTSRB/verify_robust_27.m) scripts as well.
-* Comparison of exact (sound and complete) and approximate (sound and incomplete) methods using Star sets [exact vs approx](code/nnv/examples/Tutorial/NN/compareReachability/reach_exact_vs_approx.m)
+    * Includes model training and robustness verification.
+* Comparisons of exact (sound and complete) and approximate (sound and incomplete) methods using Star sets
+    * Visualize the size difference on the output sets and the computation times for each method.  
+* Robustness analysis of a malware classifier (BODMAS Dataset).
 
+  
 __NNCS__
   
-* Reachability analysis of an [inverted pendulum](code/nnv/examples/Tutorial/NNCS/InvertedPendulum/reach_invP.m).
+* Reachability analysis of an inverted pendulum.
 * Safety verification example of an Adaptive Cruise Control (ACC) system.
-    * [Training](code/nnv/examples/Tutorial/NNCS/ACC/Training%20and%20testing). This requires installing Simulink.
-    * [Safety Verification](code/nnv/examples/Tutorial/NNCS/ACC/Verification/verify.m).
-* Safety verification of an Automated Emergency Braking System ([AEBS](code/nnv/examples/Tutorial/NNCS/AEBS))
-    * This system contains several neural networks, so a custom control loop is included in the verification script.
+* Safety verification of an Automated Emergency Braking System
 
+And more! Please go to the [tutorial description](code/nnv/examples/Tutorial/readme.md) for more details!
 
 ### Examples
 

code/nnv/examples/Submission/ARCH-COMP2024/README.md

@@ -1,47 +1,9 @@
-# ARCH-COMP 2024
-ARCH-COMP AINNCS Category 2024 Model Files
+# ARCH-COMP 2024 - AINNCS
 
 Event info: https://cps-vo.org/group/ARCH/FriendlyCompetition
 
-
-## Benchmarks 
-
-We plan to reuse benchmarks from 2023 but  feel free to propose new benchmarks or modifications to existing ones: https://github.com/verivital/ARCH-COMP2024/issues/1
-
-
-
-### [2023 Benchmarks](https://github.com/verivital/ARCH-COMP2023)
-
-- Adaptive Cruise Controller (ACC)
-
-- Airplane
-
-- Attitude Control 
-
-- Double Pendulum
-
-- Single Pendulum
-
-- QUAD
-
-- TORA with heterogeneous and sigmoid controller
-
-- TORA with ReLU controller (benchmark 9)
-
-- Unicycle (benchmark 10)
-
-- VCAS
-
-- 2D Spacecraft Docking
-
-
-### Competition History
-
-Prior year reports:
-- 2023: https://easychair.org/publications/paper/Vfq4b
-- 2022: https://easychair.org/publications/paper/C1J8
-- 2021: https://easychair.org/publications/paper/Jq4h
-- 2020: https://easychair.org/publications/paper/Jvwg
-- 2019: https://easychair.org/publications/paper/BFKs
+AINNCS competition info (benchmark and competition discussions): https://github.com/verivital/ARCH-COMP2024 
 
 Repeatability archives: https://gitlab.com/goranf/ARCH-COMP/
+
+NNV RE package: https://gitlab.com/goranf/ARCH-COMP/-/tree/master/2024/AINNCS/nnv