From b06233eccae03444aa9586006bf252c9e75ee7bc Mon Sep 17 00:00:00 2001 From: pkuliuliu Date: Wed, 9 Sep 2020 11:03:41 +0800 Subject: [PATCH] update mindarmour api rst --- .../mindarmour.adv_robustness.attacks.rst | 5 +++++ .../mindarmour.adv_robustness.defenses.rst | 5 +++++ .../mindarmour.adv_robustness.detectors.rst | 5 +++++ .../mindarmour.adv_robustness.evaluations.rst | 5 +++++ .../api/python/mindarmour/mindarmour.attacks.rst | 5 ----- .../api/python/mindarmour/mindarmour.defenses.rst | 5 ----- .../api/python/mindarmour/mindarmour.detectors.rst | 5 ----- .../python/mindarmour/mindarmour.diff_privacy.rst | 5 ----- .../python/mindarmour/mindarmour.evaluations.rst | 5 ----- .../python/mindarmour/mindarmour.fuzz_testing.rst | 5 +++++ .../api/python/mindarmour/mindarmour.fuzzing.rst | 5 ----- .../mindarmour/mindarmour.privacy.diff_privacy.rst | 5 +++++ .../mindarmour/mindarmour.privacy.evaluation.rst | 5 +++++ api/source_en/index.rst | 13 +++++++------ .../mindarmour.adv_robustness.attacks.rst | 5 +++++ .../mindarmour.adv_robustness.defenses.rst | 5 +++++ .../mindarmour.adv_robustness.detectors.rst | 5 +++++ .../mindarmour.adv_robustness.evaluations.rst | 5 +++++ .../api/python/mindarmour/mindarmour.attacks.rst | 5 ----- .../api/python/mindarmour/mindarmour.defenses.rst | 5 ----- .../api/python/mindarmour/mindarmour.detectors.rst | 5 ----- .../python/mindarmour/mindarmour.diff_privacy.rst | 5 ----- .../python/mindarmour/mindarmour.evaluations.rst | 5 ----- .../python/mindarmour/mindarmour.fuzz_testing.rst | 5 +++++ .../api/python/mindarmour/mindarmour.fuzzing.rst | 5 ----- .../mindarmour/mindarmour.privacy.diff_privacy.rst | 5 +++++ .../mindarmour/mindarmour.privacy.evaluation.rst | 5 +++++ api/source_zh_cn/index.rst | 13 +++++++------ .../mindarmour/differential_privacy_design.md | 8 ++++---- .../source_zh_cn/design/mindarmour/fuzzer_design.md | 10 +++++----- 30 files changed, 93 insertions(+), 81 deletions(-) create mode 100644 api/source_en/api/python/mindarmour/mindarmour.adv_robustness.attacks.rst create mode 100644 api/source_en/api/python/mindarmour/mindarmour.adv_robustness.defenses.rst create mode 100644 api/source_en/api/python/mindarmour/mindarmour.adv_robustness.detectors.rst create mode 100644 api/source_en/api/python/mindarmour/mindarmour.adv_robustness.evaluations.rst delete mode 100644 api/source_en/api/python/mindarmour/mindarmour.attacks.rst delete mode 100644 api/source_en/api/python/mindarmour/mindarmour.defenses.rst delete mode 100644 api/source_en/api/python/mindarmour/mindarmour.detectors.rst delete mode 100644 api/source_en/api/python/mindarmour/mindarmour.diff_privacy.rst delete mode 100644 api/source_en/api/python/mindarmour/mindarmour.evaluations.rst create mode 100644 api/source_en/api/python/mindarmour/mindarmour.fuzz_testing.rst delete mode 100644 api/source_en/api/python/mindarmour/mindarmour.fuzzing.rst create mode 100644 api/source_en/api/python/mindarmour/mindarmour.privacy.diff_privacy.rst create mode 100644 api/source_en/api/python/mindarmour/mindarmour.privacy.evaluation.rst create mode 100644 api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.attacks.rst create mode 100644 api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.defenses.rst create mode 100644 api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.detectors.rst create mode 100644 api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.evaluations.rst delete mode 100644 api/source_zh_cn/api/python/mindarmour/mindarmour.attacks.rst delete mode 100644 api/source_zh_cn/api/python/mindarmour/mindarmour.defenses.rst delete mode 100644 api/source_zh_cn/api/python/mindarmour/mindarmour.detectors.rst delete mode 100644 api/source_zh_cn/api/python/mindarmour/mindarmour.diff_privacy.rst delete mode 100644 api/source_zh_cn/api/python/mindarmour/mindarmour.evaluations.rst create mode 100644 api/source_zh_cn/api/python/mindarmour/mindarmour.fuzz_testing.rst delete mode 100644 api/source_zh_cn/api/python/mindarmour/mindarmour.fuzzing.rst create mode 100644 api/source_zh_cn/api/python/mindarmour/mindarmour.privacy.diff_privacy.rst create mode 100644 api/source_zh_cn/api/python/mindarmour/mindarmour.privacy.evaluation.rst diff --git a/api/source_en/api/python/mindarmour/mindarmour.adv_robustness.attacks.rst b/api/source_en/api/python/mindarmour/mindarmour.adv_robustness.attacks.rst new file mode 100644 index 00000000..5b38b93f --- /dev/null +++ b/api/source_en/api/python/mindarmour/mindarmour.adv_robustness.attacks.rst @@ -0,0 +1,5 @@ +mindarmour.adv_robustness.attacks +================================= + +.. automodule:: mindarmour.adv_robustness.attacks + :members: diff --git a/api/source_en/api/python/mindarmour/mindarmour.adv_robustness.defenses.rst b/api/source_en/api/python/mindarmour/mindarmour.adv_robustness.defenses.rst new file mode 100644 index 00000000..5b01e203 --- /dev/null +++ b/api/source_en/api/python/mindarmour/mindarmour.adv_robustness.defenses.rst @@ -0,0 +1,5 @@ +mindarmour.adv_robustness.defenses +================================== + +.. automodule:: mindarmour.adv_robustness.defenses + :members: diff --git a/api/source_en/api/python/mindarmour/mindarmour.adv_robustness.detectors.rst b/api/source_en/api/python/mindarmour/mindarmour.adv_robustness.detectors.rst new file mode 100644 index 00000000..d82a5b18 --- /dev/null +++ b/api/source_en/api/python/mindarmour/mindarmour.adv_robustness.detectors.rst @@ -0,0 +1,5 @@ +mindarmour.adv_robustness.detectors +=================================== + +.. automodule:: mindarmour.adv_robustness.detectors + :members: diff --git a/api/source_en/api/python/mindarmour/mindarmour.adv_robustness.evaluations.rst b/api/source_en/api/python/mindarmour/mindarmour.adv_robustness.evaluations.rst new file mode 100644 index 00000000..19aac889 --- /dev/null +++ b/api/source_en/api/python/mindarmour/mindarmour.adv_robustness.evaluations.rst @@ -0,0 +1,5 @@ +mindarmour.adv_robustness.evaluations +===================================== + +.. automodule:: mindarmour.adv_robustness.evaluations + :members: diff --git a/api/source_en/api/python/mindarmour/mindarmour.attacks.rst b/api/source_en/api/python/mindarmour/mindarmour.attacks.rst deleted file mode 100644 index 1eb57e5d..00000000 --- a/api/source_en/api/python/mindarmour/mindarmour.attacks.rst +++ /dev/null @@ -1,5 +0,0 @@ -mindarmour.attacks -================== - -.. automodule:: mindarmour.attacks - :members: \ No newline at end of file diff --git a/api/source_en/api/python/mindarmour/mindarmour.defenses.rst b/api/source_en/api/python/mindarmour/mindarmour.defenses.rst deleted file mode 100644 index f64f0a89..00000000 --- a/api/source_en/api/python/mindarmour/mindarmour.defenses.rst +++ /dev/null @@ -1,5 +0,0 @@ -mindarmour.defenses -=================== - -.. automodule:: mindarmour.defenses - :members: \ No newline at end of file diff --git a/api/source_en/api/python/mindarmour/mindarmour.detectors.rst b/api/source_en/api/python/mindarmour/mindarmour.detectors.rst deleted file mode 100644 index cd78d332..00000000 --- a/api/source_en/api/python/mindarmour/mindarmour.detectors.rst +++ /dev/null @@ -1,5 +0,0 @@ -mindarmour.detectors -==================== - -.. automodule:: mindarmour.detectors - :members: \ No newline at end of file diff --git a/api/source_en/api/python/mindarmour/mindarmour.diff_privacy.rst b/api/source_en/api/python/mindarmour/mindarmour.diff_privacy.rst deleted file mode 100644 index 9ae8947a..00000000 --- a/api/source_en/api/python/mindarmour/mindarmour.diff_privacy.rst +++ /dev/null @@ -1,5 +0,0 @@ -mindarmour.diff_privacy -======================= - -.. automodule:: mindarmour.diff_privacy - :members: \ No newline at end of file diff --git a/api/source_en/api/python/mindarmour/mindarmour.evaluations.rst b/api/source_en/api/python/mindarmour/mindarmour.evaluations.rst deleted file mode 100644 index 92a0a74e..00000000 --- a/api/source_en/api/python/mindarmour/mindarmour.evaluations.rst +++ /dev/null @@ -1,5 +0,0 @@ -mindarmour.evaluations -====================== - -.. automodule:: mindarmour.evaluations - :members: \ No newline at end of file diff --git a/api/source_en/api/python/mindarmour/mindarmour.fuzz_testing.rst b/api/source_en/api/python/mindarmour/mindarmour.fuzz_testing.rst new file mode 100644 index 00000000..558e8c12 --- /dev/null +++ b/api/source_en/api/python/mindarmour/mindarmour.fuzz_testing.rst @@ -0,0 +1,5 @@ +mindarmour.fuzz_testing +======================= + +.. automodule:: mindarmour.fuzz_testing + :members: diff --git a/api/source_en/api/python/mindarmour/mindarmour.fuzzing.rst b/api/source_en/api/python/mindarmour/mindarmour.fuzzing.rst deleted file mode 100644 index 92ca6eea..00000000 --- a/api/source_en/api/python/mindarmour/mindarmour.fuzzing.rst +++ /dev/null @@ -1,5 +0,0 @@ -mindarmour.fuzzing -================== - -.. automodule:: mindarmour.fuzzing - :members: \ No newline at end of file diff --git a/api/source_en/api/python/mindarmour/mindarmour.privacy.diff_privacy.rst b/api/source_en/api/python/mindarmour/mindarmour.privacy.diff_privacy.rst new file mode 100644 index 00000000..9fd33f9e --- /dev/null +++ b/api/source_en/api/python/mindarmour/mindarmour.privacy.diff_privacy.rst @@ -0,0 +1,5 @@ +mindarmour.privacy.diff_privacy +=============================== + +.. automodule:: mindarmour.privacy.diff_privacy + :members: diff --git a/api/source_en/api/python/mindarmour/mindarmour.privacy.evaluation.rst b/api/source_en/api/python/mindarmour/mindarmour.privacy.evaluation.rst new file mode 100644 index 00000000..eacc6a7c --- /dev/null +++ b/api/source_en/api/python/mindarmour/mindarmour.privacy.evaluation.rst @@ -0,0 +1,5 @@ +mindarmour.privacy.evaluation +============================= + +.. automodule:: mindarmour.privacy.evaluation + :members: diff --git a/api/source_en/index.rst b/api/source_en/index.rst index 36649d3f..83576251 100644 --- a/api/source_en/index.rst +++ b/api/source_en/index.rst @@ -38,13 +38,14 @@ MindSpore API :caption: MindArmour Python API api/python/mindarmour/mindarmour + api/python/mindarmour/mindarmour.adv_robustness.attacks + api/python/mindarmour/mindarmour.adv_robustness.defenses + api/python/mindarmour/mindarmour.adv_robustness.detectors + api/python/mindarmour/mindarmour.adv_robustness.evaluations + api/python/mindarmour/mindarmour.fuzz_testing + api/python/mindarmour/mindarmour.privacy.diff_privacy + api/python/mindarmour/mindarmour.privacy.evaluation api/python/mindarmour/mindarmour.utils - api/python/mindarmour/mindarmour.evaluations - api/python/mindarmour/mindarmour.detectors - api/python/mindarmour/mindarmour.attacks - api/python/mindarmour/mindarmour.defenses - api/python/mindarmour/mindarmour.fuzzing - api/python/mindarmour/mindarmour.diff_privacy .. toctree:: :maxdepth: 1 diff --git a/api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.attacks.rst b/api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.attacks.rst new file mode 100644 index 00000000..5b38b93f --- /dev/null +++ b/api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.attacks.rst @@ -0,0 +1,5 @@ +mindarmour.adv_robustness.attacks +================================= + +.. automodule:: mindarmour.adv_robustness.attacks + :members: diff --git a/api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.defenses.rst b/api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.defenses.rst new file mode 100644 index 00000000..5b01e203 --- /dev/null +++ b/api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.defenses.rst @@ -0,0 +1,5 @@ +mindarmour.adv_robustness.defenses +================================== + +.. automodule:: mindarmour.adv_robustness.defenses + :members: diff --git a/api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.detectors.rst b/api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.detectors.rst new file mode 100644 index 00000000..d82a5b18 --- /dev/null +++ b/api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.detectors.rst @@ -0,0 +1,5 @@ +mindarmour.adv_robustness.detectors +=================================== + +.. automodule:: mindarmour.adv_robustness.detectors + :members: diff --git a/api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.evaluations.rst b/api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.evaluations.rst new file mode 100644 index 00000000..19aac889 --- /dev/null +++ b/api/source_zh_cn/api/python/mindarmour/mindarmour.adv_robustness.evaluations.rst @@ -0,0 +1,5 @@ +mindarmour.adv_robustness.evaluations +===================================== + +.. automodule:: mindarmour.adv_robustness.evaluations + :members: diff --git a/api/source_zh_cn/api/python/mindarmour/mindarmour.attacks.rst b/api/source_zh_cn/api/python/mindarmour/mindarmour.attacks.rst deleted file mode 100644 index 1eb57e5d..00000000 --- a/api/source_zh_cn/api/python/mindarmour/mindarmour.attacks.rst +++ /dev/null @@ -1,5 +0,0 @@ -mindarmour.attacks -================== - -.. automodule:: mindarmour.attacks - :members: \ No newline at end of file diff --git a/api/source_zh_cn/api/python/mindarmour/mindarmour.defenses.rst b/api/source_zh_cn/api/python/mindarmour/mindarmour.defenses.rst deleted file mode 100644 index f64f0a89..00000000 --- a/api/source_zh_cn/api/python/mindarmour/mindarmour.defenses.rst +++ /dev/null @@ -1,5 +0,0 @@ -mindarmour.defenses -=================== - -.. automodule:: mindarmour.defenses - :members: \ No newline at end of file diff --git a/api/source_zh_cn/api/python/mindarmour/mindarmour.detectors.rst b/api/source_zh_cn/api/python/mindarmour/mindarmour.detectors.rst deleted file mode 100644 index cd78d332..00000000 --- a/api/source_zh_cn/api/python/mindarmour/mindarmour.detectors.rst +++ /dev/null @@ -1,5 +0,0 @@ -mindarmour.detectors -==================== - -.. automodule:: mindarmour.detectors - :members: \ No newline at end of file diff --git a/api/source_zh_cn/api/python/mindarmour/mindarmour.diff_privacy.rst b/api/source_zh_cn/api/python/mindarmour/mindarmour.diff_privacy.rst deleted file mode 100644 index 9ae8947a..00000000 --- a/api/source_zh_cn/api/python/mindarmour/mindarmour.diff_privacy.rst +++ /dev/null @@ -1,5 +0,0 @@ -mindarmour.diff_privacy -======================= - -.. automodule:: mindarmour.diff_privacy - :members: \ No newline at end of file diff --git a/api/source_zh_cn/api/python/mindarmour/mindarmour.evaluations.rst b/api/source_zh_cn/api/python/mindarmour/mindarmour.evaluations.rst deleted file mode 100644 index 92a0a74e..00000000 --- a/api/source_zh_cn/api/python/mindarmour/mindarmour.evaluations.rst +++ /dev/null @@ -1,5 +0,0 @@ -mindarmour.evaluations -====================== - -.. automodule:: mindarmour.evaluations - :members: \ No newline at end of file diff --git a/api/source_zh_cn/api/python/mindarmour/mindarmour.fuzz_testing.rst b/api/source_zh_cn/api/python/mindarmour/mindarmour.fuzz_testing.rst new file mode 100644 index 00000000..558e8c12 --- /dev/null +++ b/api/source_zh_cn/api/python/mindarmour/mindarmour.fuzz_testing.rst @@ -0,0 +1,5 @@ +mindarmour.fuzz_testing +======================= + +.. automodule:: mindarmour.fuzz_testing + :members: diff --git a/api/source_zh_cn/api/python/mindarmour/mindarmour.fuzzing.rst b/api/source_zh_cn/api/python/mindarmour/mindarmour.fuzzing.rst deleted file mode 100644 index 92ca6eea..00000000 --- a/api/source_zh_cn/api/python/mindarmour/mindarmour.fuzzing.rst +++ /dev/null @@ -1,5 +0,0 @@ -mindarmour.fuzzing -================== - -.. automodule:: mindarmour.fuzzing - :members: \ No newline at end of file diff --git a/api/source_zh_cn/api/python/mindarmour/mindarmour.privacy.diff_privacy.rst b/api/source_zh_cn/api/python/mindarmour/mindarmour.privacy.diff_privacy.rst new file mode 100644 index 00000000..9fd33f9e --- /dev/null +++ b/api/source_zh_cn/api/python/mindarmour/mindarmour.privacy.diff_privacy.rst @@ -0,0 +1,5 @@ +mindarmour.privacy.diff_privacy +=============================== + +.. automodule:: mindarmour.privacy.diff_privacy + :members: diff --git a/api/source_zh_cn/api/python/mindarmour/mindarmour.privacy.evaluation.rst b/api/source_zh_cn/api/python/mindarmour/mindarmour.privacy.evaluation.rst new file mode 100644 index 00000000..eacc6a7c --- /dev/null +++ b/api/source_zh_cn/api/python/mindarmour/mindarmour.privacy.evaluation.rst @@ -0,0 +1,5 @@ +mindarmour.privacy.evaluation +============================= + +.. automodule:: mindarmour.privacy.evaluation + :members: diff --git a/api/source_zh_cn/index.rst b/api/source_zh_cn/index.rst index e6672f4a..5661b9e5 100644 --- a/api/source_zh_cn/index.rst +++ b/api/source_zh_cn/index.rst @@ -44,13 +44,14 @@ MindSpore API :caption: MindArmour Python API api/python/mindarmour/mindarmour + api/python/mindarmour/mindarmour.adv_robustness.attacks + api/python/mindarmour/mindarmour.adv_robustness.defenses + api/python/mindarmour/mindarmour.adv_robustness.detectors + api/python/mindarmour/mindarmour.adv_robustness.evaluations + api/python/mindarmour/mindarmour.fuzz_testing + api/python/mindarmour/mindarmour.privacy.diff_privacy + api/python/mindarmour/mindarmour.privacy.evaluation api/python/mindarmour/mindarmour.utils - api/python/mindarmour/mindarmour.evaluations - api/python/mindarmour/mindarmour.detectors - api/python/mindarmour/mindarmour.attacks - api/python/mindarmour/mindarmour.defenses - api/python/mindarmour/mindarmour.fuzzing - api/python/mindarmour/mindarmour.diff_privacy .. toctree:: :maxdepth: 1 diff --git a/docs/source_zh_cn/design/mindarmour/differential_privacy_design.md b/docs/source_zh_cn/design/mindarmour/differential_privacy_design.md index 2b34793c..b4a2b270 100644 --- a/docs/source_zh_cn/design/mindarmour/differential_privacy_design.md +++ b/docs/source_zh_cn/design/mindarmour/differential_privacy_design.md @@ -56,10 +56,10 @@ Monitor提供RDP、ZCDP等回调函数，用于监测模型的差分隐私预算 ## 代码实现 -* [mechanisms.py](https://gitee.com/mindspore/mindarmour/blob/master/mindarmour/diff_privacy/mechanisms/mechanisms.py): 这个文件实现了差分隐私训练所需的噪声生成机制，包括简单高斯噪声、自适应高斯噪声、自适应裁剪高斯噪声等。 -* [optimizer.py](https://gitee.com/mindspore/mindarmour/blob/master/mindarmour/diff_privacy/optimizer/optimizer.py): 这个文件实现了使用噪声生成机制在反向传播时添加噪声的根本逻辑。 -* [monitor.py](https://gitee.com/mindspore/mindarmour/blob/master/mindarmour/diff_privacy/monitor/monitor.py): 实现了计算差分隐私预算的回调函数，模型训练过程中，会反馈当前的差分隐私预算。 -* [model.py](https://gitee.com/mindspore/mindarmour/blob/master/mindarmour/diff_privacy/train/model.py): 这个文件实现了计算损失和梯度的逻辑，差分隐私训练的梯度截断逻辑在此文件中实现，且model.py是用户使用差分隐私训练能力的入口。 +* [mechanisms.py](https://gitee.com/mindspore/mindarmour/blob/master/mindarmour/privacy/diff_privacy/mechanisms/mechanisms.py): 这个文件实现了差分隐私训练所需的噪声生成机制，包括简单高斯噪声、自适应高斯噪声、自适应裁剪高斯噪声等。 +* [optimizer.py](https://gitee.com/mindspore/mindarmour/blob/master/mindarmour/privacy/diff_privacy/optimizer/optimizer.py): 这个文件实现了使用噪声生成机制在反向传播时添加噪声的根本逻辑。 +* [monitor.py](https://gitee.com/mindspore/mindarmour/blob/master/mindarmour/privacy/diff_privacy/monitor/monitor.py): 实现了计算差分隐私预算的回调函数，模型训练过程中，会反馈当前的差分隐私预算。 +* [model.py](https://gitee.com/mindspore/mindarmour/blob/master/mindarmour/privacy/diff_privacy/train/model.py): 这个文件实现了计算损失和梯度的逻辑，差分隐私训练的梯度截断逻辑在此文件中实现，且model.py是用户使用差分隐私训练能力的入口。 ## 参考文献 diff --git a/docs/source_zh_cn/design/mindarmour/fuzzer_design.md b/docs/source_zh_cn/design/mindarmour/fuzzer_design.md index 022fc5b0..17e0ebc7 100644 --- a/docs/source_zh_cn/design/mindarmour/fuzzer_design.md +++ b/docs/source_zh_cn/design/mindarmour/fuzzer_design.md @@ -58,13 +58,13 @@ Fuzzer架构主要包括三个模块： ## 代码实现 -1. [fuzzing.py](https://gitee.com/mindspore/mindarmour/blob/master/mindarmour/fuzzing/fuzzing.py)：Fuzzer总体流程。 -2. [model_coverage_metrics.py](https://gitee.com/mindspore/mindarmour/blob/master/mindarmour/fuzzing/model_coverage_metrics.py)：神经元覆盖率指标，包括KMNC，NBC，SNAC。 -3. [image_transform.py](https://gitee.com/mindspore/mindarmour/blob/master/mindarmour/fuzzing/image_transform.py)：图像变异方法，包括基于像素值的变化方法和仿射变化方法。 -4. [adversarial attacks](https://gitee.com/mindspore/mindarmour/tree/master/mindarmour/attacks)：对抗样本攻击方法，包含多种黑盒、白盒攻击方法。 +1. [fuzzing.py](https://gitee.com/mindspore/mindarmour/blob/master/mindarmour/fuzz_testing/fuzzing.py)：Fuzzer总体流程。 +2. [model_coverage_metrics.py](https://gitee.com/mindspore/mindarmour/blob/master/mindarmour/fuzz_testing/model_coverage_metrics.py)：神经元覆盖率指标，包括KMNC，NBC，SNAC。 +3. [image_transform.py](https://gitee.com/mindspore/mindarmour/blob/master/mindarmour/fuzz_testing/image_transform.py)：图像变异方法，包括基于像素值的变化方法和仿射变化方法。 +4. [adversarial attacks](https://gitee.com/mindspore/mindarmour/tree/master/mindarmour/adv_robustness/attacks)：对抗样本攻击方法，包含多种黑盒、白盒攻击方法。 ## 参考文献 [1] Pei K, Cao Y, Yang J, et al. Deepxplore: Automated whitebox testing of deep learning systems[C]//Proceedings of the 26th Symposium on Operating Systems Principles. ACM, 2017: 1-18. -[2]Ma L, Juefei-Xu F, Zhang F, et al. Deepgauge: Multi-granularity testing criteria for deep learning systems[C]//Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering. ACM, 2018: 120-131. \ No newline at end of file +[2]Ma L, Juefei-Xu F, Zhang F, et al. Deepgauge: Multi-granularity testing criteria for deep learning systems[C]//Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering. ACM, 2018: 120-131. -- GitLab