diff --git a/.github/ISSUE_TEMPLATE/inference_bug_report.md b/.github/ISSUE_TEMPLATE/inference_bug_report.md
new file mode 100644
index 0000000000000000000000000000000000000000..d1130beb0a44f662c203e236f45ba6c12c7029bc
--- /dev/null
+++ b/.github/ISSUE_TEMPLATE/inference_bug_report.md
@@ -0,0 +1,41 @@
+---
+name: Bug report (inference)
+about: Create a report to help us improve
+title: "[BUG]"
+labels: bug,inference
+assignees: ''
+
+---
+
+**Describe the bug**
+A clear and concise description of what the bug is.
+
+**To Reproduce**
+Steps to reproduce the behavior:
+1. Simple inference script to reproduce
+2. What packages are required and their versions
+3. How to run the script
+4. ...
+
+**Expected behavior**
+A clear and concise description of what you expected to happen.
+
+**ds_report output**
+Please run `ds_report` to give us details about your setup.
+
+**Screenshots**
+If applicable, add screenshots to help explain your problem.
+
+**System info (please complete the following information):**
+ - OS: [e.g. Ubuntu 18.04]
+ - GPU count and types [e.g. two machines with x8 A100s each]
+ - (if applicable) what [DeepSpeed-MII](https://github.com/microsoft/deepspeed-mii) version are you using
+ - (if applicable) Hugging Face Transformers/Accelerate/etc. versions
+ - Python version
+ - Any other relevant info about your setup
+
+**Docker context**
+Are you using a specific docker image that you can share?
+
+**Additional context**
+Add any other context about the problem here.
diff --git a/.github/ISSUE_TEMPLATE/bug_report.md b/.github/ISSUE_TEMPLATE/training_bug_report.md
similarity index 95%
rename from .github/ISSUE_TEMPLATE/bug_report.md
rename to .github/ISSUE_TEMPLATE/training_bug_report.md
index a053956ee6d88175fd6dee0b7e98406b21dcc3c5..df0f282ee709d8dba1f9147a4042008a300755ed 100644
--- a/.github/ISSUE_TEMPLATE/bug_report.md
+++ b/.github/ISSUE_TEMPLATE/training_bug_report.md
@@ -1,8 +1,8 @@
 ---
-name: Bug report
+name: Bug report (training)
 about: Create a report to help us improve
 title: "[BUG]"
-labels: bug
+labels: bug,training
 assignees: ''
 
 ---