README.md 47.9 KB
Newer Older
1
# Configuration of your jobs with .gitlab-ci.yml
D
Douwe Maan 已提交
2

3
This document describes the usage of `.gitlab-ci.yml`, the file that is used by
4
GitLab Runner to manage your project's jobs.
5

6 7 8 9
From version 7.12, GitLab CI uses a [YAML](https://en.wikipedia.org/wiki/YAML)
file (`.gitlab-ci.yml`) for the project configuration. It is placed in the root
of your repository and contains definitions of how your project should be built.

10 11 12
If you want a quick introduction to GitLab CI, follow our
[quick start guide](../quick_start/README.md).

13 14 15 16 17
NOTE: **Note:**
If you have a [mirrored repository where GitLab pulls from](https://docs.gitlab.com/ee/workflow/repository_mirroring.html#pulling-from-a-remote-repository),
you may need to enable pipeline triggering in your project's
**Settings > Repository > Pull from a remote repository > Trigger pipelines for mirror updates**.

18 19
## Jobs

20
The YAML file defines a set of jobs with constraints stating when they should
21 22 23
be run. You can specify an unlimited number of jobs which are defined as
top-level elements with an arbitrary name and always have to contain at least
the `script` clause.
D
Douwe Maan 已提交
24 25 26 27 28 29 30 31 32

```yaml
job1:
  script: "execute-script-for-job1"

job2:
  script: "execute-script-for-job2"
```

33
The above example is the simplest possible CI/CD configuration with two separate
34 35 36
jobs, where each of the jobs executes a different command.
Of course a command can execute code directly (`./configure;make;make install`)
or run a script (`test.sh`) in the repository.
D
Douwe Maan 已提交
37

38 39 40
Jobs are picked up by [Runners](../runners/README.md) and executed within the
environment of the Runner. What is important, is that each job is run
independently from each other.
D
Douwe Maan 已提交
41

42 43
Each job must have a unique name, but there are a few **reserved `keywords` that
cannot be used as job names**:
D
Douwe Maan 已提交
44

45 46 47 48 49 50 51 52
- `image`
- `services`
- `stages`
- `types`
- `before_script`
- `after_script`
- `variables`
- `cache`
D
Douwe Maan 已提交
53

54
A job is defined by a list of parameters that define the job behavior.
D
Douwe Maan 已提交
55

56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76
| Keyword       | Required | Description |
|---------------|----------|-------------|
| script        | yes      | Defines a shell script which is executed by Runner |
| image         | no       | Use docker image, covered in [Using Docker Images](../docker/using_docker_images.md#define-image-and-services-from-gitlab-ciyml) |
| services      | no       | Use docker services, covered in [Using Docker Images](../docker/using_docker_images.md#define-image-and-services-from-gitlab-ciyml) |
| stage         | no       | Defines a job stage (default: `test`) |
| type          | no       | Alias for `stage` |
| variables     | no       | Define job variables on a job level |
| only          | no       | Defines a list of git refs for which job is created |
| except        | no       | Defines a list of git refs for which job is not created |
| tags          | no       | Defines a list of tags which are used to select Runner |
| allow_failure | no       | Allow job to fail. Failed job doesn't contribute to commit status |
| when          | no       | Define when to run job. Can be `on_success`, `on_failure`, `always` or `manual` |
| dependencies  | no       | Define other jobs that a job depends on so that you can pass artifacts between them|
| artifacts     | no       | Define list of [job artifacts](#artifacts) |
| cache         | no       | Define list of files that should be cached between subsequent runs |
| before_script | no       | Override a set of commands that are executed before job |
| after_script  | no       | Override a set of commands that are executed after job |
| environment   | no       | Defines a name of environment to which deployment is done by this job |
| coverage      | no       | Define code coverage settings for a given job |
| retry         | no       | Define how many times a job can be auto-retried in case of a failure |
77

78
### `pages`
D
Douwe Maan 已提交
79

80 81 82 83 84 85 86 87 88 89 90
`pages` is a special job that is used to upload static content to GitLab that
can be used to serve your website. It has a special syntax, so the two
requirements below must be met:

1. Any static content must be placed under a `public/` directory
1. `artifacts` with a path to the `public/` directory must be defined

The example below simply moves all files from the root of the project to the
`public/` directory. The `.public` workaround is so `cp` doesn't also copy
`public/` to itself in an infinite loop:

P
pityonline 已提交
91
```yaml
92 93
pages:
  stage: deploy
D
Douwe Maan 已提交
94
  script:
P
pityonline 已提交
95 96 97
    - mkdir .public
    - cp -r * .public
    - mv .public public
98 99
  artifacts:
    paths:
P
pityonline 已提交
100
      - public
D
Douwe Maan 已提交
101
  only:
P
pityonline 已提交
102
    - master
D
Douwe Maan 已提交
103 104
```

105
Read more on [GitLab Pages user documentation](../../user/project/pages/index.md).
D
Douwe Maan 已提交
106

107
## `image` and `services`
108 109

This allows to specify a custom Docker image and a list of services that can be
110
used for time of the job. The configuration of this feature is covered in
111
[a separate document](../docker/README.md).
D
Douwe Maan 已提交
112

113
## `before_script` and `after_script`
114

115
> Introduced in GitLab 8.7 and requires Gitlab Runner v1.2
K
Kamil Trzcinski 已提交
116

117 118 119 120
`before_script` is used to define the command that should be run before all
jobs, including deploy jobs, but after the restoration of [artifacts](#artifacts).
This can be an array or a multi-line string.

121
`after_script` is used to define the command that will be run after for all
122
jobs, including failed ones. This has to be an array or a multi-line string.
123

124 125 126 127 128
The `before_script` and the main `script` are concatenated and run in a single context/container.
The `after_script` is run separately, so depending on the executor, changes done
outside of the working tree might not be visible, e.g. software installed in the
`before_script`.

129 130
It's possible to overwrite the globally defined `before_script` and `after_script`
if you set it per-job:
131

132 133
```yaml
before_script:
P
pityonline 已提交
134
  - global before script
135 136 137

job:
  before_script:
P
pityonline 已提交
138
    - execute this instead of global before script
139
  script:
P
pityonline 已提交
140
    - my command
141
  after_script:
P
pityonline 已提交
142
    - execute this after my script
143 144 145
```

## `stages`
D
Douwe Maan 已提交
146

147 148 149 150
`stages` is used to define stages that can be used by jobs and is defined
globally.

The specification of `stages` allows for having flexible multi stage pipelines.
151
The ordering of elements in `stages` defines the ordering of jobs' execution:
D
Douwe Maan 已提交
152

153 154
1. Jobs of the same stage are run in parallel.
1. Jobs of the next stage are run after the jobs from the previous stage
155
   complete successfully.
D
Douwe Maan 已提交
156 157

Let's consider the following example, which defines 3 stages:
158 159

```yaml
D
Douwe Maan 已提交
160 161 162 163 164 165
stages:
  - build
  - test
  - deploy
```

166
1. First, all jobs of `build` are executed in parallel.
167 168
1. If all jobs of `build` succeed, the `test` jobs are executed in parallel.
1. If all jobs of `test` succeed, the `deploy` jobs are executed in parallel.
169
1. If all jobs of `deploy` succeed, the commit is marked as `passed`.
170 171
1. If any of the previous jobs fails, the commit is marked as `failed` and no
   jobs of further stage are executed.
172

173
There are also two edge cases worth mentioning:
174

175 176 177
1. If no `stages` are defined in `.gitlab-ci.yml`, then the `build`,
   `test` and `deploy` are allowed to be used as job's stage by default.
2. If a job doesn't specify a `stage`, the job is assigned the `test` stage.
178

179
## `stage`
180

181 182 183
`stage` is defined per-job and relies on [`stages`](#stages) which is defined
globally. It allows to group jobs into different stages, and jobs of the same
`stage` are executed in `parallel`. For example:
D
Douwe Maan 已提交
184 185

```yaml
186 187 188 189 190 191 192 193 194 195 196 197 198 199
stages:
  - build
  - test
  - deploy

job 1:
  stage: build
  script: make build dependencies

job 2:
  stage: build
  script: make build artifacts

job 3:
D
Douwe Maan 已提交
200
  stage: test
201 202 203 204 205
  script: make test

job 4:
  stage: deploy
  script: make deploy
D
Douwe Maan 已提交
206 207
```

208
## `types`
D
Douwe Maan 已提交
209

210 211 212
CAUTION: **Deprecated:**
`types` is deprecated, and could be removed in one of the future releases.
Use [stages](#stages) instead.
213

214 215 216 217
## `script`

`script` is the only required keyword that a job needs. It's a shell script
which is executed by the Runner. For example:
D
Douwe Maan 已提交
218 219 220 221 222 223 224

```yaml
job:
  script: "bundle exec rspec"
```

This parameter can also contain several commands using an array:
225

D
Douwe Maan 已提交
226 227 228 229 230 231 232
```yaml
job:
  script:
    - uname -a
    - bundle exec rspec
```

233 234 235 236 237
Sometimes, `script` commands will need to be wrapped in single or double quotes.
For example, commands that contain a colon (`:`) need to be wrapped in quotes so
that the YAML parser knows to interpret the whole thing as a string rather than
a "key: value" pair. Be careful when using special characters:
`:`, `{`, `}`, `[`, `]`, `,`, `&`, `*`, `#`, `?`, `|`, `-`, `<`, `>`, `=`, `!`, `%`, `@`, `` ` ``.
238

239
## `only` and `except` (simplified)
D
Douwe Maan 已提交
240

241 242
`only` and `except` are two parameters that set a job policy to limit when
jobs are created:
D
Douwe Maan 已提交
243

244
1. `only` defines the names of branches and tags for which the job will run.
245
2. `except` defines the names of branches and tags for which the job will
246
    **not** run.
247

248
There are a few rules that apply to the usage of job policy:
249 250 251 252 253 254 255

* `only` and `except` are inclusive. If both `only` and `except` are defined
   in a job specification, the ref is filtered by `only` and `except`.
* `only` and `except` allow the use of regular expressions.
* `only` and `except` allow to specify a repository path to filter jobs for
   forks.

256 257 258 259 260 261 262 263 264 265 266 267 268 269
In addition, `only` and `except` allow the use of special keywords:

| **Value** |  **Description**  |
| --------- |  ---------------- |
| `branches`  | When a branch is pushed.  |
| `tags`      | When a tag is pushed.  |
| `api`       | When pipeline has been triggered by a second pipelines API (not triggers API).  |
| `external`  | When using CI services other than GitLab. |
| `pipelines` | For multi-project triggers, created using the API with `CI_JOB_TOKEN`. |
| `pushes`    | Pipeline is triggered by a `git push` by the user. |
| `schedules` | For [scheduled pipelines][schedules]. |
| `triggers`  | For pipelines created using a trigger token. |
| `web`       | For pipelines created using **Run pipeline** button in GitLab UI (under your project's **Pipelines**). |

270
In the example below, `job` will run only for refs that start with `issue-`,
271
whereas all branches will be skipped:
D
Douwe Maan 已提交
272 273 274

```yaml
job:
275
  # use regexp
D
Douwe Maan 已提交
276
  only:
277 278
    - /^issue-.*$/
  # use special keyword
D
Douwe Maan 已提交
279
  except:
280
    - branches
D
Douwe Maan 已提交
281 282
```

283
In this example, `job` will run only for refs that are tagged, or if a build is
284
explicitly requested via an API trigger or a [Pipeline Schedule][schedules]:
285 286 287 288 289 290 291

```yaml
job:
  # use special keywords
  only:
    - tags
    - triggers
292
    - schedules
293 294
```

295 296
The repository path can be used to have jobs executed only for the parent
repository and not forks:
297 298 299 300 301 302 303 304

```yaml
job:
  only:
    - branches@gitlab-org/gitlab-ce
  except:
    - master@gitlab-org/gitlab-ce
```
305 306 307

The above example will run `job` for all branches on `gitlab-org/gitlab-ce`,
except master.
308

309
## `only` and `except` (complex)
310

311
> `refs` and `kubernetes` policies introduced in GitLab 10.0
312

313
> `variables` policy introduced in 10.7
314

315 316 317
CAUTION: **Warning:**
This an _alpha_ feature, and it it subject to change at any time without
prior notice!
318

319 320
Since GitLab 10.0 it is possible to define a more elaborate only/except job
policy configuration.
321 322

GitLab now supports both, simple and complex strategies, so it is possible to
323
use an array and a hash configuration scheme.
324

325 326 327 328 329
Three keys are now available: `refs`, `kubernetes` and `variables`.
Refs strategy equals to simplified only/except configuration, whereas
kubernetes strategy accepts only `active` keyword.

`variables` keyword is used to define variables expressions. In other words
330
you can use predefined variables / project / group or
331 332
environment-scoped variables to define an expression GitLab is going to
evaluate in order to decide whether a job should be created or not.
333 334 335 336 337 338 339 340 341 342 343 344 345 346

See the example below. Job is going to be created only when pipeline has been
scheduled or runs for a `master` branch, and only if kubernetes service is
active in the project.

```yaml
job:
  only:
    refs:
      - master
      - schedules
    kubernetes: active
```

347
Examples of using variables expressions:
348 349 350

```yaml
deploy:
351
  script: cap staging deploy
352 353 354 355 356 357 358 359
  only:
    refs:
      - branches
    variables:
      - $RELEASE == "staging"
      - $STAGING
```

360 361 362 363 364 365 366 367 368 369
Another use case is exluding jobs depending on a commit message _(added in 11.0)_:

```yaml
end-to-end:
  script: rake test:end-to-end
  except:
    variables:
      - $CI_COMMIT_MESSAGE =~ /skip-end-to-end-tests/
```

370
Learn more about variables expressions on [a separate page][variables-expressions].
371

372
## `tags`
D
Douwe Maan 已提交
373

374
`tags` is used to select specific Runners from the list of all Runners that are
375
allowed to run this project.
D
Douwe Maan 已提交
376

377
During the registration of a Runner, you can specify the Runner's tags, for
378 379
example `ruby`, `postgres`, `development`.

380
`tags` allow you to run jobs with Runners that have the specified tags
381 382 383
assigned to them:

```yaml
D
Douwe Maan 已提交
384 385 386 387 388 389
job:
  tags:
    - ruby
    - postgres
```

390
The specification above, will make sure that `job` is built by a Runner that
391
has both `ruby` AND `postgres` tags defined.
D
Douwe Maan 已提交
392

393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414
Tags are also a great way to run different jobs on different platforms, for
example, given an OS X Runner with tag `osx` and Windows Runner with tag
`windows`, the following jobs run on respective platforms:

```yaml
windows job:
  stage:
    - build
  tags:
    - windows
  script:
    - echo Hello, %USERNAME%!

osx job:
  stage:
    - build
  tags:
    - osx
  script:
    - echo "Hello, $USER!"
```

415
## `allow_failure`
416

417 418
`allow_failure` is used when you want to allow a job to fail without impacting
the rest of the CI suite. Failed jobs don't contribute to the commit status.
419

420
When enabled and the job fails, the pipeline will be successful/green for all
421
intents and purposes, but a "CI build passed with warnings" message  will be
422 423
displayed on the merge request or commit or job page. This is to be used by
jobs that are allowed to fail, but where failure indicates some other (manual)
424 425 426 427 428 429 430 431 432 433
steps should be taken elsewhere.

In the example below, `job1` and `job2` will run in parallel, but if `job1`
fails, it will not stop the next stage from running, since it's marked with
`allow_failure: true`:

```yaml
job1:
  stage: test
  script:
P
pityonline 已提交
434
    - execute_script_that_will_fail
435 436 437 438 439
  allow_failure: true

job2:
  stage: test
  script:
P
pityonline 已提交
440
    - execute_script_that_will_succeed
441 442 443 444

job3:
  stage: deploy
  script:
P
pityonline 已提交
445
    - deploy_to_staging
446 447
```

448
## `when`
449 450 451

`when` is used to implement jobs that are run in case of failure or despite the
failure.
452

R
Robert Speicher 已提交
453 454
`when` can be set to one of the following values:

455
1. `on_success` - execute job only when all jobs from prior stages
456
    succeed. This is the default.
457
1. `on_failure` - execute job only when at least one job from prior stages
458
    fails.
459 460
1. `always` - execute job regardless of the status of jobs from prior stages.
1. `manual` - execute job manually (added in GitLab 8.10). Read about
461
    [manual actions](#when-manual) below.
462

463 464 465
For example:

```yaml
466
stages:
P
pityonline 已提交
467 468 469 470 471
  - build
  - cleanup_build
  - test
  - deploy
  - cleanup
472

473
build_job:
474 475
  stage: build
  script:
P
pityonline 已提交
476
    - make build
477

478
cleanup_build_job:
479 480
  stage: cleanup_build
  script:
P
pityonline 已提交
481
    - cleanup build when failed
482 483
  when: on_failure

484
test_job:
485 486
  stage: test
  script:
P
pityonline 已提交
487
    - make test
488

489
deploy_job:
490 491
  stage: deploy
  script:
P
pityonline 已提交
492
    - make deploy
493
  when: manual
494

495
cleanup_job:
496 497
  stage: cleanup
  script:
P
pityonline 已提交
498
    - cleanup after jobs
499 500 501 502
  when: always
```

The above script will:
503

504 505 506 507
1. Execute `cleanup_build_job` only when `build_job` fails.
2. Always execute `cleanup_job` as the last step in pipeline regardless of
   success or failure.
3. Allow you to manually execute `deploy_job` from GitLab's UI.
508

509
### `when:manual`
510

511 512 513 514
> **Notes:**
- Introduced in GitLab 8.10.
- Blocking manual actions were introduced in GitLab 9.0.
- Protected actions were introduced in GitLab 9.2.
515

516 517 518 519 520
Manual actions are a special type of job that are not executed automatically,
they need to be explicitly started by a user. An example usage of manual actions
would be a deployment to a production environment. Manual actions can be started
from the pipeline, job, environment, and deployment views. Read more at the
[environments documentation][env-manual].
521

522 523
Manual actions can be either optional or blocking. Blocking manual actions will
block the execution of the pipeline at the stage this action is defined in. It's
524
possible to resume execution of the pipeline when someone executes a blocking
525
manual action by clicking a _play_ button.
526

527
When a pipeline is blocked, it will not be merged if Merge When Pipeline Succeeds
528 529 530 531 532
is set. Blocked pipelines also do have a special status, called _manual_.
Manual actions are non-blocking by default. If you want to make manual action
blocking, it is necessary to add `allow_failure: false` to the job's definition
in `.gitlab-ci.yml`.

533 534 535
Optional manual actions have `allow_failure: true` set by default and their
Statuses do not contribute to the overall pipeline status. So, if a manual
action fails, the pipeline will eventually succeed.
536

537 538 539 540 541
Manual actions are considered to be write actions, so permissions for
[protected branches](../../user/project/protected_branches.md) are used when
user wants to trigger an action. In other words, in order to trigger a manual
action assigned to a branch that the pipeline is running for, user needs to
have ability to merge to this branch.
542

543
## `environment`
544

545 546 547 548 549
>
**Notes:**
- Introduced in GitLab 8.9.
- You can read more about environments and find more examples in the
  [documentation about environments][environment].
550

551
`environment` is used to define that a job deploys to a specific environment.
M
Mark Pundsack 已提交
552 553
If `environment` is specified and no environment under that name exists, a new
one will be created automatically.
554

555
In its simplest form, the `environment` keyword can be defined like:
556

557
```yaml
558 559 560
deploy to production:
  stage: deploy
  script: git push production HEAD:master
561 562
  environment:
    name: production
563 564
```

565 566 567
In the above example, the `deploy to production` job will be marked as doing a
deployment to the `production` environment.

568
### `environment:name`
569

570 571 572 573 574 575
>
**Notes:**
- Introduced in GitLab 8.11.
- Before GitLab 8.11, the name of an environment could be defined as a string like
  `environment: production`. The recommended way now is to define it under the
  `name` keyword.
576 577 578
- The `name` parameter can use any of the defined CI variables,
  including predefined, secure variables and `.gitlab-ci.yml` [`variables`](#variables).
  You however cannot use variables defined under `script`.
579

580 581 582 583 584 585 586 587 588 589 590 591 592 593 594
The `environment` name can contain:

- letters
- digits
- spaces
- `-`
- `_`
- `/`
- `$`
- `{`
- `}`

Common names are `qa`, `staging`, and `production`, but you can use whatever
name works with your workflow.

595 596 597 598
Instead of defining the name of the environment right after the `environment`
keyword, it is also possible to define it as a separate value. For that, use
the `name` keyword under `environment`:

599
```yaml
600 601 602 603 604 605 606
deploy to production:
  stage: deploy
  script: git push production HEAD:master
  environment:
    name: production
```

607
### `environment:url`
608

609 610 611 612 613
>
**Notes:**
- Introduced in GitLab 8.11.
- Before GitLab 8.11, the URL could be added only in GitLab's UI. The
  recommended way now is to define it in `.gitlab-ci.yml`.
614 615 616
- The `url` parameter can use any of the defined CI variables,
  including predefined, secure variables and `.gitlab-ci.yml` [`variables`](#variables).
  You however cannot use variables defined under `script`.
617 618 619 620 621 622 623 624

This is an optional value that when set, it exposes buttons in various places
in GitLab which when clicked take you to the defined URL.

In the example below, if the job finishes successfully, it will create buttons
in the merge requests and in the environments/deployments pages which will point
to `https://prod.example.com`.

625
```yaml
626 627 628 629 630 631 632 633
deploy to production:
  stage: deploy
  script: git push production HEAD:master
  environment:
    name: production
    url: https://prod.example.com
```

634
### `environment:on_stop`
635

636 637 638 639 640 641
>
**Notes:**
- [Introduced][ce-6669] in GitLab 8.13.
- Starting with GitLab 8.14, when you have an environment that has a stop action
  defined, GitLab will automatically trigger a stop action when the associated
  branch is deleted.
642 643 644 645 646 647 648

Closing (stoping) environments can be achieved with the `on_stop` keyword defined under
`environment`. It declares a different job that runs in order to close
the environment.

Read the `environment:action` section for an example.

649
### `environment:action`
650 651 652 653 654 655

> [Introduced][ce-6669] in GitLab 8.13.

The `action` keyword is to be used in conjunction with `on_stop` and is defined
in the job that is called to close the environment.

656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735
Take for instance:

```yaml
review_app:
  stage: deploy
  script: make deploy-app
  environment:
    name: review
    on_stop: stop_review_app

stop_review_app:
  stage: deploy
  script: make delete-app
  when: manual
  environment:
    name: review
    action: stop
```

In the above example we set up the `review_app` job to deploy to the `review`
environment, and we also defined a new `stop_review_app` job under `on_stop`.
Once the `review_app` job is successfully finished, it will trigger the
`stop_review_app` job based on what is defined under `when`. In this case we
set it up to `manual` so it will need a [manual action](#manual-actions) via
GitLab's web interface in order to run.

The `stop_review_app` job is **required** to have the following keywords defined:

- `when` - [reference](#when)
- `environment:name`
- `environment:action`
- `stage` should be the same as the `review_app` in order for the environment
  to stop automatically when the branch is deleted

### Dynamic environments

>
**Notes:**
- [Introduced][ce-6323] in GitLab 8.12 and GitLab Runner 1.6.
- The `$CI_ENVIRONMENT_SLUG` was [introduced][ce-7983] in GitLab 8.15.
- The `name` and `url` parameters can use any of the defined CI variables,
  including predefined, secure variables and `.gitlab-ci.yml` [`variables`](#variables).
  You however cannot use variables defined under `script`.

For example:

```yaml
deploy as review app:
  stage: deploy
  script: make deploy
  environment:
    name: review/$CI_COMMIT_REF_NAME
    url: https://$CI_ENVIRONMENT_SLUG.example.com/
```

The `deploy as review app` job will be marked as deployment to dynamically
create the `review/$CI_COMMIT_REF_NAME` environment, where `$CI_COMMIT_REF_NAME`
is an [environment variable][variables] set by the Runner. The
`$CI_ENVIRONMENT_SLUG` variable is based on the environment name, but suitable
for inclusion in URLs. In this case, if the `deploy as review app` job was run
in a branch named `pow`, this environment would be accessible with an URL like
`https://review-pow.example.com/`.

This of course implies that the underlying server which hosts the application
is properly configured.

The common use case is to create dynamic environments for branches and use them
as Review Apps. You can see a simple example using Review Apps at
<https://gitlab.com/gitlab-examples/review-apps-nginx/>.

## `cache`

>
**Notes:**
- Introduced in GitLab Runner v0.7.0.
- `cache` can be set globally and per-job.
- From GitLab 9.0, caching is enabled and shared between pipelines and jobs
  by default.
- From GitLab 9.2, caches are restored before [artifacts](#artifacts).

736 737 738 739
TIP: **Learn more:**
Read how caching works and find out some good practices in the
[caching dependencies documentation](../caching/index.md).

740 741 742 743 744 745 746
`cache` is used to specify a list of files and directories which should be
cached between jobs. You can only use paths that are within the project
workspace.

If `cache` is defined outside the scope of jobs, it means it is set
globally and all jobs will use that definition.

747
### `cache:paths`
748

749 750
Use the `paths` directive to choose which files or directories will be cached.
Wildcards can be used as well.
751

752
Cache all files in `binaries` that end in `.apk` and the `.config` file:
753 754 755 756 757 758

```yaml
rspec:
  script: test
  cache:
    paths:
P
pityonline 已提交
759 760
      - binaries/*.apk
      - .config
761 762 763 764 765 766 767 768
```

Locally defined cache overrides globally defined options. The following `rspec`
job will cache only `binaries/`:

```yaml
cache:
  paths:
P
pityonline 已提交
769
    - my/files
770 771 772 773

rspec:
  script: test
  cache:
774
    key: rspec
775
    paths:
P
pityonline 已提交
776
      - binaries/
777 778
```

779 780 781 782
Note that since cache is shared between jobs, if you're using different
paths for different jobs, you should also set a different **cache:key**
otherwise cache content can be overwritten.

783 784 785 786
### `cache:key`

> Introduced in GitLab Runner v1.0.0.

787 788 789
Since the cache is shared between jobs, if you're using different
paths for different jobs, you should also set a different `cache:key`
otherwise cache content can be overwritten.
790

791 792 793 794
The `key` directive allows you to define the affinity of caching between jobs,
allowing to have a single cache for all jobs, cache per-job, cache per-branch
or any other way that fits your workflow. This way, you can fine tune caching,
allowing you to cache data between different jobs or even different branches.
795 796

The `cache:key` variable can use any of the
797 798 799
[predefined variables](../variables/README.md), and the default key, if not
set, is just literal `default` which means everything is shared between each
pipelines and jobs by default, starting from GitLab 9.0.
800 801 802 803 804

NOTE: **Note:**
The `cache:key` variable cannot contain the `/` character, or the equivalent
URI-encoded `%2F`; a value made only of dots (`.`, `%2E`) is also forbidden.

805
For example, to enable per-branch caching:
806 807 808 809

```yaml
cache:
  key: "$CI_COMMIT_REF_SLUG"
810
  paths:
P
pityonline 已提交
811
    - binaries/
812 813
```

814 815
If you use **Windows Batch** to run your shell scripts you need to replace
`$` with `%`:
816 817 818

```yaml
cache:
819
  key: "%CI_COMMIT_REF_SLUG%"
820
  paths:
P
pityonline 已提交
821
    - binaries/
822 823
```

824 825 826 827
### `cache:untracked`

Set `untracked: true` to cache all files that are untracked in your Git
repository:
828 829

```yaml
830 831 832 833
rspec:
  script: test
  cache:
    untracked: true
834 835
```

836
Cache all Git untracked files and files in `binaries`:
837 838

```yaml
839 840 841 842 843
rspec:
  script: test
  cache:
    untracked: true
    paths:
P
pityonline 已提交
844
      - binaries/
845 846
```

847
### `cache:policy`
848

849
> Introduced in GitLab 9.4.
850

851 852 853 854
The default behaviour of a caching job is to download the files at the start of
execution, and to re-upload them at the end. This allows any changes made by the
job to be persisted for future runs, and is known as the `pull-push` cache
policy.
855

856 857 858 859
If you know the job doesn't alter the cached files, you can skip the upload step
by setting `policy: pull` in the job specification. Typically, this would be
twinned with an ordinary cache job at an earlier stage to ensure the cache
is updated from time to time:
860

861 862 863 864
```yaml
stages:
  - setup
  - test
865

866 867 868 869 870 871 872 873
prepare:
  stage: setup
  cache:
    key: gems
    paths:
      - vendor/bundle
  script:
    - bundle install --deployment
874

875 876 877 878 879 880 881 882 883
rspec:
  stage: test
  cache:
    key: gems
    paths:
      - vendor/bundle
    policy: pull
  script:
    - bundle exec rspec ...
884 885
```

886 887 888
This helps to speed up job execution and reduce load on the cache server,
especially when you have a large number of cache-using jobs executing in
parallel.
889

890 891 892
Additionally, if you have a job that unconditionally recreates the cache without
reference to its previous contents, you can use `policy: push` in that job to
skip the download step.
893

894
## `artifacts`
K
Kamil Trzcinski 已提交
895

896
>
897 898 899
**Notes:**
- Introduced in GitLab Runner v0.7.0 for non-Windows platforms.
- Windows support was added in GitLab Runner v.1.0.0.
900
- From GitLab 9.2, caches are restored before artifacts.
901
- Not all executors are [supported](https://docs.gitlab.com/runner/executors/#compatibility-chart).
902
- Job artifacts are only collected for successful jobs by default.
903

904
`artifacts` is used to specify a list of files and directories which should be
905
attached to the job after success.
906

907 908
The artifacts will be sent to GitLab after the job finishes successfully and will
be available for download in the GitLab UI.
909

910
[Read more about artifacts.](../../user/project/pipelines/job_artifacts.md)
911

912
### `artifacts:paths`
913

914 915
You can only use paths that are within the project workspace. To pass artifacts
between different jobs, see [dependencies](#dependencies).
916

917
Send all files in `binaries` and `.config`:
K
Kamil Trzcinski 已提交
918

919 920 921
```yaml
artifacts:
  paths:
P
pityonline 已提交
922 923
    - binaries/
    - .config
924
```
K
Kamil Trzcinski 已提交
925

926 927 928 929 930 931 932 933 934
To disable artifact passing, define the job with empty [dependencies](#dependencies):

```yaml
job:
  stage: build
  script: make build
  dependencies: []
```

935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951
You may want to create artifacts only for tagged releases to avoid filling the
build server storage with temporary build artifacts.

Create artifacts only for tags (`default-job` will not create artifacts):

```yaml
default-job:
  script:
    - mvn test -U
  except:
    - tags

release-job:
  script:
    - mvn package -U
  artifacts:
    paths:
P
pityonline 已提交
952
      - target/*.war
953 954 955 956
  only:
    - tags
```

957
### `artifacts:name`
958

959
> Introduced in GitLab 8.6 and GitLab Runner v1.1.0.
960

A
Achilleas Pipinellis 已提交
961
The `name` directive allows you to define the name of the created artifacts
962
archive. That way, you can have a unique name for every archive which could be
A
Achilleas Pipinellis 已提交
963 964
useful when you'd like to download the archive from GitLab. The `artifacts:name`
variable can make use of any of the [predefined variables](../variables/README.md).
965
The default name is `artifacts`, which becomes `artifacts.zip` when downloaded.
966

967 968 969 970 971
NOTE: **Note:**
If your branch-name contains forward slashes
(e.g. `feature/my-feature`) it is advised to use `$CI_COMMIT_REF_SLUG`
instead of `$CI_COMMIT_REF_NAME` for proper naming of the artifact.

972
To create an archive with a name of the current job:
973 974 975 976

```yaml
job:
  artifacts:
Z
Z.J. van de Weg 已提交
977
    name: "$CI_JOB_NAME"
978
    paths:
P
pityonline 已提交
979
      - binaries/
980 981
```

A
Achilleas Pipinellis 已提交
982
To create an archive with a name of the current branch or tag including only
983
the binaries directory:
984 985 986

```yaml
job:
987 988
  artifacts:
    name: "$CI_COMMIT_REF_NAME"
989
    paths:
P
pityonline 已提交
990
      - binaries/
991 992
```

993
To create an archive with a name of the current job and the current branch or
994
tag including only the binaries directory:
995 996 997 998

```yaml
job:
  artifacts:
J
John Burak 已提交
999
    name: "$CI_JOB_NAME-$CI_COMMIT_REF_NAME"
1000
    paths:
P
pityonline 已提交
1001
      - binaries/
1002 1003
```

A
Achilleas Pipinellis 已提交
1004
To create an archive with a name of the current [stage](#stages) and branch name:
1005 1006 1007 1008

```yaml
job:
  artifacts:
J
John Burak 已提交
1009
    name: "$CI_JOB_STAGE-$CI_COMMIT_REF_NAME"
1010
    paths:
P
pityonline 已提交
1011
      - binaries/
1012 1013
```

A
Achilleas Pipinellis 已提交
1014 1015
---

1016 1017 1018 1019 1020 1021
If you use **Windows Batch** to run your shell scripts you need to replace
`$` with `%`:

```yaml
job:
  artifacts:
J
John Burak 已提交
1022
    name: "%CI_JOB_STAGE%-%CI_COMMIT_REF_NAME%"
1023
    paths:
P
pityonline 已提交
1024
      - binaries/
1025 1026
```

1027 1028 1029 1030 1031 1032
If you use **Windows PowerShell** to run your shell scripts you need to replace
`$` with `$env:`:

```yaml
job:
  artifacts:
J
John Burak 已提交
1033
    name: "$env:CI_JOB_STAGE-$env:CI_COMMIT_REF_NAME"
1034
    paths:
P
pityonline 已提交
1035
      - binaries/
1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 1047 1048 1049 1050 1051 1052 1053 1054 1055 1056 1057 1058 1059
```

### `artifacts:untracked`

`artifacts:untracked` is used to add all Git untracked files as artifacts (along
to the paths defined in `artifacts:paths`).

NOTE: **Note:**
To exclude the folders/files which should not be a part of `untracked` just
add them to `.gitignore`.

Send all Git untracked files:

```yaml
artifacts:
  untracked: true
```

Send all Git untracked files and files in `binaries`:

```yaml
artifacts:
  untracked: true
  paths:
P
pityonline 已提交
1060
    - binaries/
1061 1062
```

1063
### `artifacts:when`
1064

1065
> Introduced in GitLab 8.9 and GitLab Runner v1.3.0.
1066

1067
`artifacts:when` is used to upload artifacts on job failure or despite the
1068 1069 1070 1071
failure.

`artifacts:when` can be set to one of the following values:

1072 1073 1074
1. `on_success` - upload artifacts only when the job succeeds. This is the default.
1. `on_failure` - upload artifacts only when the job fails.
1. `always` - upload artifacts regardless of the job status.
1075

1076
To upload artifacts only when job fails:
1077 1078 1079 1080 1081 1082 1083

```yaml
job:
  artifacts:
    when: on_failure
```

1084
### `artifacts:expire_in`
1085

1086
> Introduced in GitLab 8.9 and GitLab Runner v1.3.0.
1087

1088 1089 1090 1091 1092
`expire_in` allows you to specify how long artifacts should live before they
expire and therefore deleted, counting from the time they are uploaded and
stored on GitLab. If the expiry time is not defined, it defaults to the
[instance wide setting](../../user/admin_area/settings/continuous_integration.md#default-artifacts-expiration)
(30 days by default, forever on GitLab.com).
1093

1094
You can use the **Keep** button on the job page to override expiration and
1095
keep artifacts forever.
1096

1097 1098
After their expiry, artifacts are deleted hourly by default (via a cron job),
and are not accessible anymore.
1099

1100 1101
The value of `expire_in` is an elapsed time in seconds, unless a unit is
provided. Examples of parsable values:
1102

1103
- '42'
1104 1105 1106 1107 1108 1109 1110
- '3 mins 4 sec'
- '2 hrs 20 min'
- '2h20min'
- '6 mos 1 day'
- '47 yrs 6 mos and 4d'
- '3 weeks and 2 days'

1111
To expire artifacts 1 week after being uploaded:
1112 1113 1114 1115 1116 1117 1118

```yaml
job:
  artifacts:
    expire_in: 1 week
```

1119 1120 1121 1122 1123 1124 1125 1126 1127 1128 1129 1130 1131 1132 1133 1134 1135 1136 1137 1138 1139 1140 1141 1142 1143 1144 1145 1146 1147 1148 1149 1150 1151 1152 1153 1154 1155 1156 1157 1158 1159 1160 1161 1162 1163 1164
### `artifacts:reports`

> [Introduced](https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/20390) in
GitLab 11.2. Requires GitLab Runner 11.2 and above.

The `reports` keyword is used for collecting test reports from jobs and
exposing them in GitLab's UI (merge requests, pipeline views). Read how to use
this with [JUnit reports](#artifacts-reports-junit).

NOTE: **Note:**
The test reports are collected regardless of the job results (success or failure).
You can use [`artifacts:expire_in`](#artifacts-expire_in) to set up an expiration
date for their artifacts.

#### `artifacts:reports:junit`

> [Introduced](https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/20390) in
GitLab 11.2. Requires GitLab Runner 11.2 and above.

The `junit` report collects [JUnit XML files](https://www.ibm.com/support/knowledgecenter/en/SSQ2R2_14.1.0/com.ibm.rsar.analysis.codereview.cobol.doc/topics/cac_useresults_junit.html)
as artifacts. Although JUnit was originally developed in Java, there are many
[third party ports](https://en.wikipedia.org/wiki/JUnit#Ports) for other
languages like Javascript, Python, Ruby, etc.

Below is an example of collecting a JUnit XML file from Ruby's RSpec test tool:

```yaml
rspec:
  stage: test
  script:
  - bundle install
  - rspec --format RspecJunitFormatter --out rspec.xml
  artifacts:
    reports:
      junit: rspec.xml
```

The collected JUnit reports will be uploaded to GitLab as an artifact and will
be automatically [shown in merge requests](../junit_test_reports.md).

NOTE: **Note:**
In case the JUnit tool you use exports to multiple XML files, you can specify
multiple test report paths within a single job
(`junit: [rspec-1.xml, rspec-2.xml, rspec-3.xml]`) and they will be automatically
concatenated into a single file.

1165
## `dependencies`
1166

1167
> Introduced in GitLab 8.6 and GitLab Runner v1.1.1.
1168

1169
This feature should be used in conjunction with [`artifacts`](#artifacts) and
1170
allows you to define the artifacts to pass between different jobs.
1171

1172
Note that `artifacts` from all previous [stages](#stages) are passed by default.
1173

1174
To use this feature, define `dependencies` in context of the job and pass
1175 1176
a list of all previous jobs from which the artifacts should be downloaded.
You can only define jobs from stages that are executed before the current one.
S
Shinya Maeda 已提交
1177
An error will be shown if you define jobs from the current stage or next ones.
1178
Defining an empty array will skip downloading any artifacts for that job.
F
Fabio Busatto 已提交
1179 1180
The status of the previous job is not considered when using `dependencies`, so
if it failed or it is a manual job that was not run, no error occurs.
1181 1182

---
1183

1184 1185 1186 1187 1188
In the following example, we define two jobs with artifacts, `build:osx` and
`build:linux`. When the `test:osx` is executed, the artifacts from `build:osx`
will be downloaded and extracted in the context of the build. The same happens
for `test:linux` and artifacts from `build:linux`.

1189
The job `deploy` will download artifacts from all previous jobs because of
1190
the [stage](#stages) precedence:
1191

1192
```yaml
1193 1194
build:osx:
  stage: build
1195
  script: make build:osx
1196 1197
  artifacts:
    paths:
P
pityonline 已提交
1198
      - binaries/
1199

1200 1201
build:linux:
  stage: build
1202
  script: make build:linux
1203 1204
  artifacts:
    paths:
P
pityonline 已提交
1205
      - binaries/
1206 1207 1208

test:osx:
  stage: test
1209
  script: make test:osx
1210
  dependencies:
P
pityonline 已提交
1211
    - build:osx
1212 1213 1214

test:linux:
  stage: test
1215
  script: make test:linux
1216
  dependencies:
P
pityonline 已提交
1217
    - build:linux
1218 1219 1220

deploy:
  stage: deploy
1221
  script: make deploy
1222 1223
```

1224
### When a dependent job will fail
1225 1226

> Introduced in GitLab 10.3.
S
Shinya Maeda 已提交
1227

1228 1229 1230 1231
If the artifacts of the job that is set as a dependency have been
[expired](#artifacts-expire_in) or
[erased](../../user/project/pipelines/job_artifacts.md#erasing-artifacts), then
the dependent job will fail.
S
Shinya Maeda 已提交
1232

1233 1234 1235 1236
NOTE: **Note:**
You can ask your administrator to
[flip this switch](../../administration/job_artifacts.md#validation-for-dependencies)
and bring back the old behavior.
S
Shinya Maeda 已提交
1237

1238
## `coverage`
1239

1240
> [Introduced][ce-7447] in GitLab 8.17.
1241

1242 1243
`coverage` allows you to configure how code coverage will be extracted from the
job output.
1244

1245 1246 1247 1248 1249 1250
Regular expressions are the only valid kind of value expected here. So, using
surrounding `/` is mandatory in order to consistently and explicitly represent
a regular expression string. You must escape special characters if you want to
match them literally.

A simple example:
1251 1252 1253

```yaml
job1:
1254
  script: rspec
M
Max Raab 已提交
1255
  coverage: '/Code coverage: \d+\.\d+/'
1256 1257
```

1258
## `retry`
1259

G
George Tsiolis 已提交
1260
> [Introduced][ce-12909] in GitLab 9.5.
1261 1262 1263 1264 1265 1266 1267

`retry` allows you to configure how many times a job is going to be retried in
case of a failure.

When a job fails, and has `retry` configured it is going to be processed again
up to the amount of times specified by the `retry` keyword.

1268
If `retry` is set to 2, and a job succeeds in a second run (first retry), it won't be retried
1269
again. `retry` value has to be a positive integer, equal or larger than 0, but
1270
lower or equal to 2 (two retries maximum, three runs in total).
1271 1272 1273 1274 1275 1276

A simple example:

```yaml
test:
  script: rspec
1277
  retry: 2
1278 1279
```

1280 1281 1282 1283 1284 1285 1286 1287 1288 1289 1290 1291 1292 1293 1294 1295 1296 1297 1298 1299 1300 1301 1302 1303 1304 1305 1306 1307 1308 1309 1310 1311 1312 1313 1314 1315 1316
## `variables`

> Introduced in GitLab Runner v0.5.0.

NOTE: **Note:**
Integers (as well as strings) are legal both for variable's name and value.
Floats are not legal and cannot be used.

GitLab CI/CD allows you to define variables inside `.gitlab-ci.yml` that are
then passed in the job environment. They can be set globally and per-job.
When the `variables` keyword is used on a job level, it overrides the global
YAML variables and predefined ones.

They are stored in the Git repository and are meant to store non-sensitive
project configuration, for example:

```yaml
variables:
  DATABASE_URL: "postgres://postgres@postgres/my_database"
```

These variables can be later used in all executed commands and scripts.
The YAML-defined variables are also set to all created service containers,
thus allowing to fine tune them.

To turn off global defined variables in a specific job, define an empty hash:

```yaml
job_name:
  variables: {}
```

Except for the user defined variables, there are also the ones [set up by the
Runner itself](../variables/README.md#predefined-variables-environment-variables).
One example would be `CI_COMMIT_REF_NAME` which has the value of
the branch or tag name for which project is built. Apart from the variables
you can set in `.gitlab-ci.yml`, there are also the so called
1317
[Variables](../variables/README.md#variables)
1318 1319 1320 1321 1322
which can be set in GitLab's UI.

[Learn more about variables and their priority.][variables]

### Git strategy
M
Mark Pundsack 已提交
1323

N
Nick Thomas 已提交
1324 1325 1326 1327 1328
> Introduced in GitLab 8.9 as an experimental feature.  May change or be removed
  completely in future releases. `GIT_STRATEGY=none` requires GitLab Runner
  v1.7+.

You can set the `GIT_STRATEGY` used for getting recent application code, either
1329 1330
globally or per-job in the [`variables`](#variables) section. If left
unspecified, the default from project settings will be used.
M
Mark Pundsack 已提交
1331

N
Nick Thomas 已提交
1332 1333 1334 1335
There are three possible values: `clone`, `fetch`, and `none`.

`clone` is the slowest option. It clones the repository from scratch for every
job, ensuring that the project workspace is always pristine.
M
Mark Pundsack 已提交
1336

1337
```yaml
M
Mark Pundsack 已提交
1338 1339 1340 1341
variables:
  GIT_STRATEGY: clone
```

N
Nick Thomas 已提交
1342 1343 1344
`fetch` is faster as it re-uses the project workspace (falling back to `clone`
if it doesn't exist). `git clean` is used to undo any changes made by the last
job, and `git fetch` is used to retrieve commits made since the last job ran.
M
Mark Pundsack 已提交
1345

1346
```yaml
M
Mark Pundsack 已提交
1347 1348 1349 1350
variables:
  GIT_STRATEGY: fetch
```

N
Nick Thomas 已提交
1351 1352 1353 1354 1355 1356
`none` also re-uses the project workspace, but skips all Git operations
(including GitLab Runner's pre-clone script, if present). It is mostly useful
for jobs that operate exclusively on artifacts (e.g., `deploy`). Git repository
data may be present, but it is certain to be out of date, so you should only
rely on files brought into the project workspace from cache or artifacts.

1357
```yaml
N
Nick Thomas 已提交
1358 1359 1360 1361
variables:
  GIT_STRATEGY: none
```

1362
### Git submodule strategy
1363 1364 1365 1366

> Requires GitLab Runner v1.10+.

The `GIT_SUBMODULE_STRATEGY` variable is used to control if / how Git
1367 1368
submodules are included when fetching the code before a build. You can set them
globally or per-job in the [`variables`](#variables) section.
1369

1370
There are three possible values: `none`, `normal`, and `recursive`:
1371 1372 1373 1374 1375 1376

- `none` means that submodules will not be included when fetching the project
  code. This is the default, which matches the pre-v1.10 behavior.

- `normal` means that only the top-level submodules will be included. It is
  equivalent to:
1377

1378
    ```
1379 1380
    git submodule sync
    git submodule update --init
1381 1382 1383 1384
    ```

- `recursive` means that all submodules (including submodules of submodules)
  will be included. It is equivalent to:
1385

1386
    ```
1387 1388
    git submodule sync --recursive
    git submodule update --init --recursive
1389 1390 1391 1392
    ```

Note that for this feature to work correctly, the submodules must be configured
(in `.gitmodules`) with either:
1393

1394 1395 1396 1397
- the HTTP(S) URL of a publicly-accessible repository, or
- a relative path to another repository on the same GitLab server. See the
  [Git submodules](../git_submodules.md) documentation.

1398 1399 1400 1401 1402 1403 1404 1405 1406 1407 1408 1409 1410 1411 1412 1413 1414 1415 1416 1417 1418 1419 1420 1421 1422 1423 1424 1425
### Git checkout

> Introduced in GitLab Runner 9.3

The `GIT_CHECKOUT` variable can be used when the `GIT_STRATEGY` is set to either
`clone` or `fetch` to specify whether a `git checkout` should be run. If not
specified, it defaults to true. You can set them globally or per-job in the
[`variables`](#variables) section.

If set to `false`, the Runner will:

- when doing `fetch` - update the repository and leave working copy on
  the current revision,
- when doing `clone` - clone the repository and leave working copy on the
  default branch.

Having this setting set to `true` will mean that for both `clone` and `fetch`
strategies the Runner will checkout the working copy to a revision related
to the CI pipeline:

```yaml
variables:
  GIT_STRATEGY: clone
  GIT_CHECKOUT: "false"
script:
  - git checkout master
  - git merge $CI_BUILD_REF_NAME
```
1426

1427
### Job stages attempts
1428 1429 1430

> Introduced in GitLab, it requires GitLab Runner v1.9+.

1431
You can set the number for attempts the running job will try to execute each
1432 1433
of the following stages:

1434 1435 1436 1437 1438
| Variable                        | Description |
|-------------------------------- |-------------|
| **GET_SOURCES_ATTEMPTS**        | Number of attempts to fetch sources running a job |
| **ARTIFACT_DOWNLOAD_ATTEMPTS**  | Number of attempts to download artifacts running a job |
| **RESTORE_CACHE_ATTEMPTS**      | Number of attempts to restore the cache running a job |
1439 1440 1441 1442 1443

The default is one single attempt.

Example:

1444
```yaml
1445
variables:
1446
  GET_SOURCES_ATTEMPTS: 3
1447 1448
```

1449
You can set them globally or per-job in the [`variables`](#variables) section.
1450

1451
### Shallow cloning
M
Mark Pundsack 已提交
1452

1453
> Introduced in GitLab 8.9 as an experimental feature. May change in future
M
Mark Pundsack 已提交
1454
releases or be removed completely.
M
Mark Pundsack 已提交
1455 1456

You can specify the depth of fetching and cloning using `GIT_DEPTH`. This allows
M
Mark Pundsack 已提交
1457 1458 1459
shallow cloning of the repository which can significantly speed up cloning for
repositories with a large number of commits or old, large binaries. The value is
passed to `git fetch` and `git clone`.
M
Mark Pundsack 已提交
1460

M
Mark Pundsack 已提交
1461
>**Note:**
1462 1463
If you use a depth of 1 and have a queue of jobs or retry
jobs, jobs may fail.
M
Mark Pundsack 已提交
1464

1465 1466 1467 1468
Since Git fetching and cloning is based on a ref, such as a branch name, Runners
can't clone a specific commit SHA. If there are multiple jobs in the queue, or
you are retrying an old job, the commit to be tested needs to be within the
Git history that is cloned. Setting too small a value for `GIT_DEPTH` can make
M
Mark Pundsack 已提交
1469
it impossible to run these old commits. You will see `unresolved reference` in
1470
job logs. You should then reconsider changing `GIT_DEPTH` to a higher value.
M
Mark Pundsack 已提交
1471

1472 1473
Jobs that rely on `git describe` may not work correctly when `GIT_DEPTH` is
set since only part of the Git history is present.
M
Mark Pundsack 已提交
1474 1475

To fetch or clone only the last 3 commits:
1476 1477

```yaml
M
Mark Pundsack 已提交
1478
variables:
M
Mark Pundsack 已提交
1479
  GIT_DEPTH: "3"
M
Mark Pundsack 已提交
1480 1481
```

1482 1483 1484 1485 1486 1487 1488 1489 1490 1491 1492
You can set it globally or per-job in the [`variables`](#variables) section.

## Special YAML features

It's possible to use special YAML features like anchors (`&`), aliases (`*`)
and map merging (`<<`), which will allow you to greatly reduce the complexity
of `.gitlab-ci.yml`.

Read more about the various [YAML features](https://learnxinyminutes.com/docs/yaml/).

### Hidden keys (jobs)
A
Achilleas Pipinellis 已提交
1493

1494
> Introduced in GitLab 8.6 and GitLab Runner v1.1.1.
A
Achilleas Pipinellis 已提交
1495

1496 1497 1498 1499 1500 1501 1502 1503
If you want to temporarily 'disable' a job, rather than commenting out all the
lines where the job is defined:

```
#hidden_job:
#  script:
#    - run test
```
A
Achilleas Pipinellis 已提交
1504

1505 1506
you can instead start its name with a dot (`.`) and it will not be processed by
GitLab CI. In the following example, `.hidden_job` will be ignored:
A
Achilleas Pipinellis 已提交
1507 1508

```yaml
1509
.hidden_job:
A
Achilleas Pipinellis 已提交
1510
  script:
1511
    - run test
A
Achilleas Pipinellis 已提交
1512 1513
```

1514 1515 1516
Use this feature to ignore jobs, or use the
[special YAML features](#special-yaml-features) and transform the hidden keys
into templates.
1517

1518 1519
### Anchors

1520
> Introduced in GitLab 8.6 and GitLab Runner v1.1.1.
1521

1522
YAML has a handy feature called 'anchors', which lets you easily duplicate
1523
content across your document. Anchors can be used to duplicate/inherit
1524
properties, and is a perfect example to be used with [hidden keys](#hidden-keys-jobs)
1525 1526 1527 1528 1529
to provide templates for your jobs.

The following example uses anchors and map merging. It will create two jobs,
`test1` and `test2`, that will inherit the parameters of `.job_template`, each
having their own custom `script` defined:
1530 1531

```yaml
1532
.job_template: &job_definition  # Hidden key that defines an anchor named 'job_definition'
1533 1534 1535 1536 1537 1538
  image: ruby:2.1
  services:
    - postgres
    - redis

test1:
1539
  <<: *job_definition           # Merge the contents of the 'job_definition' alias
1540
  script:
1541
    - test1 project
1542 1543

test2:
1544
  <<: *job_definition           # Merge the contents of the 'job_definition' alias
1545
  script:
1546 1547 1548 1549 1550 1551 1552 1553 1554 1555 1556 1557 1558 1559 1560 1561 1562 1563 1564 1565 1566 1567 1568 1569 1570 1571 1572 1573 1574
    - test2 project
```

`&` sets up the name of the anchor (`job_definition`), `<<` means "merge the
given hash into the current one", and `*` includes the named anchor
(`job_definition` again). The expanded version looks like this:

```yaml
.job_template:
  image: ruby:2.1
  services:
    - postgres
    - redis

test1:
  image: ruby:2.1
  services:
    - postgres
    - redis
  script:
    - test1 project

test2:
  image: ruby:2.1
  services:
    - postgres
    - redis
  script:
    - test2 project
1575 1576
```

1577 1578 1579 1580
Let's see another one example. This time we will use anchors to define two sets
of services. This will create two jobs, `test:postgres` and `test:mysql`, that
will share the `script` directive defined in `.job_template`, and the `services`
directive defined in `.postgres_services` and `.mysql_services` respectively:
1581 1582 1583 1584 1585 1586 1587 1588 1589 1590 1591

```yaml
.job_template: &job_definition
  script:
    - test project

.postgres_services:
  services: &postgres_definition
    - postgres
    - ruby

1592
.mysql_services:
1593 1594 1595 1596 1597
  services: &mysql_definition
    - mysql
    - ruby

test:postgres:
A
Achilleas Pipinellis 已提交
1598
  <<: *job_definition
1599 1600 1601
  services: *postgres_definition

test:mysql:
A
Achilleas Pipinellis 已提交
1602
  <<: *job_definition
1603 1604 1605
  services: *mysql_definition
```

1606
The expanded version looks like this:
1607

1608 1609 1610 1611
```yaml
.job_template:
  script:
    - test project
1612

1613 1614 1615 1616
.postgres_services:
  services:
    - postgres
    - ruby
1617

1618 1619 1620 1621 1622 1623
.mysql_services:
  services:
    - mysql
    - ruby

test:postgres:
1624
  script:
1625 1626 1627 1628 1629 1630 1631 1632 1633 1634 1635
    - test project
  services:
    - postgres
    - ruby

test:mysql:
  script:
    - test project
  services:
    - mysql
    - ruby
1636 1637
```

1638
You can see that the hidden keys are conveniently used as templates.
1639

1640 1641 1642 1643 1644 1645 1646
## Triggers

Triggers can be used to force a rebuild of a specific branch, tag or commit,
with an API call.

[Read more in the triggers documentation.](../triggers/README.md)

1647
## Skipping jobs
1648

1649 1650
If your commit message contains `[ci skip]` or `[skip ci]`, using any
capitalization, the commit will be created but the pipeline will be skipped.
1651

D
Douwe Maan 已提交
1652
## Validate the .gitlab-ci.yml
1653

1654
Each instance of GitLab CI has an embedded debug tool called Lint, which validates the
1655
content of your `.gitlab-ci.yml` files. You can find the Lint under the page `ci/lint` of your
T
Takuya Noguchi 已提交
1656
project namespace (e.g, `http://gitlab-example.com/gitlab-org/project-123/-/ci/lint`)
D
Douwe Maan 已提交
1657

1658 1659 1660 1661 1662
## Using reserved keywords

If you get validation error when using specific values (e.g., `true` or `false`),
try to quote them, or change them to a different form (e.g., `/bin/true`).

A
Achilleas Pipinellis 已提交
1663 1664 1665 1666 1667
## Examples

Visit the [examples README][examples] to see a list of examples using GitLab
CI with various languages.

1668
[env-manual]: ../environments.md#manually-deploying-to-environments
A
Achilleas Pipinellis 已提交
1669
[examples]: ../examples/README.md
1670 1671
[ce-6323]: https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/6323
[environment]: ../environments.md
1672 1673
[ce-6669]: https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/6669
[variables]: ../variables/README.md
1674
[ce-7983]: https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7983
1675
[ce-7447]: https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7447
G
George Tsiolis 已提交
1676
[ce-12909]: https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/12909
1677
[schedules]: ../../user/project/pipelines/schedules.md
1678
[variables-expressions]: ../variables/README.md#variables-expressions