README.md 16.8 KB
Newer Older
M
Marcia Ramos 已提交
1 2 3 4
---
type: reference
---

5
# Configuring GitLab Runners
D
Douwe Maan 已提交
6

A
Achilleas Pipinellis 已提交
7 8 9
In GitLab CI, Runners run the code defined in [`.gitlab-ci.yml`](../yaml/README.md).
They are isolated (virtual) machines that pick up jobs through the coordinator
API of GitLab CI.
D
Douwe Maan 已提交
10

11 12
A Runner can be specific to a certain project or serve any project
in GitLab CI. A Runner that serves all projects is called a shared Runner.
D
Douwe Maan 已提交
13

A
Achilleas Pipinellis 已提交
14
Ideally, the GitLab Runner should not be installed on the same machine as GitLab.
15
Read the [requirements documentation](../../install/requirements.md#gitlab-runner)
16 17
for more information.

18
## Shared, specific and group Runners
A
Achilleas Pipinellis 已提交
19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35

After [installing the Runner][install], you can either register it as shared or
specific. You can only register a shared Runner if you have admin access to
the GitLab instance. The main differences between a shared and a specific Runner
are:

- **Shared Runners** are useful for jobs that have similar requirements,
  between multiple projects. Rather than having multiple Runners idling for
  many projects, you can have a single or a small number of Runners that handle
  multiple projects. This makes it easier to maintain and update them.
  Shared Runners process jobs using a [fair usage queue](#how-shared-runners-pick-jobs).
  In contrast to specific Runners that use a FIFO queue, this prevents
  cases where projects create hundreds of jobs which can lead to eating all
  available shared Runners resources.
- **Specific Runners** are useful for jobs that have special requirements or for
  projects with a specific demand. If a job has certain requirements, you can set
  up the specific Runner with this in mind, while not having to do this for all
36
  Runners. For example, if you want to deploy a certain project, you can set up
A
Achilleas Pipinellis 已提交
37 38
  a specific Runner to have the right credentials for this. The [usage of tags](#using-tags)
  may be useful in this case. Specific Runners process jobs using a [FIFO] queue.
39
- **Group Runners** are useful when you have multiple projects under one group
40
  and would like all projects to have access to a set of Runners. Group Runners
41
  process jobs using a [FIFO] queue.
A
Achilleas Pipinellis 已提交
42 43 44

A Runner that is specific only runs for the specified project(s). A shared Runner
can run jobs for every project that has enabled the option **Allow shared Runners**
45
under **Settings > CI/CD**.
A
Achilleas Pipinellis 已提交
46 47 48 49

Projects with high demand of CI activity can also benefit from using specific
Runners. By having dedicated Runners you are guaranteed that the Runner is not
being held up by another project's jobs.
D
Douwe Maan 已提交
50

51 52 53
You can set up a specific Runner to be used by multiple projects. The difference
with a shared Runner is that you have to enable each project explicitly for
the Runner to be able to run its jobs.
D
Douwe Maan 已提交
54

55
Specific Runners do not get shared with forked projects automatically.
A
Achilleas Pipinellis 已提交
56 57
A fork does copy the CI settings (jobs, allow shared, etc) of the cloned
repository.
D
Douwe Maan 已提交
58

A
Achilleas Pipinellis 已提交
59
## Registering a shared Runner
D
Douwe Maan 已提交
60

A
Achilleas Pipinellis 已提交
61
You can only register a shared Runner if you are an admin of the GitLab instance.
D
Douwe Maan 已提交
62

A
Achilleas Pipinellis 已提交
63
1. Grab the shared-Runner token on the `admin/runners` page
D
Douwe Maan 已提交
64

65
   ![Shared Runners Admin Area](img/shared_runners_admin.png)
D
Douwe Maan 已提交
66

A
Achilleas Pipinellis 已提交
67
1. [Register the Runner][register]
D
Douwe Maan 已提交
68

A
Achilleas Pipinellis 已提交
69 70
Shared Runners are enabled by default as of GitLab 8.2, but can be disabled
with the **Disable shared Runners** button which is present under each project's
71
**Settings > CI/CD** page. Previous versions of GitLab defaulted shared
A
Achilleas Pipinellis 已提交
72
Runners to disabled.
D
Douwe Maan 已提交
73

A
Achilleas Pipinellis 已提交
74
## Registering a specific Runner
D
Douwe Maan 已提交
75

D
Dylan Griffith 已提交
76
Registering a specific Runner can be done in two ways:
D
Douwe Maan 已提交
77

78 79
1. Creating a Runner with the project registration token
1. Converting a shared Runner into a specific Runner (one-way, admin only)
D
Douwe Maan 已提交
80

A
Achilleas Pipinellis 已提交
81
### Registering a specific Runner with a project registration token
D
Douwe Maan 已提交
82

83
To create a specific Runner without having admin rights to the GitLab instance,
A
Achilleas Pipinellis 已提交
84
visit the project you want to make the Runner work for in GitLab:
D
Douwe Maan 已提交
85

86
1. Go to **Settings > CI/CD** to obtain the token
A
Achilleas Pipinellis 已提交
87
1. [Register the Runner][register]
D
Douwe Maan 已提交
88

89 90
## Registering a group Runner

E
Elliot Rushton 已提交
91
Creating a group Runner requires Owner permissions for the group. To create a
92 93 94 95 96
group Runner visit the group you want to make the Runner work for in GitLab:

1. Go to **Settings > CI/CD** to obtain the token
1. [Register the Runner][register]

A
Achilleas Pipinellis 已提交
97
### Making an existing shared Runner specific
D
Douwe Maan 已提交
98

A
Achilleas Pipinellis 已提交
99 100 101
If you are an admin on your GitLab instance, you can turn any shared Runner into
a specific one, but not the other way around. Keep in mind that this is a one
way transition.
D
Douwe Maan 已提交
102

103
1. Go to the Runners in the **Admin Area > Overview > Runners** (`/admin/runners`)
A
Achilleas Pipinellis 已提交
104 105 106
   and find your Runner
1. Enable any projects under **Restrict projects for this Runner** to be used
   with the Runner
D
Douwe Maan 已提交
107

A
Achilleas Pipinellis 已提交
108 109 110
From now on, the shared Runner will be specific to those projects.

## Locking a specific Runner from being enabled for other projects
111

112 113
You can configure a Runner to assign it exclusively to a project. When a
Runner is locked this way, it can no longer be enabled for other projects.
A
Achilleas Pipinellis 已提交
114 115 116 117 118
This setting can be enabled the first time you [register a Runner][register] and
can be changed afterwards under each Runner's settings.

To lock/unlock a Runner:

119
1. Visit your project's **Settings > CI/CD**
A
Achilleas Pipinellis 已提交
120 121 122 123
1. Find the Runner you wish to lock/unlock and make sure it's enabled
1. Click the pencil button
1. Check the **Lock to current projects** option
1. Click **Save changes** for the changes to take effect
124

125 126
## Assigning a Runner to another project

E
Elliot Rushton 已提交
127
If you are an Owner on a project where a specific Runner is assigned to, and the
128
Runner is not [locked only to that project](#locking-a-specific-runner-from-being-enabled-for-other-projects),
E
Elliot Rushton 已提交
129
you can enable the Runner also on any other project where you have Owner permissions.
130 131 132

To enable/disable a Runner in your project:

133
1. Visit your project's **Settings > CI/CD**
134 135 136 137 138
1. Find the Runner you wish to enable/disable
1. Click **Enable for this project** or **Disable for this project**

> **Note**:
Consider that if you don't lock your specific Runner to a specific project, any
M
Mark Chao 已提交
139
user with Maintainer role in you project can assign your Runner to another arbitrary
140 141
project without requiring your authorization, so use it with caution.

M
Matija Čupić 已提交
142 143 144 145 146 147 148 149
CAUTION: **Caution:**
Never add a private Runner that you're using in your private projects to a
project that you share with other people.

CAUTION: **Caution:**
Never use a Runner from a project which has multiple maintainers in your
private project.

150 151 152
An admin can enable/disable a specific Runner for projects:

1. Navigate to **Admin > Runners**
153 154 155
1. Find the Runner you wish to enable/disable
1. Click edit on the Runner
1. Click **Enable** or **Disable** on the project
156

S
Fix doc  
Shinya Maeda 已提交
157
## Protected Runners
S
Add doc  
Shinya Maeda 已提交
158

159
> [Introduced](https://gitlab.com/gitlab-org/gitlab-foss/-/merge_requests/13194) in GitLab 10.0.
S
Add doc  
Shinya Maeda 已提交
160

S
Fix doc  
Shinya Maeda 已提交
161 162 163
You can protect Runners from revealing sensitive information.
Whenever a Runner is protected, the Runner picks only jobs created on
[protected branches] or [protected tags], and ignores other jobs.
S
Add doc  
Shinya Maeda 已提交
164

S
Fix doc  
Shinya Maeda 已提交
165
To protect/unprotect Runners:
S
Add doc  
Shinya Maeda 已提交
166

167
1. Visit your project's **Settings > CI/CD**
S
Fix doc  
Shinya Maeda 已提交
168 169
1. Find a Runner you want to protect/unprotect and make sure it's enabled
1. Click the pencil button besides the Runner name
S
Add doc  
Shinya Maeda 已提交
170 171 172
1. Check the **Protected** option
1. Click **Save changes** for the changes to take effect

S
Fix doc  
Shinya Maeda 已提交
173
![specific Runners edit icon](img/protected_runners_check_box.png)
S
Fix doc  
Shinya Maeda 已提交
174

175 176
## Manually clearing the Runners cache

177
Read [clearing the cache](../caching/index.md#clearing-the-cache).
178

A
Achilleas Pipinellis 已提交
179
## How shared Runners pick jobs
D
Douwe Maan 已提交
180

A
Achilleas Pipinellis 已提交
181 182 183
Shared Runners abide to a process queue we call fair usage. The fair usage
algorithm tries to assign jobs to shared Runners from projects that have the
lowest number of jobs currently running on shared Runners.
D
Douwe Maan 已提交
184

A
Achilleas Pipinellis 已提交
185
**Example 1**
D
Douwe Maan 已提交
186

A
Achilleas Pipinellis 已提交
187
We have following jobs in queue:
D
Douwe Maan 已提交
188

189 190 191 192 193 194
- Job 1 for Project 1
- Job 2 for Project 1
- Job 3 for Project 1
- Job 4 for Project 2
- Job 5 for Project 2
- Job 6 for Project 3
A
Achilleas Pipinellis 已提交
195 196 197

With the fair usage algorithm jobs are assigned in following order:

198 199 200 201 202 203
1. Job 1 is chosen first, because it has the lowest job number from projects with no running jobs (i.e. all projects)
1. Job 4 is next, because 4 is now the lowest job number from projects with no running jobs (Project 1 has a job running)
1. Job 6 is next, because 6 is now the lowest job number from projects with no running jobs (Projects 1 and 2 have jobs running)
1. Job 2 is next, because, of projects with the lowest number of jobs running (each has 1), it is the lowest job number
1. Job 5 is next, because Project 1 now has 2 jobs running, and between Projects 2 and 3, Job 5 is the lowest remaining job number
1. Lastly we choose Job 3... because it's the only job left
A
Achilleas Pipinellis 已提交
204 205 206 207 208 209 210

---

**Example 2**

We have following jobs in queue:

211 212 213 214 215 216
- Job 1 for project 1
- Job 2 for project 1
- Job 3 for project 1
- Job 4 for project 2
- Job 5 for project 2
- Job 6 for project 3
A
Achilleas Pipinellis 已提交
217 218 219

With the fair usage algorithm jobs are assigned in following order:

220
1. Job 1 is chosen first, because it has the lowest job number from projects with no running jobs (i.e. all projects)
A
Achilleas Pipinellis 已提交
221
1. We finish job 1
222 223
1. Job 2 is next, because, having finished Job 1, all projects have 0 jobs running again, and 2 is the lowest available job number
1. Job 4 is next, because with Project 1 running a job, 4 is the lowest number from projects running no jobs (Projects 2 and 3)
A
Achilleas Pipinellis 已提交
224
1. We finish job 4
225 226 227
1. Job 5 is next, because having finished Job 4, Project 2 has no jobs running again
1. Job 6 is next, because Project 3 is the only project left with no running jobs
1. Lastly we choose Job 3... because, again, it's the only job left (who says 1 is the loneliest number?)
A
Achilleas Pipinellis 已提交
228 229

## Using shared Runners effectively
D
Douwe Maan 已提交
230

231
If you are planning to use shared Runners, there are several things you
D
Douwe Maan 已提交
232 233
should keep in mind.

A
Achilleas Pipinellis 已提交
234
### Using tags
D
Douwe Maan 已提交
235

236
You must set up a Runner to be able to run all the different types of jobs
D
Douwe Maan 已提交
237 238 239 240
that it may encounter on the projects it's shared over. This would be
problematic for large amounts of projects, if it wasn't for tags.

By tagging a Runner for the types of jobs it can handle, you can make sure
241
shared Runners will [only run the jobs they are equipped to run](../yaml/README.md#tags).
D
Douwe Maan 已提交
242

243
For instance, at GitLab we have Runners tagged with "rails" if they contain
D
Douwe Maan 已提交
244 245
the appropriate dependencies to run Rails test suites.

246
### Allowing Runners with tags to pick jobs without tags
247

248 249
When you [register a Runner][register], its default behavior is to **only pick**
[tagged jobs](../yaml/README.md#tags).
A
Achilleas Pipinellis 已提交
250

251
NOTE: **Note:**
E
Elliot Rushton 已提交
252
Owner [permissions](../../user/permissions.md) are required to change the
253
Runner settings.
A
Achilleas Pipinellis 已提交
254

255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303
To make a Runner pick untagged jobs:

1. Visit your project's **Settings > CI/CD > Runners**.
1. Find the Runner you want to pick untagged jobs and make sure it's enabled.
1. Click the pencil button.
1. Check the **Run untagged jobs** option.
1. Click the **Save changes** button for the changes to take effect.

NOTE: **Note:**
The Runner tags list can not be empty when it's not allowed to pick untagged jobs.

Below are some example scenarios of different variations.

#### Runner runs only tagged jobs

The following examples illustrate the potential impact of the Runner being set
to run only tagged jobs.

Example 1:

1. The Runner is configured to run only tagged jobs and has the `docker` tag.
1. A job that has a `hello` tag is executed and stuck.

Example 2:

1. The Runner is configured to run only tagged jobs and has the `docker` tag.
1. A job that has a `docker` tag is executed and run.

Example 3:

1. The Runner is configured to run only tagged jobs and has the `docker` tag.
1. A job that has no tags defined is executed and stuck.

#### Runner is allowed to run untagged jobs

The following examples illustrate the potential impact of the Runner being set
to run tagged and untagged jobs.

Example 1:

1. The Runner is configured to run untagged jobs and has the `docker` tag.
1. A job that has no tags defined is executed and run.
1. A second job that has a `docker` tag defined is executed and run.

Example 2:

1. The Runner is configured to run untagged jobs and has no tags defined.
1. A job that has no tags defined is executed and run.
1. A second job that has a `docker` tag defined is stuck.
304

T
Tomasz Maczukin 已提交
305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320
### Setting maximum job timeout for a Runner

For each Runner you can specify a _maximum job timeout_. Such timeout,
if smaller than [project defined timeout], will take the precedence. This
feature can be used to prevent Shared Runner from being appropriated
by a project by setting a ridiculous big timeout (e.g. one week).

When not configured, Runner will not override project timeout.

How this feature will work:

**Example 1 - Runner timeout bigger than project timeout**

1. You set the _maximum job timeout_ for a Runner to 24 hours
1. You set the _CI/CD Timeout_ for a project to **2 hours**
1. You start a job
321
1. The job, if running longer, will be timed out after **2 hours**
T
Tomasz Maczukin 已提交
322 323 324 325 326 327

**Example 2 - Runner timeout not configured**

1. You remove the _maximum job timeout_ configuration from a Runner
1. You set the _CI/CD Timeout_ for a project to **2 hours**
1. You start a job
328
1. The job, if running longer, will be timed out after **2 hours**
T
Tomasz Maczukin 已提交
329 330 331 332 333 334

**Example 3 - Runner timeout smaller than project timeout**

1. You set the _maximum job timeout_ for a Runner to **30 minutes**
1. You set the _CI/CD Timeout_ for a project to 2 hours
1. You start a job
335
1. The job, if running longer, will be timed out after **30 minutes**
T
Tomasz Maczukin 已提交
336

337
### Be careful with sensitive information
D
Douwe Maan 已提交
338

339
With some [Runner Executors](https://docs.gitlab.com/runner/executors/README.html),
340 341
if you can run a job on the Runner, you can get full access to the file system,
and thus any code it runs as well as the token of the Runner. With shared Runners, this means that anyone
A
Achilleas Pipinellis 已提交
342 343
that runs jobs on the Runner, can access anyone else's code that runs on the
Runner.
D
Douwe Maan 已提交
344

345 346
In addition, because you can get access to the Runner token, it is possible
to create a clone of a Runner and submit false jobs, for example.
D
Douwe Maan 已提交
347

348
The above is easily avoided by restricting the usage of shared Runners
349 350
on large public GitLab instances, controlling access to your GitLab instance,
and using more secure [Runner Executors](https://docs.gitlab.com/runner/executors/README.html).
D
Douwe Maan 已提交
351 352 353 354

### Forks

Whenever a project is forked, it copies the settings of the jobs that relate
355
to it. This means that if you have shared Runners set up for a project and
356
someone forks that project, the shared Runners will also serve jobs of this
D
Douwe Maan 已提交
357 358
project.

359
## Attack vectors in Runners
D
Douwe Maan 已提交
360

361 362 363
Mentioned briefly earlier, but the following things of Runners can be exploited.
We're always looking for contributions that can mitigate these
[Security Considerations](https://docs.gitlab.com/runner/security/).
A
Achilleas Pipinellis 已提交
364

365 366 367
### Resetting the registration token for a Project

If you think that registration token for a Project was revealed, you should
368 369
reset them. It's recommended because such a token can be used to register another
Runner to the Project. It may then be used to obtain the values of secret
370 371 372 373 374
variables or clone the project code, that normally may be unavailable for the
attacker.

To reset the token:

375 376 377 378
1. Go to **Settings > CI/CD** for a specified Project.
1. Expand the **General pipelines settings** section.
1. Find the **Runner token** form field and click the **Reveal value** button.
1. Delete the value and save the form.
379
1. After the page is refreshed, expand the **Runners settings** section
380
   and check the registration token - it should be changed.
381

382 383 384 385
From now on the old token is no longer valid and will not register
any new Runners to the project. If you are using any tools to provision and
register new Runners, the tokens used in those tools should be updated to reflect the
value of the new token.
386

387 388
## Determining the IP address of a Runner

389
> [Introduced](https://gitlab.com/gitlab-org/gitlab-foss/-/merge_requests/17286) in GitLab 10.6.
390 391 392 393 394 395 396 397 398 399 400 401 402 403 404

It may be useful to know the IP address of a Runner so you can troubleshoot
issues with that Runner. GitLab stores and displays the IP address by viewing
the source of the HTTP requests it makes to GitLab when polling for jobs. The
IP address is always kept up to date so if the Runner IP changes it will be
automatically updated in GitLab.

The IP address for shared Runners and specific Runners can be found in
different places.

### Shared Runners

To view the IP address of a shared Runner you must have admin access to
the GitLab instance. To determine this:

405
1. Visit **Admin Area > Overview > Runners**
406 407 408 409 410 411 412 413
1. Look for the Runner in the table and you should see a column for "IP Address"

![shared Runner IP address](img/shared_runner_ip_address.png)

### Specific Runners

You can find the IP address of a Runner for a specific project by:

414
1. Visit your project's **Settings > CI/CD**
415 416 417 418
1. Find the Runner and click on it's ID which links you to the details page
1. On the details page you should see a row for "IP Address"

![specific Runner IP address](img/specific_runner_ip_address.png)
T
Tomasz Maczukin 已提交
419

E
Evan Read 已提交
420
[install]: https://docs.gitlab.com/runner/install/
T
Tomasz Maczukin 已提交
421
[fifo]: https://en.wikipedia.org/wiki/FIFO_(computing_and_electronics)
E
Evan Read 已提交
422
[register]: https://docs.gitlab.com/runner/register/
T
Tomasz Maczukin 已提交
423 424 425
[protected branches]: ../../user/project/protected_branches.md
[protected tags]: ../../user/project/protected_tags.md
[project defined timeout]: ../../user/project/pipelines/settings.html#timeout