pfsclient.md.txt 3.4 KB
Newer Older
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129
# PFSClient

## Description
The `pfs` command is a Command Line Interface to manage your files on PaddlePaddle Cloud

## Synopsis
```
paddle [options] pfs <subcommand> [parameters]
```

## Options
```
--profile (string)
	Use a specific profile from your credential file.

--help (string)
	Display more information about command

--version
	Output version information and exit

--debug
	Show detailed debugging log	
	
--only-show-errors (boolean) 
	Only errors and warnings are displayed. All other output is suppressed.
```

## Path Arguments
When using a command, we need to specify path arguments. There are two path argument type: `localpath` and `pfspath`.  

A `pfspath` begin with `/pfs`, eg: `/pfs/$DATACENTER/home/$USER/folder`.

[Here](https://github.com/PaddlePaddle/Paddle/blob/develop/doc/design/cluster_train/data_dispatch.md#上传训练文件) is how to config datacenters.

## order of Path Arguments
Commonly, if there are two path arguments, the first is the source, and the second is the destination.

## Subcommonds
- rm - remove files or directories

```
Synopsis:
	rm [-r] [-v] <PFSPath> ...

Options:
	-r 
		Remove directories and their contents recursively 
	-v      
		Cause rm to be verbose, showing files after they are removed.
	
Examples:
	paddle pfs rm /pfs/$DATACENTER/home/$USER/file
	paddle pfs rm -r /pfs/$DATACENTER/home/$USER/folder
```
- mv - move (rename) files

```
Synopsis:
	mv [-f | -n] [-v] <LocalPath> <PFSPath>
	mv [-f | -n] [-v] <LocalPath> ... <PFSPath>
	mv [-f | -n] [-v] <PFSPath> <LocalPath> 
	mv [-f | -n] [-v] <PFSPath> ... <LocalPath> 
	mv [-f | -n] [-v] <PFSPath> <PFSPath> 
	mv [-f | -n] [-v] <PFSPath> ... <PFSPath> 
	
Options:
	-f      
		Do not prompt for confirmation before overwriting the destination path.  (The -f option overrides previous -n options.)
	-n      
		Do not overwrite an existing file.  (The -n option overrides previous -f options.)
	-v      
		Cause mv to be verbose, showing files after they are moved.
		
Examples:
	paddle pfs mv ./text1.txt /pfs/$DATACENTER/home/$USER/text1.txt
```
- cp - copy files or directories

```
Synopsis:
	cp [-r] [-f | -n] [-v] [--preserve--links] <LocalPath> <PFSPath>
	cp [-r] [-f | -n] [-v] [--preserve--links] <LocalPath> ... <PFSPath>
	cp [-r] [-f | -n] [-v] [--preserve--links] <PFSPath> <LocalPath> 
	cp [-r] [-f | -n] [-v] [--preserve--links] <PFSPath> ... <LocalPath>
	cp [-r] [-f | -n] [-v] [--preserve--links] <PFSPath> <PFSPath> 
	cp [-r] [-f | -n] [-v] [--preserve--links] <PFSPath> ... <PFSPath>

Options:
	-r
   		Copy directories recursively
   	-f      
		Do not prompt for confirmation before overwriting the destination path.  (The -f option overrides previous -n options.)
	-n      
		Do not overwrite an existing file.  (The -n option overrides previous -f options.)
	-v      
		Cause cp to be verbose, showing files after they are copied.
	--preserve--links
	   Reserve links when copy links
	   
Examples:
	paddle pfs cp ./file /pfs/$DATACENTER/home/$USER/file
	paddle pfs cp /pfs/$DATACENTER/home/$USER/file ./file
```
- ls- list files

```
Synopsis:
	ls [-r] <PFSPath> ...
	
Options:
	-R
   		List directory(ies) recursively

Examples:
	paddle pfs ls  /pfs/$DATACENTER/home/$USER/file
	paddle pfs ls  /pfs/$DATACENTER/home/$USER/folder
```

- mkdir - mkdir directory(ies)
Create intermediate directory(ies) as required.

```
Synopsis:
	mkdir <PFSPath> ...

Examples:
	paddle pfs mkdir  /pfs/$DATACENTER/home/$USER/folder
```