docs.md 82.5 KB
Newer Older
1 2
# TAOS SQL

G
Ganlin Zhao 已提交
3
TDengine provides a SQL-style language, TAOS SQL, to insert or query data. This document introduces TAOS SQL and supports other common tips. To read through this document, readers should have basic understanding about SQL.
4

G
Ganlin Zhao 已提交
5
TAOS SQL is the main tool for users to write and query data into/from TDengine. TAOS SQL provides a syntax style similar to standard SQL to facilitate users to get started quickly. Strictly speaking, TAOS SQL is not and does not attempt to provide SQL standard syntax. In addition, since TDengine does not provide deletion functionality for time-series data, the relevant functions of data deletion is unsupported in TAO SQL.
6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36

Let’s take a look at the conventions used for syntax descriptions.

- The content in < > is what the user needs to enter, but do not enter < > itself
- [] indicates that the content is optional, but do not enter [] itself
- "|" means you can select one of multiple choices, but you cannot enter | yourself
- "…" means repeating for as many times

In order to better explain the rules and characteristics of SQL syntax, this document assumes that there is a data set. Take smart meters as an example, each smart meter collects three metrics: current, voltage and phase. It is modeled as follows:

```mysql
taos> DESCRIBE meters;
             Field              |        Type        |   Length    |    Note    |
=================================================================================
 ts                             | TIMESTAMP          |           8 |            |
 current                        | FLOAT              |           4 |            |
 voltage                        | INT                |           4 |            |
 phase                          | FLOAT              |           4 |            |
 location                       | BINARY             |          64 | TAG        |
 groupid                        | INT                |           4 | TAG        |
```

The data set contains data from four smart meters, which correspond to four sub-tables according to the modeling rules of TDengine, and their names are D1001, D1002, D1003 and D1004 respectively.

## <a class="anchor" id="data-type"></a> Data Types

With TDengine, the most important thing is timestamp. When creating and inserting records and querying history records, you need to specify a timestamp. The timestamp has the following rules:

- Time Format: 'YYYY-MM-DD HH:mm:ss.MS', default in milliseconds. For example,'2017-08-12 18:52:58.128'
- Internal Function **now** : this is the current time of the server
- When inserting a record, if timestamp is NOW, then use the server current time.
37
- Epoch Time: a timestamp value can also be a long integer representing milliseconds since 1970-01-01 08:00:00.000.
38 39
- Arithmetic operations can be applied to timestamp. For example: now-2h represents a timestamp which is 2 hours ago from the current server time. Units include u( microsecond), a (milliseconds), s (seconds), m (minutes), h (hours), d (days), w (weeks). In `select * from t1 where ts > now-2w and ts <= now-1w`, which queries data of the whole week before two weeks. To specify the interval of down sampling, you can also use n(calendar month) and y(calendar year) as time units.

E
Elias Soong 已提交
40
TDengine's timestamp is set to millisecond accuracy by default. Microsecond/nanosecond accuracy can be set using CREATE DATABASE with PRECISION parameter. (Nanosecond resolution is supported from version 2.1.5.0 onwards.)
41 42 43 44 45 46

In TDengine, the following 10 data types can be used in data model of an ordinary table.

|      | **Data Type** | **Bytes** | **Note**                                                     |
| ---- | ------------- | --------- | ------------------------------------------------------------ |
| 1    | TIMESTAMP     | 8         | Time stamp. Default in milliseconds, and support microseconds. Starting from 1970-01-01 00:00:00. 000 (UTC/GMT), the timing cannot be earlier than this time. |
47 48 49 50
| 2    | INT           | 4         | A null-able integer type with a range of [-2^31+1, 2^31-1 ]   |
| 3    | BIGINT        | 8         | A null-able integer type with a range of [-2^59, 2^59 ]       |
| 4    | FLOAT         | 4         | A standard null-able float type with 6 -7 significant digits and a range of [-3.4E38, 3.4E38] |
| 5    | DOUBLE        | 8         | A standard null-able double float type with 15-16 significant digits and a range of [-1.7E308, 1.7E308] |
51
| 6    | BINARY        | Custom    | Used to record ASCII strings. Theoretically, the maximum length can be 16,374 bytes, but since each row of data can be up to 16K bytes, the actual limit is generally smaller than the theoretical value. Binary only supports string input, and single quotation marks are used at both ends of the string, otherwise all English will be automatically converted to lowercase. When using, the size must be specified. For example, binary (20) defines a string with a maximum length of 20 characters, and each character occupies 1 byte of storage space. In this case, if the user string exceeds 20 bytes, an error will be reported. For single quotation marks in strings, they can be represented by escape character backslash plus single quotation marks, that is\ '. |
52 53
| 7    | SMALLINT      | 2         | A null-able integer type with a range of [-32767, 32767]      |
| 8    | TINYINT       | 1         | A null-able integer type with a range of [-127, 127]          |
54 55
| 9    | BOOL          | 1         | Boolean type,{true, false}                                  |
| 10   | NCHAR         | Custom    | Used to record non-ASCII strings, such as Chinese characters. Each nchar character takes up 4 bytes of storage space. Single quotation marks are used at both ends of the string, and escape characters are required for single quotation marks in the string, that is \’. When nchar is used, the string size must be specified. A column of type nchar (10) indicates that the string of this column stores up to 10 nchar characters, which will take up 40 bytes of space. If the length of the user string exceeds the declared length, an error will be reported. |
wmmhello's avatar
wmmhello 已提交
56
| 11   | JSON          |           | Json type,only support for tag                                  |
57 58 59 60 61 62


**Tips**:

1. TDengine is case-insensitive to English characters in SQL statements and automatically converts them to lowercase for execution. Therefore, the user's case-sensitive strings and passwords need to be enclosed in single quotation marks.
2. Avoid using BINARY type to save non-ASCII type strings, which will easily lead to errors such as garbled data. The correct way is to use NCHAR type to save Chinese characters.
G
Ganlin Zhao 已提交
63
3. The numerical values in SQL statements are treated as floating or integer numbers, depends on if the value contains decimal point or is in scientific notation format. Therefore, caution is needed since overflow might happen for corresponding data types. E.g., 9999999999999999999 is overflowed as the number is greater than the largest integer number. However, 9999999999999999999.0 is treated as a valid floating number. 
64 65 66

## <a class="anchor" id="management"></a>Database Management

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
67
- **Create a Database**
68 69 70 71 72 73 74 75 76 77 78

   ```mysql
      CREATE DATABASE [IF NOT EXISTS] db_name [KEEP keep] [DAYS days] [UPDATE 1];
   ```

Note:

1. KEEP is how long the data of the database is kept, the default is 3650 days (10 years), and the database will automatically delete the data expired;
2. UPDATE marks the database support updating the same timestamp data;
3. Maximum length of the database name is 33;
4. Maximum length of a SQL statement is 65480 characters;
E
Elias Soong 已提交
79
5. Database has more storage-related configuration parameters, see [Server-side Configuration](https://www.taosdata.com/en/documentation/administrator#config) .
80

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
81
- **Show current system parameters**
82

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
83 84 85
    ```mysql
    SHOW VARIABLES;
    ```
86

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
87
- **Use a database**
88

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
89 90 91
    ```mysql
    USE db_name;
    ```
A
Anaïs Huang 已提交
92
    Use/switch database (Invalid when accessing through RESTful connection)
93

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
94 95 96 97 98
- **Drop a database**
    ```mysql
    DROP DATABASE [IF EXISTS] db_name;
    ```
    Delete a database, all data tables included will be deleted. Please use with caution.
99

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
100
- **Modify database parameters**
101

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
102 103 104 105
    ```mysql
    ALTER DATABASE db_name COMP 2;
    ```
    COMP parameter modifies the database file compression flag bit, with the default value of 2 and the value range is [0, 2]. 0 means no compression, 1 means one-stage compression, and 2 means two-stage compression.
106

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
107
    ```mysql
108
    ALTER DATABASE db_name REPLICA 2;
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
109 110
    ```
    REPLICA parameter refers to the number of replicas of the modified database, and the value range is [1, 3]. For use in a cluster, the number of replicas must be less than or equal to the number of DNODE.
111

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
112 113 114 115
    ```mysql
    ALTER DATABASE db_name KEEP 365;
    ```
    The KEEP parameter refers to the number of days to save a modified data file. The default value is 3650, and the value range is [days, 365000]. It must be greater than or equal to the days parameter value.
116 117

   ```mysql
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
118
   ALTER DATABASE db_name QUORUM 2;
119
   ```
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
120
   QUORUM parameter refers to the number of confirmations required for successful data writing, and the value range is [1, 3]. For asynchronous replication, quorum is set to 1, and the virtual node with master role can confirm it by itself. For synchronous replication, it needs to be at least 2 or greater. In principle, Quorum > = 1 and Quorum < = replica number, which is required when starting a synchronization module instance.
121

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
122
    ```mysql
123
    ALTER DATABASE db_name BLOCKS 100;
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
124 125
    ```
   BLOCKS parameter is the number of cache-sized memory blocks in each VNODE (TSDB), so the memory size used for a VNODE equals roughly (cache * blocks). Value range is [3,1000].
126

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
127
    ```mysql
128
    ALTER DATABASE db_name CACHELAST 0;
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
129 130
    ```
    CACHELAST parameter controls whether last_row of the data subtable is cached in memory. The default value is 0, and the value range is [0, 1]. Where 0 means not enabled and 1 means enabled. (supported from version 2.0. 11)
131
   
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
132
    **Tips**: After all the above parameters are modified, show databases can be used to confirm whether the modification is successful.
133

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
134
- **Show all databases in system**
135

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
136 137 138
    ```mysql
    SHOW DATABASES;
    ```
139 140 141

## <a class="anchor" id="table"></a> Table Management

142
- **Create a table**
143

144 145 146 147 148 149
    ```mysql
    CREATE TABLE [IF NOT EXISTS] tb_name (timestamp_field_name TIMESTAMP, field1_name data_type1 [, field2_name data_type2 ...]);
    ```
  Note:
   1. The first field must be a timestamp, and system will set it as the primary key;
   2. The max length of table name is 192;
150
   3. The length of each row of the table cannot exceed 48K (it's 16K prior to 2.1.7.0) characters;
151 152
   4. Sub-table names can only consist of letters, numbers, and underscores, and cannot begin with numbers
   5. If the data type binary or nchar is used, the maximum number of bytes should be specified, such as binary (20), which means 20 bytes;
153

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
154
- **Create a table via STable**
155

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
156 157 158 159
    ```mysql
    CREATE TABLE [IF NOT EXISTS] tb_name USING stb_name TAGS (tag_value1, ...);
    ```
    Use a STable as template and assign tag values to create a data table.
160 161 162

- **Create a data table using STable as a template and specify a specific tags column**

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
163 164 165 166 167
   ```mysql
   CREATE TABLE [IF NOT EXISTS] tb_name USING stb_name (tag_name1, ...) TAGS (tag_value1, ...);
   ```
   Using the specified STable as a template, specify the values of some tags columns to create a data table. (Unspecified tags columns are set to null values.)
   Note: This method has been supported since version 2.0. 17. In previous versions, tags columns were not allowed to be specified, but the values of all tags columns must be explicitly given.
168

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
169
- **Create tables in batches**
170

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
171
   ```mysql
172
   CREATE TABLE [IF NOT EXISTS] tb_name1 USING stb_name TAGS (tag_value1, ...) [IF NOT EXISTS] tb_name2 USING stb_name TAGS (tag_value2, ...) ...;
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
173 174 175 176 177
   ```
   Create a large number of data tables in batches faster. (Server side 2.0. 14 and above)
   
   Note:
   1. The method of batch creating tables requires that the data table must use STable as a template.
178
   2. On the premise of not exceeding the length limit of SQL statements, it is suggested that the number of tables in a single statement should be controlled between 1000 and 3000, which will obtain an ideal speed of table creating.
179

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
180
- **Drop a table**
181
  
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
182 183 184
    ```mysql
    DROP TABLE [IF EXISTS] tb_name;
    ```
185

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
186
- **Show all data table information under the current database**
187

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
188
    ```mysql
189
    SHOW TABLES [LIKE tb_name_wildcard];
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
190 191 192 193
    ```
    Show all data table information under the current database.
    Note: Wildcard characters can be used to match names in like. The maximum length of this wildcard character string cannot exceed 24 bytes.
    Wildcard matching: 1) '%' (percent sign) matches 0 to any number of characters; 2) '_' underscore matches one character.
194

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
195
- **Modify display character width online**
196

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
197 198 199
    ```mysql
    SET MAX_BINARY_DISPLAY_WIDTH <nn>;
    ```
200

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
201 202 203 204 205
- **Get schema information of a table**
  
    ```mysql
    DESCRIBE tb_name;
    ```
206

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
207
- **Add a column to table**
208

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
209 210 211 212 213 214
   ```mysql
   ALTER TABLE tb_name ADD COLUMN field_name data_type;
   ```
   Note:
   1. The maximum number of columns is 1024 and the minimum number is 2;
   2. The maximum length of a column name is 64; 
215

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
216
- **Drop a column in table**
217

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
218 219 220 221
   ```mysql
   ALTER TABLE tb_name DROP COLUMN field_name; 
   ```
   If the table is created through a STable, the operation of table schema changing can only be carried out on the STable. Moreover, the schema changes for the STable take effect for all tables created through the schema. For tables that are not created through STables, you can modify the table schema directly.
222 223 224

## <a class="anchor" id="super-table"></a> STable Management

225
Note: In 2.0.15.0 and later versions, STABLE reserved words are supported. That is, in the instruction description later in this section, the three instructions of CREATE, DROP and ALTER need to write TABLE instead of STABLE in the old version as the reserved word.
226

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
227
- **Create a STable**
228

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
229 230 231
    ```mysql
    CREATE STABLE [IF NOT EXISTS] stb_name (timestamp_field_name TIMESTAMP, field1_name data_type1 [, field2_name data_type2 ...]) TAGS (tag1_name tag_type1, tag2_name tag_type2 [, tag3_name tag_type3]);
    ```
B
Bo Ding 已提交
232
    Similar to a standard table creation SQL, but you need to specify name and type of TAGS field.
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
233 234 235 236 237 238
    
    Note:
    
    1. Data types of TAGS column cannot be timestamp;
    2. No duplicated TAGS column names;
    3. Reversed word cannot be used as a TAGS column name;
239
    4. The maximum number of TAGS is 128, and at least 1 TAG allowed, with a total length of no more than 16K characters.
240

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
241
- **Drop a STable**
242

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
243 244 245 246
    ```mysql
    DROP STABLE [IF EXISTS] stb_name;
    ```
    Drop a STable automatically deletes all sub-tables created through the STable.
247

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
248
- **Show all STable information under the current database**
249

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
250 251 252 253
    ```mysql
    SHOW STABLES [LIKE tb_name_wildcard];
    ```
    View all STables under the current database and relevant information, including name, creation time, column number, tag number, number of tables created through the STable, etc.
254

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
255
- **Obtain schema information of a STable**
256

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
257 258 259
    ```mysql
    DESCRIBE stb_name;
    ```
260

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
261
- **Add column to STable**
262

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
263 264 265
    ```mysql
    ALTER STABLE stb_name ADD COLUMN field_name data_type;
    ```
266

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
267
- **Drop column in STable**
268

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
269 270 271
    ```mysql
    ALTER STABLE stb_name DROP COLUMN field_name; 
    ```
272 273 274

## <a class="anchor" id="tags"></a> TAG Management in STable

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
275
- **Add a tag**
276

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
277 278 279 280
    ```mysql
    ALTER STABLE stb_name ADD TAG new_tag_name tag_type;
    ```
    Add a new tag to the STable and specify a type of the new tag. The total number of tags cannot exceed 128 and the total length does not exceed 16K characters.
281

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
282
- **Drop a tag**
283

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
284 285 286 287
    ```mysql
    ALTER STABLE stb_name DROP TAG tag_name;
    ```
    Delete a tag of STable. After deleting the tag, all sub-tables under the STable will also automatically delete the same tag.
288

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
289
- **Modify a tag name**
290

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
291 292 293 294
    ```mysql
    ALTER STABLE stb_name CHANGE TAG old_tag_name new_tag_name;
    ```
    Modify a tag name of STable. After modifying, all sub-tables under the STable will automatically update the new tag name.
295

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
296
- **Modify a tag value of sub-table**
297
  
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
298 299 300 301
    ```mysql
    ALTER TABLE tb_name SET TAG tag_name=new_tag_value;
    ```
    Note: Except that the operation of tag value updating is carried out for sub-tables, all other tag operations (adding tags, deleting tags, etc.) can only be applied to STable, and cannot be operated on a single sub-table. After adding a tag to a STable, all tables established based on that will automatically add a new tag, and the default value is NULL.
302 303 304

## <a class="anchor" id="insert"></a> Data Writing

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
305
- **Insert a record**
306 307

  ```mysql
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
308
  INSERT INTO tb_name VALUES (field_value, ...);
309
  ```
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
310
  Insert a record into table tb_name.
311

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
312
- **Insert a record with data corresponding to a given column**
313
  
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
314 315 316 317
    ```mysql
    INSERT INTO tb_name (field1_name, ...) VALUES (field1_value1, ...);
    ```
    Insert a record into table tb_name, and the data corresponds to a given column. For columns that do not appear in the SQL statement, database will automatically populate them with NULL. Primary key (timestamp) cannot be NULL.
318

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
319
- **Insert multiple records**
320

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
321 322 323 324
    ```mysql
    INSERT INTO tb_name VALUES (field1_value1, ...) (field1_value2, ...) ...;
    ```
    Insert multiple records into table tb_name.
325

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
326
- **Insert multiple records into a given column**
327
  
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
328 329 330 331
    ```mysql
    INSERT INTO tb_name (field1_name, ...) VALUES (field1_value1, ...) (field1_value2, ...) ...;
    ```
    Insert multiple records into a given column of table tb_name.
332

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
333
- **Insert multiple records into multiple tables**
334
  
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
335 336 337 338 339
    ```mysql
    INSERT INTO tb1_name VALUES (field1_value1, ...) (field1_value2, ...) ...
                tb2_name VALUES (field1_value1, ...) (field1_value2, ...) ...;
    ```
    Insert multiple records into tables tb1_name and tb2_name at the same time.
340

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
341
- **Insert multiple records per column into multiple tables**
342

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
343 344 345 346 347 348
    ```mysql
    INSERT INTO tb1_name (tb1_field1_name, ...) VALUES (field1_value1, ...) (field1_value2, ...) ...
                tb2_name (tb2_field1_name, ...) VALUES (field1_value1, ...) (field1_value2, ...) ...;
    ```
    Insert multiple records per column into tables tb1_name and tb2_name at the same time.
    Note: The timestamp of the oldest record allowed to be inserted is relative to the current server time, minus the configured keep value (days of data retention), and the timestamp of the latest record allowed to be inserted is relative to the current server time, plus the configured days value (interval of data storage in the data file, in days). Both keep and days can be specified when the database is created, and the default values are 3650 days and 10 days, respectively.
349 350 351

- <a class="anchor" id="auto_create_table"></a> Automatically create a table when inserting

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
352 353 354 355
    ```mysql
    INSERT INTO tb_name USING stb_name TAGS (tag_value1, ...) VALUES (field_value1, ...);
    ```
    If user is not sure whether a table exists when writing data, the automatic table building syntax can be used to create a non-existent table when writing. If the table already exists, no new table will be created. When automatically creating a table, it is required to use the STable as a template and specify tags value for the data table.
356

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
357 358 359 360 361 362
- **Automatically create a table when inserting, and specify a given tags column**
  
    ```mysql
    INSERT INTO tb_name USING stb_name (tag_name1, ...) TAGS (tag_value1, ...) VALUES (field_value1, ...);
    ```
    During automatic table creation, only the values of some tags columns can be specified, and the unspecified tags columns will be null.
363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411

**History writing**: The IMPORT or INSERT command can be used. The syntax and function of IMPORT are exactly the same as those of INSERT.

Note: For SQL statements in insert type, the stream parsing strategy we adopt will still execute the correct part of SQL before the following errors are found. In the following sql, insert statement is invalid, but d1001 will still be created.

```mysql
taos> CREATE TABLE meters(ts TIMESTAMP, current FLOAT, voltage INT, phase FLOAT) TAGS(location BINARY(30), groupId INT);
Query OK, 0 row(s) affected (0.008245s)

taos> SHOW STABLES;
              name              |      created_time       | columns |  tags  |   tables    |
============================================================================================
 meters                         | 2020-08-06 17:50:27.831 |       4 |      2 |           0 |
Query OK, 1 row(s) in set (0.001029s)

taos> SHOW TABLES;
Query OK, 0 row(s) in set (0.000946s)

taos> INSERT INTO d1001 USING meters TAGS('Beijing.Chaoyang', 2) VALUES('a');

DB error: invalid SQL: 'a' (invalid timestamp) (0.039494s)

taos> SHOW TABLES;
           table_name           |      created_time       | columns |          stable_name           |
======================================================================================================
 d1001                          | 2020-08-06 17:52:02.097 |       4 | meters                         |
Query OK, 1 row(s) in set (0.001091s)
```

## <a class="anchor" id="select"></a> Data Query

### Query Syntax:

```mysql
SELECT select_expr [, select_expr ...]
    FROM {tb_name_list}
    [WHERE where_condition]
    [INTERVAL (interval_val [, interval_offset])]
    [SLIDING sliding_val]
    [FILL fill_val]
    [GROUP BY col_list]
    [ORDER BY col_list { DESC | ASC }]
    [SLIMIT limit_val [SOFFSET offset_val]]
    [LIMIT limit_val [OFFSET offset_val]]
    [>> export_file];
```

#### SELECT Clause

412
A select clause can be a sub-query of UNION and another query.
413 414 415 416 417 418 419 420 421 422 423 424 425 426 427

#### Wildcard character

The wildcard \* can be used to refer to all columns. For ordinary tables, there’re only ordinary columns in results.

```mysql
taos> SELECT * FROM d1001;
           ts            |       current        |   voltage   |        phase         |
======================================================================================
 2018-10-03 14:38:05.000 |             10.30000 |         219 |              0.31000 |
 2018-10-03 14:38:15.000 |             12.60000 |         218 |              0.33000 |
 2018-10-03 14:38:16.800 |             12.30000 |         221 |              0.31000 |
Query OK, 3 row(s) in set (0.001165s)
```

428
For STables, wildcards contain *tag columns*.
429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534

```mysql
taos> SELECT * FROM meters;
           ts            |       current        |   voltage   |        phase         |            location            |   groupid   |
=====================================================================================================================================
 2018-10-03 14:38:05.500 |             11.80000 |         221 |              0.28000 | Beijing.Haidian                |           2 |
 2018-10-03 14:38:16.600 |             13.40000 |         223 |              0.29000 | Beijing.Haidian                |           2 |
 2018-10-03 14:38:05.000 |             10.80000 |         223 |              0.29000 | Beijing.Haidian                |           3 |
 2018-10-03 14:38:06.500 |             11.50000 |         221 |              0.35000 | Beijing.Haidian                |           3 |
 2018-10-03 14:38:04.000 |             10.20000 |         220 |              0.23000 | Beijing.Chaoyang               |           3 |
 2018-10-03 14:38:16.650 |             10.30000 |         218 |              0.25000 | Beijing.Chaoyang               |           3 |
 2018-10-03 14:38:05.000 |             10.30000 |         219 |              0.31000 | Beijing.Chaoyang               |           2 |
 2018-10-03 14:38:15.000 |             12.60000 |         218 |              0.33000 | Beijing.Chaoyang               |           2 |
 2018-10-03 14:38:16.800 |             12.30000 |         221 |              0.31000 | Beijing.Chaoyang               |           2 |
Query OK, 9 row(s) in set (0.002022s)
```

Wildcards support table name prefixes, the two following SQL statements will return all columns:

```mysql
SELECT * FROM d1001;
SELECT d1001.* FROM d1001;
```

In Join query, the results returned by \* with prefix and \* without prefix are different. \* returns all column data of all tables (excluding tags), while wildcards with prefix only return column data of the corresponding table.

```mysql
taos> SELECT * FROM d1001, d1003 WHERE d1001.ts=d1003.ts;
           ts            | current |   voltage   |    phase     |           ts            | current |   voltage   |    phase     |
==================================================================================================================================
 2018-10-03 14:38:05.000 | 10.30000|         219 |      0.31000 | 2018-10-03 14:38:05.000 | 10.80000|         223 |      0.29000 |
Query OK, 1 row(s) in set (0.017385s)
```
```mysql
taos> SELECT d1001.* FROM d1001,d1003 WHERE d1001.ts = d1003.ts;
           ts            |       current        |   voltage   |        phase         |
======================================================================================
 2018-10-03 14:38:05.000 |             10.30000 |         219 |              0.31000 |
Query OK, 1 row(s) in set (0.020443s)
```

In the process of using SQL functions for query, some SQL functions support wildcard operation. The difference is that the `count(\*)` function returns only one column, but the `first`,`last`,`last_row` functions return all columns.

```mysql
taos> SELECT COUNT(*) FROM d1001;
       count(*)        |
========================
                     3 |
Query OK, 1 row(s) in set (0.001035s)
```

```mysql
taos> SELECT FIRST(*) FROM d1001;
        first(ts)        |    first(current)    | first(voltage) |     first(phase)     |
=========================================================================================
 2018-10-03 14:38:05.000 |             10.30000 |            219 |              0.31000 |
Query OK, 1 row(s) in set (0.000849s)
```

####  Tag Column

Since version 2.0. 14, it is supported to specify *tag column* in queries of ordinary tables, and the values of tag columns will be returned together with the data of other ordinary columns.

```mysql
taos> SELECT location, groupid, current FROM d1001 LIMIT 2;
            location            |   groupid   |       current        |
======================================================================
 Beijing.Chaoyang               |           2 |             10.30000 |
 Beijing.Chaoyang               |           2 |             12.60000 |
Query OK, 2 row(s) in set (0.003112s)
```

Note: The wildcard \* of ordinary tables does not contain *tag columns*.

#### Obtain the de-duplicated value of a tag column

Since version 2.0. 15, it is supported to specify `DISTINCT` keyword when querying tag columns in STables, which will return all non-duplicate values of given tag columns.

```mysql
SELECT DISTINCT tag_name FROM stb_name;
```

Note: At present, `DISTINCT` keyword only supports deduplication of tag columns of STables, and cannot be used for ordinary columns.

#### Column name in result set

In `SELECT` clause, if there’s no returning of column name in result set, the result set column name defaults to the expression name in `SELECT` clause as the column name. In addition, user can use `AS` to rename the columns in the returned result set. For example:

```mysql
taos> SELECT ts, ts AS primary_key_ts FROM d1001;
           ts            |     primary_key_ts      |
====================================================
 2018-10-03 14:38:05.000 | 2018-10-03 14:38:05.000 |
 2018-10-03 14:38:15.000 | 2018-10-03 14:38:15.000 |
 2018-10-03 14:38:16.800 | 2018-10-03 14:38:16.800 |
Query OK, 3 row(s) in set (0.001191s)
```

However, renaming for one single column is not supported for `first(*)`,`last(*)`,`last_row(*)`.

#### Implicit result column

`Select_exprs` can be the name of a column belongs to a table, or it can be a column-based functional expression or calculation formula, with an upper limit of 256. When user uses `interval` or `group by tags` clause, the timestamp column (the first column) and the tag column in `group by` clause are forced to be returned in the final returned result. Later versions can support turning off the output of implicit columns in `group by` clause, and the column output is completely controlled by select clause.

#### List of STable

535
The `FROM` keyword can be followed by a list of several tables (STables) or result of a sub-query. 
536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665

If you do not specify user's current database, you can use the database name before the table name to specify the database to which the table belongs. For example: `power.d1001` to use tables across databases.

```mysql
SELECT * FROM power.d1001;
------------------------------
USE power;
SELECT * FROM d1001;
```

#### Special Functions

Some special query functions can be performed without using FROM clause. Obtain the current database database ():

```mysql
taos> SELECT DATABASE();
           database()           |
=================================
 power                          |
Query OK, 1 row(s) in set (0.000079s)
```

If no default database is specified when logging in, and `USE` command is not used to switch data, then `NULL` is returned.

```mysql
taos> SELECT DATABASE();
           database()           |
=================================
 NULL                           |
Query OK, 1 row(s) in set (0.000184s)
```

Get server and client version numbers:

```mysql
taos> SELECT CLIENT_VERSION();
 client_version() |
===================
 2.0.0.0          |
Query OK, 1 row(s) in set (0.000070s)

taos> SELECT SERVER_VERSION();
 server_version() |
===================
 2.0.0.0          |
Query OK, 1 row(s) in set (0.000077s)
```

A server state detection statement. If server is normal, return a number (for example, 1). If server is exceptional, return error code. The SQL syntax can be compatible with the check of TDengine status by connection pool and the check of database server status by third-party tools. And can avoid connection loss of connection pool caused by using a wrong heartbeat detection SQL statement.

```mysql
taos> SELECT SERVER_STATUS();
 server_status() |
==================
               1 |
Query OK, 1 row(s) in set (0.000074s)

taos> SELECT SERVER_STATUS() AS status;
   status    |
==============
           1 |
Query OK, 1 row(s) in set (0.000081s)
```

#### Special keywords in TAOS SQL

>  `TBNAME`: It can be regarded as a special tag in a STable query, representing the name of sub-table involved in the query
>
> _c0: Represents the first column of a table (STable)

#### Tips

Get all sub-table names and related tags information of a STable:

```mysql
SELECT TBNAME, location FROM meters;
```

Statistics of sub-tables number under a STable:

```mysql
SELECT COUNT(TBNAME) FROM meters;
```

The  two queries above only support adding filters for TAGS in Where conditional clause. For example:

```mysql
taos> SELECT TBNAME, location FROM meters;
             tbname             |            location            |
==================================================================
 d1004                          | Beijing.Haidian                |
 d1003                          | Beijing.Haidian                |
 d1002                          | Beijing.Chaoyang               |
 d1001                          | Beijing.Chaoyang               |
Query OK, 4 row(s) in set (0.000881s)

taos> SELECT COUNT(tbname) FROM meters WHERE groupId > 2;
     count(tbname)     |
========================
                     2 |
Query OK, 1 row(s) in set (0.001091s)
```

- You can use \* to return all columns, or given column names. Four operations can be performed on numeric columns, and column names can be given to output columns.
- `WHERE` statement can use various logical decisions to filter numeric values, or wildcards to filter strings
- The output is sorted by default in ascending order by timestamps in the first column, but you can specify descending order (\_c0 refers to the first column timestamp). It is illegal to use ORDER BY to sort other fields.
- Parameter LIMIT controls the number of outputs, and OFFSET specifies which output starts from. LIMIT/OFFSET executes the result set after ORDER BY.
- "> >" output can be exported to a specified file

#### Supported Filtering Operations

| **Operation** | **Note**                      | **Applicable Data Types**           |
| ------------- | ----------------------------- | ----------------------------------- |
| >             | larger than                   | **timestamp** and all numeric types |
| <             | smaller than                  | **timestamp** and all numeric types |
| >=            | larger than or equal to       | **timestamp** and all numeric types |
| <=            | smaller than or equal to      | **timestamp** and all numeric types |
| =             | equal to                      | all types                           |
| <>            | not equal to                  | all types                           |
| between and   | within a certain range        | **timestamp** and all numeric types |
| %             | match with any char sequences | **binary** **nchar**                |
| _             | match with a single char      | **binary** **nchar**                |

1. To filter the range of multiple fields at the same time, you need to use keyword AND to connect different query conditions. The query filtering between different columns connected by OR are not supported at the moment.
2. For filtering a single field, if it is a time filtering condition, only one condition in a statement can be set; however, for other (ordinary) columns or tag columns, OR keyword can be used for query filtering of combined conditions. For example: ((value > 20 AND value < 30) OR (value < 12)).
3. Since version 2.0. 17, condition filtering supports BETWEEN AND syntax. For example, WHERE col2 BETWEEN 1.5 AND 3.25 means that the query condition is "1.5 ≤ col2 ≤ 3.25".

### SQL Example

- For example, table tb1 is created with the following statement
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
666 667 668 669
  
    ```mysql
    CREATE TABLE tb1 (ts TIMESTAMP, col1 INT, col2 FLOAT, col3 BINARY(50));
    ```
670 671 672

- Query all records of the last hour of tb1

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
673 674 675 676
    ```mysql
    SELECT * FROM tb1 WHERE ts >= NOW - 1h;
    ```

B
Bo Ding 已提交
677
- Look up table tb1 from 2018-06-01 08:00:00. 000 to 2018-06-02 08:00:00. 000, and col3 string is a record ending in 'nny ', and the result is in descending order of timestamp:
678

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
679 680 681
    ```mysql
    SELECT * FROM tb1 WHERE ts > '2018-06-01 08:00:00.000' AND ts <= '2018-06-02 08:00:00.000' AND col3 LIKE '%nny' ORDER BY ts DESC;
    ```
682 683 684

- Query the sum of col1 and col2, and name it complex. The time is greater than 2018-06-01 08:00:00. 000, and col2 is greater than 1.2. As a result, only 10 records are outputted, starting from item 5

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
685 686 687
    ```mysql
    SELECT (col1 + col2) AS 'complex' FROM tb1 WHERE ts > '2018-06-01 08:00:00.000' AND col2 > 1.2 LIMIT 10 OFFSET 5;
    ```
688

689
- Query the records of past 10 minutes, the value of col2 is greater than 3.14, and output the result to the file /home/testoutput.csv.
690

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
691
    ```mysql
692
    SELECT COUNT(*) FROM tb1 WHERE ts >= NOW - 10m AND col2 > 3.14 >> /home/testoutput.csv;
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
693
    ```
694 695 696 697 698 699 700 701 702

<a class="anchor" id="functions"></a>

## SQL Functions

TDengine supports aggregations over data, they are listed below:

- **COUNT**

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726
    ```mysql
    SELECT COUNT([*|field_name]) FROM tb_name [WHERE clause];
    ```
    Function: record the number of rows or non-null values in a column of statistics/STable.
    
    Returned result data type: long integer INT64.
    
    Applicable Fields: Applied to all fields.
    
    Applied to: **table, STable**.
    
    Note:
    1. You can use \* instead of specific fields, and use *() to return the total number of records.
    2. The query results for fields of the same table (excluding NULL values) are the same.
    3. If the statistic object is a specific column, return the number of records with non-NULL values in that column.
    
    Example:
    
    ```mysql
    taos> SELECT COUNT(*), COUNT(voltage) FROM meters;
        count(*)        |    count(voltage)     |
    ================================================
                        9 |                     9 |
    Query OK, 1 row(s) in set (0.004475s)
727
    
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
728 729 730 731 732
    taos> SELECT COUNT(*), COUNT(voltage) FROM d1001;
        count(*)        |    count(voltage)     |
    ================================================
                        3 |                     3 |
    Query OK, 1 row(s) in set (0.001075s)
733 734 735 736
    ```

- **AVG**

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
737 738
  ```mysql
  SELECT AVG(field_name) FROM tb_name [WHERE clause];
739
  ```
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
740
  Function: return the average value of a column in statistics/STable.
741
  
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762
  Return Data Type: double.
  
  Applicable Fields: all types except timestamp, binary, nchar, bool.
  
  Applied to: **table,STable**.
  
  Example:
  
  ```mysql
  taos> SELECT AVG(current), AVG(voltage), AVG(phase) FROM meters;
      avg(current)        |       avg(voltage)        |        avg(phase)         |
  ====================================================================================
              11.466666751 |             220.444444444 |               0.293333333 |
  Query OK, 1 row(s) in set (0.004135s)
  
  taos> SELECT AVG(current), AVG(voltage), AVG(phase) FROM d1001;
      avg(current)        |       avg(voltage)        |        avg(phase)         |
  ====================================================================================
              11.733333588 |             219.333333333 |               0.316666673 |
  Query OK, 1 row(s) in set (0.000943s)
  ```
763 764

- **TWA**
765
  
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
766 767
  ```mysql
  SELECT TWA(field_name) FROM tb_name WHERE clause;
768
  ```
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
769 770 771 772 773 774 775 776
  
  Function: Time weighted average function. The time-weighted average of a column in a statistical table over a period of time.
  
  Return Data Type: double.
  
  Applicable Fields: all types except timestamp, binary, nchar, bool.
  
  Applied to: **table**.
777 778 779

- **SUM**

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
780 781
  ```mysql
  SELECT SUM(field_name) FROM tb_name [WHERE clause];
782
  ```
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
783 784 785
  
  Function: return the sum of a statistics/STable.
  
B
Bo Ding 已提交
786
  Return Data Type: INT64 and Double.
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
787 788 789 790 791 792
  
  Applicable Fields: All types except timestamp, binary, nchar, bool.
  
  Applied to:  **table,STable**.
  
  Example:
793

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
794 795 796 797 798 799
  ```mysql
  taos> SELECT SUM(current), SUM(voltage), SUM(phase) FROM meters;
      sum(current)        |     sum(voltage)      |        sum(phase)         |
  ================================================================================
              103.200000763 |                  1984 |               2.640000001 |
  Query OK, 1 row(s) in set (0.001702s)
800
  
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
801 802 803 804 805
  taos> SELECT SUM(current), SUM(voltage), SUM(phase) FROM d1001;
      sum(current)        |     sum(voltage)      |        sum(phase)         |
  ================================================================================
              35.200000763 |                   658 |               0.950000018 |
  Query OK, 1 row(s) in set (0.000980s)
806
  ```
807 808

- **STDDEV**
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
809 810 811 812 813 814 815 816 817 818 819 820 821 822 823 824 825 826 827 828 829
  
  ```mysql
  SELECT STDDEV(field_name) FROM tb_name [WHERE clause];
  ```
  
  Function: Mean square deviation of a column in statistics table.
  
  Return Data Type: Double.
  
  Applicable Fields: All types except timestamp, binary, nchar, bool.
  
  Applied to: **table**. (also support **STable** since version 2.0.15.1)
  
  Example:
  
  ```mysql
  taos> SELECT STDDEV(current) FROM d1001;
      stddev(current)      |
  ============================
              1.020892909 |
  Query OK, 1 row(s) in set (0.000915s)
830 831 832
  ```

- **LEASTSQUARES**
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
833 834 835 836 837 838 839 840 841 842 843 844 845 846 847 848 849 850 851 852 853
    ```mysql
    SELECT LEASTSQUARES(field_name, start_val, step_val) FROM tb_name [WHERE clause];
    ```
    Function: Value of a column in statistical table is a fitting straight equation of primary key (timestamp). Start_val is the initial value of independent variable, and step_val is the step size value of independent variable.
    
    Return Data Type: String expression (slope, intercept).
    
    Applicable Fields: All types except timestamp, binary, nchar, bool.
    
    Note: Independent variable is the timestamp, and dependent variable is the value of the column.
    
    Applied to: **table**.
    
    Example:
    ```mysql
    taos> SELECT LEASTSQUARES(current, 1, 1) FROM d1001;
                leastsquares(current, 1, 1)             |
    =====================================================
    {slop:1.000000, intercept:9.733334}                 |
    Query OK, 1 row(s) in set (0.000921s)
    ```
854

855 856 857 858 859 860 861 862 863 864 865
- **MODE**
    ```mysql
    SELECT MODE(field_name) FROM tb_name [WHERE clause];
    ```
    Function: Returns the value with the highest frequency. If there are multiple highest values with the same frequency, the output is NULL.

    Return Data Type: Same as applicable fields.

    Applicable Fields: All types except timestamp.

    Supported version: Version after 2.6.0 .
wmmhello's avatar
wmmhello 已提交
866 867 868
    
    Note: Since the amount of returned data is unknown, considering the memory factor, in order to return the result normally, it is recommended that the amount of non repeated data is 100000, otherwise an error will be reported.
    
869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890
    Example:
    ```mysql
    taos> select voltage from d002;
        voltage        |
    ========================
           1           |
           1           |
           2           |
           19          |
    Query OK, 4 row(s) in set (0.003545s)
  
    taos> select mode(voltage) from d002;
      mode(voltage)    |
    ========================
           1           |
   Query OK, 1 row(s) in set (0.019393s)
    ```  

- **HYPERLOGLOG**
    ```mysql
    SELECT HYPERLOGLOG(field_name) FROM { tb_name | stb_name } [WHERE clause];
    ```
wmmhello's avatar
wmmhello 已提交
891 892 893
    Function: 
    - The hyperloglog algorithm is used to return the cardinality of a column. In the case of large amount of data, the algorithm can significantly reduce the occupation of memory, but the cardinality is an estimated value, and the standard error(the standard error is the standard deviation of the average of multiple experiments, not the error with the real result) is 0.81%.
    - When the amount of data is small, the algorithm is not very accurate. You can use the method like this: select count(data) from (select unique(col) as data from table).
894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921

    Return Data Type:Integer.

    Applicable Fields: All types.

    Supported version: Version after 2.6.0 .

    Example:
    ```mysql
    taos> select dbig from shll;
         dbig          |
    ========================
           1           |
           1           |
           1           |
           NULL        |
           2           |
           19          |
           NULL        |
           9           |
    Query OK, 8 row(s) in set (0.003755s)
  
    taos> select hyperloglog(dbig) from shll;
      hyperloglog(dbig)|
    ========================
           4           |
    Query OK, 1 row(s) in set (0.008388s)
  
922 923 924
### Selector Functions

- **MIN**
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
925 926 927 928 929 930 931 932 933 934
    ```mysql
    SELECT MIN(field_name) FROM {tb_name | stb_name} [WHERE clause];
    ```
    Function: return the minimum value of a specific column in statistics/STable.
    
    Return Data Type: Same as applicable fields.
    
    Applicable Fields: All types except timestamp, binary, nchar, bool.
    
    Example:
935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951

    ```mysql
    taos> SELECT MIN(current), MIN(voltage) FROM meters;
        min(current)     | min(voltage) |
    ======================================
                10.20000 |          218 |
    Query OK, 1 row(s) in set (0.001765s)
    
    taos> SELECT MIN(current), MIN(voltage) FROM d1001;
        min(current)     | min(voltage) |
    ======================================
                10.30000 |          218 |
    Query OK, 1 row(s) in set (0.000950s)
    ```

- **MAX**

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
952 953 954 955 956 957 958 959 960 961 962
   ```mysql
   SELECT MAX(field_name) FROM { tb_name | stb_name } [WHERE clause];
   ```
   
   Function: return the maximum value of a specific column in statistics/STable.
   
   Return Data Type: Same as applicable fields.
   
   Applicable Fields: All types except timestamp, binary, nchar, bool.
   
   Example:
963

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
964 965 966 967 968 969
   ```mysql
   taos> SELECT MAX(current), MAX(voltage) FROM meters;
       max(current)     | max(voltage) |
   ======================================
               13.40000 |          223 |
   Query OK, 1 row(s) in set (0.001123s)
970
    
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
971 972 973 974 975 976
   taos> SELECT MAX(current), MAX(voltage) FROM d1001;
       max(current)     | max(voltage) |
   ======================================
               12.60000 |          221 |
   Query OK, 1 row(s) in set (0.000987s)
   ```
977 978 979

- **FIRST**

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
980 981 982 983 984 985 986 987 988 989 990 991
   ```mysql
   SELECT FIRST(field_name) FROM { tb_name | stb_name } [WHERE clause];
   ```
   
   Function: The first non-NULL value written into a column in statistics/STable.
   
   Return Data Type: Same as applicable fields.
   
   Applicable Fields: All types.
   
   Note:
   1. To return the first (minimum timestamp) non-NULL value of each column, use FIRST (\*);
992 993
   2. if all columns in the result set are NULL values, the return result of the column is also NULL;
   3. If all columns in the result set are NULL values, no result is returned.
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
994 995
   
   Example:
996 997

   ```mysql
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
998 999 1000 1001 1002 1003 1004 1005 1006
   taos> SELECT FIRST(*) FROM meters;
          first(ts)        |    first(current)    | first(voltage) |     first(phase)     |
   =========================================================================================
   2018-10-03 14:38:04.000 |             10.20000 |            220 |              0.23000 |
   Query OK, 1 row(s) in set (0.004767s)

   taos> SELECT FIRST(current) FROM d1002;
         first(current)    |
   =======================
1007
                10.20000 |
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1008
   Query OK, 1 row(s) in set (0.001023s)
1009 1010 1011 1012
   ```

- **LAST**

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 1024
   ```mysql
   SELECT LAST(field_name) FROM { tb_name | stb_name } [WHERE clause];
   ```
   
   Function: The last non-NULL value written by the value of a column in statistics/STable.
   
   Return Data Type: Same as applicable fields.
   
   Applicable Fields: All types.
   
   Note:
   1. To return the last (maximum timestamp) non-NULL value of each column, use LAST (\*);
1025
   2. If a column in the result set has a NULL value, the returned result of the column is also NULL; if all columns in the result set have NULL values, no result is returned.
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1026 1027
   
   Example:
1028 1029 1030 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043

   ```mysql
    taos> SELECT LAST(*) FROM meters;
            last(ts)         |    last(current)     | last(voltage) |     last(phase)      |
    ========================================================================================
    2018-10-03 14:38:16.800 |             12.30000 |           221 |              0.31000 |
    Query OK, 1 row(s) in set (0.001452s)

    taos> SELECT LAST(current) FROM d1002;
        last(current)     |
    =======================
                10.30000 |
    Query OK, 1 row(s) in set (0.000843s)
   ```

- **TOP**
1044
  
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1045 1046 1047 1048 1049 1050 1051 1052 1053 1054 1055 1056 1057 1058
    ```mysql
    SELECT TOP(field_name, K) FROM { tb_name | stb_name } [WHERE clause];
    ```
    Function: The top k non-NULL values of a column in statistics/STable. If there are more than k column values tied for the largest, the one with smaller timestamp is returned.
    
    Return Data Type: Same as applicable fields.
    
    Applicable Fields: All types except timestamp, binary, nchar, bool.
    
    Note:
    1. The range of *k* value is 1≤*k*≤100;
    2. System also returns the timestamp column associated with the record.
    
    Example:
1059

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1060 1061 1062 1063 1064 1065 1066 1067
    ```mysql
    taos> SELECT TOP(current, 3) FROM meters;
            ts            |   top(current, 3)    |
    =================================================
    2018-10-03 14:38:15.000 |             12.60000 |
    2018-10-03 14:38:16.600 |             13.40000 |
    2018-10-03 14:38:16.800 |             12.30000 |
    Query OK, 3 row(s) in set (0.001548s)
1068
      
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1069 1070 1071 1072 1073 1074 1075
    taos> SELECT TOP(current, 2) FROM d1001;
            ts            |   top(current, 2)    |
    =================================================
    2018-10-03 14:38:15.000 |             12.60000 |
    2018-10-03 14:38:16.800 |             12.30000 |
    Query OK, 2 row(s) in set (0.000810s)
    ```
1076 1077 1078

- **BOTTOM**

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1079 1080 1081 1082 1083 1084 1085 1086
    ```mysql
    SELECT BOTTOM(field_name, K) FROM { tb_name | stb_name } [WHERE clause];
    ```
    Function: The last k non-NULL values of a column in statistics/STable. If there are more than k column values tied for the smallest, the one with smaller timestamp is returned.
    
    Return Data Type: Same as applicable fields.
    
    Applicable Fields: All types except timestamp, binary, nchar, bool.
1087

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1088 1089 1090
    Note:
    1. The range of *k* value is 1≤*k*≤100;
    2. System also returns the timestamp column associated with the record.
1091

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1092
    Example:
1093

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1094 1095 1096 1097 1098 1099 1100
    ```mysql
    taos> SELECT BOTTOM(voltage, 2) FROM meters;
            ts            | bottom(voltage, 2) |
    ===============================================
    2018-10-03 14:38:15.000 |                218 |
    2018-10-03 14:38:16.650 |                218 |
    Query OK, 2 row(s) in set (0.001332s)
1101
    
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1102 1103 1104 1105 1106 1107
    taos> SELECT BOTTOM(current, 2) FROM d1001;
            ts            |  bottom(current, 2)  |
    =================================================
    2018-10-03 14:38:05.000 |             10.30000 |
    2018-10-03 14:38:16.800 |             12.30000 |
    Query OK, 2 row(s) in set (0.000793s)
1108 1109 1110
    ```

- **PERCENTILE**
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1111 1112 1113 1114 1115 1116 1117 1118 1119 1120 1121 1122
    ```mysql
    SELECT PERCENTILE(field_name, P) FROM { tb_name } [WHERE clause];
    ```
    Function: Percentile of the value of a column in statistical table.
    
    Return Data Type: Double.
    
    Applicable Fields: All types except timestamp, binary, nchar, bool.
    
    Note: The range of P value is 0 ≤ P ≤ 100. P equals to MIN when, and equals MAX when it’s 100.
    
    Example:
1123

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1124
    ```mysql
1125 1126 1127 1128 1129
    taos> SELECT PERCENTILE(current, 20) FROM d1001;
    percentile(current, 20)  |
    ============================
                11.100000191 |
    Query OK, 1 row(s) in set (0.000787s)
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1130
    ```
1131 1132

- **APERCENTILE**
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1133 1134 1135 1136 1137 1138 1139 1140 1141 1142
    ```mysql
    SELECT APERCENTILE(field_name, P) FROM { tb_name | stb_name } [WHERE clause];
    ```
    Function: The value percentile of a column in statistical table is similar to the PERCENTILE function, but returns approximate results.
    
    Return Data Type: Double.
    
    Applicable Fields: All types except timestamp, binary, nchar, bool.
    
    Note: The range of *P* value is 0 ≤ *P* ≤ 100. *P* equals to MIN when, and equals MAX when it’s 100. APERCENTILE function is recommended, which performs far better than PERCENTILE function.
1143 1144

- **LAST_ROW**
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1145 1146 1147 1148 1149 1150 1151 1152 1153 1154 1155 1156
    ```mysql
    SELECT LAST_ROW(field_name) FROM { tb_name | stb_name };
    ```
    Function: Return the last record of a table (STtable).
    
    Return Data Type: Double.
    
    Applicable Fields: All types.
    
    Note: Unlike last function, last_row does not support time range restriction and forces the last record to be returned.
    
    Example:
1157

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1158 1159 1160 1161 1162 1163
    ```mysql
    taos> SELECT LAST_ROW(current) FROM meters;
    last_row(current)   |
    =======================
                12.30000 |
    Query OK, 1 row(s) in set (0.001238s)
1164
    
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1165 1166 1167 1168
    taos> SELECT LAST_ROW(current) FROM d1002;
    last_row(current)   |
    =======================
                10.30000 |
1169 1170 1171
      Query OK, 1 row(s) in set (0.001042s)
    ```

1172 1173 1174 1175 1176 1177 1178 1179 1180 1181 1182 1183 1184 1185 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201 1202 1203 1204 1205 1206 1207 1208 1209 1210 1211 1212 1213 1214 1215 1216 1217 1218 1219 1220 1221
- **TAIL**
    ```mysql
    SELECT TAIL(field_name, k, offset_val) FROM {tb_name | stb_name} [WHERE clause];
    ```
    Function: Skip the last num of offset_value, return the k consecutive records without ignoring NULL value. offset_val can be empty, then the last K records are returned.The function is equivalent to:order by ts desc LIMIT k OFFSET offset_val.

    Range:k: [1,100]  offset_val: [0,100]。

    Return Data Type: Same as applicable fields.

    Applicable Fields: All types except timestamp.

    Applied to: **table stable**.

    Supported version: Version after 2.6.0 .

    Example:
    ```mysql
    taos> select ts,dbig from tail2;
           ts            |         dbig          |
    ==================================================
    2021-10-15 00:31:33.000 |                     1 |
    2021-10-17 00:31:31.000 |                  NULL |
    2021-12-24 00:31:34.000 |                     2 |
    2022-01-01 08:00:05.000 |                    19 |
    2022-01-01 08:00:06.000 |                  NULL |
    2022-01-01 08:00:07.000 |                     9 |
    Query OK, 6 row(s) in set (0.001952s)
  
    taos> select tail(dbig,2,2) from tail2;
    ts                      |    tail(dbig,2,2)     |
    ==================================================
    2021-12-24 00:31:34.000 |                     2 |
    2022-01-01 08:00:05.000 |                    19 |
    Query OK, 2 row(s) in set (0.002307s)

- **UNIQUE**
    ```mysql
    SELECT UNIQUE(field_name) FROM {tb_name | stb_name} [WHERE clause];
    ```
    Function: Returns the first occurrence of a value in this column.

    Return Data Type: Same as applicable fields.

    Applicable Fields: All types except timestamp.

    Applied to: **table stable**.

    Supported version: Version after 2.6.0 .

wmmhello's avatar
wmmhello 已提交
1222 1223 1224 1225
    Note: 
    - This function can be applied to ordinary tables and super tables. Cannot be used with window operations,such as interval/state_window/session_window.
    - Since the amount of returned data is unknown, considering the memory factor, in order to return the result normally, it is recommended that the amount of non repeated data is 100000, otherwise an error will be reported.
    
1226 1227 1228 1229 1230 1231 1232 1233 1234 1235 1236 1237 1238 1239 1240 1241 1242 1243 1244 1245 1246 1247 1248 1249 1250
    Example:
    ```mysql
    taos> select ts,voltage from unique1;
           ts            |        voltage        |
    ==================================================
    2021-10-17 00:31:31.000 |                     1 |
    2022-01-24 00:31:31.000 |                     1 |
    2021-10-17 00:31:31.000 |                     1 |
    2021-12-24 00:31:31.000 |                     2 |
    2022-01-01 08:00:01.000 |                    19 |
    2021-10-17 00:31:31.000 |                  NULL |
    2022-01-01 08:00:02.000 |                  NULL |
    2022-01-01 08:00:03.000 |                     9 |
    Query OK, 8 row(s) in set (0.003018s)
  
    taos> select unique(voltage) from unique1;
    ts                      |    unique(voltage)    |
    ==================================================
    2021-10-17 00:31:31.000 |                     1 |
    2021-10-17 00:31:31.000 |                  NULL |
    2021-12-24 00:31:31.000 |                     2 |
    2022-01-01 08:00:01.000 |                    19 |
    2022-01-01 08:00:03.000 |                     9 |
    Query OK, 5 row(s) in set (0.108458s)

1251 1252 1253
### Computing Functions

- **DIFF**
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1254 1255 1256 1257 1258 1259 1260 1261 1262 1263 1264 1265
    ```mysql
    SELECT DIFF(field_name) FROM tb_name [WHERE clause];
    ```
    Function: Return the value difference between a column and the previous column.
    
    Return Data Type: Same as applicable fields.
    
    Applicable Fields: All types except timestamp, binary, nchar, bool.
    
    Note: The number of output result lines is the total number of lines in the range minus one, and there is no result output in the first line.
    
    Example:
1266

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1267 1268 1269 1270 1271 1272 1273 1274
    ```mysql
    taos> SELECT DIFF(current) FROM d1001;
            ts            |    diff(current)     |
    =================================================
    2018-10-03 14:38:15.000 |              2.30000 |
    2018-10-03 14:38:16.800 |             -0.30000 |
    Query OK, 2 row(s) in set (0.001162s)
    ```
1275 1276 1277

- **SPREAD**

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1278 1279 1280 1281 1282
    ```mysql
    SELECT SPREAD(field_name) FROM { tb_name | stb_name } [WHERE clause];
    ```
    Function: Return the difference between the max value and the min value of a column in statistics /STable.
    
1283
    Return Data Type: Double.
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1284 1285 1286 1287 1288 1289
    
    Applicable Fields: All types except binary, nchar, bool.
    
    Note: Applicable for TIMESTAMP field, which indicates the time range of a record.
    
    Example:
1290

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1291 1292 1293 1294 1295 1296
    ```mysql
    taos> SELECT SPREAD(voltage) FROM meters;
        spread(voltage)      |
    ============================
                5.000000000 |
    Query OK, 1 row(s) in set (0.001792s)
1297
    
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1298 1299 1300 1301 1302 1303
    taos> SELECT SPREAD(voltage) FROM d1001;
        spread(voltage)      |
    ============================
                3.000000000 |
    Query OK, 1 row(s) in set (0.000836s)
    ```
1304

1305 1306 1307 1308 1309 1310 1311 1312 1313 1314 1315 1316 1317 1318 1319 1320 1321 1322 1323
- **ASIN**
    ```mysql
    SELECT ASIN(field_name) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Returns the arc-sine of the input value.

    Output Data Type: DOUBLE.

    Input: applies to value of all types except timestamp, binary, nchar, and bool. Can not apply to tag column of super table.

    Embedded Query Support: Both Outer Query and Inner Query 

    Notes:

      If input value is NULL, the output value is NULL.

      It is a scalar function and can not be used together with aggregate function

      Applies to columns of normal table, child table and super table
1324 1325 1326
      
      Supported after version 2.6.0.x

1327 1328 1329 1330 1331 1332 1333 1334 1335 1336 1337 1338 1339 1340 1341 1342 1343 1344 1345 1346 1347

- **ACOS**
    ```mysql
    SELECT ACOS(field_name) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Returns the arc-cosine of the input value.

    Output Data Type: DOUBLE.

    Input: applies to value of all types except timestamp, binary, nchar, and bool. Can not apply to tag column of super table.

    Embedded Query Support: Both Outer Query and Inner Query 

    Notes:

      If input value is NULL, the output value is NULL.

      It is a scalar function and can not be used together with aggregate function

      Applies to columns of normal table, child table and super table

1348 1349
      Supported after version 2.6.0.x

1350 1351 1352 1353 1354 1355 1356 1357 1358 1359 1360 1361 1362 1363 1364 1365 1366 1367 1368 1369 1370

- **ATAN**
    ```mysql
    SELECT ATAN(field_name) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Returns the arc-tangent of the input value.

    Output Data Type: DOUBLE.

    Input: applies to value of all types except timestamp, binary, nchar, and bool. Can not apply to tag column of super table.

    Embedded Query Support: Both Outer Query and Inner Query 

    Notes:

      If input value is NULL, the output value is NULL.

      It is a scalar function and can not be used together with aggregate function

      Applies to columns of normal table, child table and super table

1371 1372
      Supported after version 2.6.0.x

1373 1374 1375 1376 1377 1378 1379 1380 1381 1382 1383 1384 1385 1386 1387 1388 1389 1390 1391 1392 1393

- **SIN**
    ```mysql
    SELECT SIN(field_name) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Returns the sine of the input value.

    Output Data Type: DOUBLE.

    Input: applies to value of all types except timestamp, binary, nchar, and bool. Can not apply to tag column of super table.

    Embedded Query Support: Both Outer Query and Inner Query 

    Notes:

      If input value is NULL, the output value is NULL.

      It is a scalar function and can not be used together with aggregate function

      Applies to columns of normal table, child table and super table

1394 1395
      Supported after version 2.6.0.x

1396 1397 1398 1399 1400 1401 1402 1403 1404 1405 1406 1407 1408 1409 1410 1411 1412 1413 1414 1415 1416

- **COS**
    ```mysql
    SELECT COS(field_name) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Returns the cosine of the input value.

    Output Data Type: DOUBLE.

    Input: applies to value of all types except timestamp, binary, nchar, and bool. Can not apply to tag column of super table.

    Embedded Query Support: Both Outer Query and Inner Query 

    Notes:

      If input value is NULL, the output value is NULL.

      It is a scalar function and can not be used together with aggregate function

      Applies to columns of normal table, child table and super table

1417 1418
      Supported after version 2.6.0.x

1419 1420 1421 1422 1423 1424 1425 1426 1427 1428 1429 1430 1431 1432 1433 1434 1435 1436 1437 1438
- **TAN**
    ```mysql
    SELECT TAN(field_name) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Returns the tangent of the input value.

    Output Data Type: DOUBLE.

    Input: applies to value of all types except timestamp, binary, nchar, and bool. Can not apply to tag column of super table.

    Embedded Query Support: Both Outer Query and Inner Query 

    Notes:

      If input value is NULL, the output value is NULL.

      It is a scalar function and can not be used together with aggregate function

      Applies to columns of normal table, child table and super table

1439 1440
      Supported after version 2.6.0.x

1441 1442 1443 1444 1445 1446 1447 1448 1449 1450 1451 1452 1453 1454 1455 1456 1457 1458 1459 1460 1461 1462 1463


- **POW**
    ```mysql
    SELECT POW(field_name, power) FROM { tb_name | stb_name } [WHERE clause]
    ```

    Function: Returns the input value raised to the specified power of the second argument

    Output Data Type: DOUBLE.

    Input: applies to value of all types except timestamp, binary, nchar, and bool. Can not apply to tag column of super table.

    Embedded Query Support: Both Outer Query and Inner Query 

    Notes:

      If input value is NULL, the output value is NULL.

      It is a scalar function and can not be used together with aggregate function

      Applies to columns of normal table, child table and super table

1464 1465
      Supported after version 2.6.0.x

1466 1467 1468 1469 1470 1471 1472 1473 1474 1475 1476 1477 1478 1479 1480 1481 1482 1483 1484 1485
- **LOG**
    ```mysql
    SELECT LOG(field_name, base) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Returns the logarithm of the input value with base

    Output Data Type: DOUBLE.

    Input: applies to value of all types except timestamp, binary, nchar, and bool. Can not apply to tag column of super table.

    Embedded Query Support: Both Outer Query and Inner Query 

    Notes:

      If input value is NULL, the output value is NULL.

      It is a scalar function and can not be used together with aggregate function

      Applies to columns of normal table, child table and super table

1486 1487
      Supported after version 2.6.0.x

1488 1489 1490 1491 1492 1493 1494 1495 1496 1497 1498 1499 1500 1501 1502 1503 1504 1505 1506 1507
- **ABS**
    ```mysql
    SELECT ABS(field_name) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Returns the absolute value of the input value

    Output Data Type: If the input data is an integer numeric value, the output data type is ubigint. If the input data is a float or double value, the output data type is double

    Input: applies to value of all types except timestamp, binary, nchar, and bool. Can not apply to tag column of super table.

    Embedded Query Support: Both Outer Query and Inner Query 

    Notes:

      If input value is NULL, the output value is NULL.

      It is a scalar function and can not be used together with aggregate function

      Applies to columns of normal table, child table and super table

1508 1509
      Supported after version 2.6.0.x

1510 1511 1512 1513 1514 1515 1516 1517 1518 1519 1520 1521 1522 1523 1524 1525 1526 1527 1528 1529 1530

- **SQRT**
    ```mysql
    SELECT SQRT(field_name) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Returns the square root value of the input value

    Output Data Type: DOUBLE.

    Input: applies to value of all types except timestamp, binary, nchar, and bool. Can not apply to tag column of super table.

    Embedded Query Support: Both Outer Query and Inner Query 

    Notes:

      If input value is NULL, the output value is NULL.

      It is a scalar function and can not be used together with aggregate function

      Applies to columns of normal table, child table and super table

1531 1532
      Supported after version 2.6.0.x

1533 1534 1535 1536 1537 1538 1539 1540 1541 1542 1543 1544 1545 1546 1547 1548
- **CAST**
    ```mysql
    SELECT CAST(expression AS type_name) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Converts a value into as a specific data type of type_name.

    Output Data Type: type_name specificied. Supported types include BIGINT, BINARY(N), TIMESTAMP and NCHAR(N) and BIGINT UNSIGNED

    Input: Normal column, constant, scalar function and the arithmetic computation(+,-,*,/,%) among them. Input data type includes BOOL, TINYINT, SMALLINT, INT, BIGINT, FLOAT, DOUBLE, BINARY(M), TIMESTAMP, NCHAR(M), TINYINT UNSIGNED, SMALLINT UNSIGNED, INT UNSIGNED, and BIGINT UNSIGNED

    Notes:

      Reports error for unsupported cast

      It is a scalar function and its output is NULL for input NULL

1549 1550
      Supported after version 2.6.0.x

1551 1552 1553 1554 1555 1556 1557 1558 1559 1560 1561 1562 1563 1564 1565 1566 1567

- **CONCAT**
    ```mysql
    SELECT CONCAT(str1|column1, str2|column2, ...) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Returns the string from concatenating the arguments

    Output Data Type: With binary inputs, the output data type is binary. With nchar inputs, the output data type is nchar.

    Input: all inputs shall be of data type binary or nchar. Can not apply to tag columns.

    Notes:
    
      If one of the string inputs is NULL, the resulting output is NULL.
      The function takes 2 to 8 string values as input. all inputs must be of the same data type.
      This function applies to normal table, child table and super table
      This function applies to bother out query and inner query
1568
      Supported after version 2.6.0.x
1569 1570 1571 1572 1573 1574 1575 1576 1577 1578 1579 1580 1581 1582 1583 1584 1585
      
- **CONCAT_WS**
    ```
    SELECT CONCAT_WS(separator, str1|column1, str2|column2, ...) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Returns the string from concatenating the arguments with separator.

    Output Data Type: With binary inputs, the output data type is binary. With nchar inputs, the output data type is nchar.

    Input: all inputs shall be of data type binary or nchar. Can not apply to tag columns.

    Notes:
    
      Returns NULL when the separator is NULL. If the separator is not NULL and all the other string values are NULL, the result is an empty string. 
      The function takes 3 to 9 string values as input. all inputs must be of the same data type.
      This function applies to normal table, child table and super table
      This function applies to bother out query and inner query
1586
      Supported after version 2.6.0.x
1587 1588 1589 1590 1591 1592 1593 1594 1595 1596 1597 1598 1599 1600 1601 1602 1603
      

- **LENGTH**
    ```
    SELECT LENGTH(str|column) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Returns the length of the string measure in bytes

    Output Data Type: INT。

    Input: BINARY or NCHAR values. Can not apply to tag columns

    Notes:
    
      Returns NULL when input is NULL. 
      This function applies to normal table, child table and super table
      This function applies to bother out query and inner query
1604
      Supported after version 2.6.0.x
1605 1606 1607 1608 1609 1610 1611 1612 1613 1614 1615 1616 1617 1618 1619 1620

- **CHAR_LENGTH**
    ```
    SELECT CHAR_LENGTH(str|column) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Returns the length of the string measure in characters

    Output Data Type: INT。

    Input: BINARY or NCHAR values. Can not apply to tag columns

    Notes:
    
      Returns NULL when input is NULL. 
      This function applies to normal table, child table and super table
      This function applies to bother out query and inner query
1621
      Supported after version 2.6.0.x
1622 1623 1624 1625 1626 1627 1628 1629 1630 1631 1632 1633 1634 1635 1636 1637

- **LOWER**
    ```
    SELECT LOWER(str|column) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Returns the lower case of input value

    Output Data Type: BINARY or NCHAR. Same data type as Input.

    Input: BINARY or NCHAR values. Can not apply to tag columns

    Notes:
    
      Returns NULL when input is NULL. 
      This function applies to normal table, child table and super table
      This function applies to bother out query and inner query
1638
      Supported after version 2.6.0.x
1639 1640 1641 1642 1643 1644 1645 1646 1647 1648 1649 1650 1651 1652 1653 1654

- **UPPER**
    ```
    SELECT UPPER(str|column) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: Returns the upper case of input value

    Output Data Type: BINARY or NCHAR. Same data type as Input.

    Input: BINARY or NCHAR values. Can not apply to tag columns

    Notes:
    
      Returns NULL when input is NULL. 
      This function applies to normal table, child table and super table
      This function applies to bother out query and inner query
1655
      Supported after version 2.6.0.x
1656 1657 1658 1659 1660 1661 1662 1663 1664 1665 1666 1667 1668 1669 1670 1671

- **LTRIM**
    ```
    SELECT LTRIM(str|column) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: removes leading spaces from a string

    Output Data Type: BINARY or NCHAR. Same data type as Input.

    Input: BINARY or NCHAR values. Can not apply to tag columns

    Notes:
    
      Returns NULL when input is NULL. 
      This function applies to normal table, child table and super table
      This function applies to bother out query and inner query
1672
      Supported after version 2.6.0.x
1673 1674 1675 1676 1677 1678 1679 1680 1681 1682 1683 1684 1685 1686 1687 1688

- **RTRIM**
    ```
    SELECT RTRIM(str|column) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: removes trailing spaces from a string

    Output Data Type: BINARY or NCHAR. Same data type as Input.

    Input: BINARY or NCHAR values. Can not apply to tag columns

    Notes:
    
      Returns NULL when input is NULL. 
      This function applies to normal table, child table and super table
      This function applies to bother out query and inner query
1689
      Supported after version 2.6.0.x
1690 1691 1692 1693 1694 1695 1696 1697 1698 1699 1700 1701 1702 1703 1704 1705 1706

- **SUBSTR**
    ```
    SELECT SUBSTR(str,pos[,len]) FROM { tb_name | stb_name } [WHERE clause]
    ```
    Function: extracts substring from a string str, starting from pos and extracting len characters.

    Output Data Type: BINARY or NCHAR. Same data type as Input.

    Input: BINARY or NCHAR values. Can not apply to tag columns

    Notes:
    
      Returns NULL when input is NULL. 
      Input pos can be negative or positive. If it is a positive number, this function extracts from the beginning of the string. If it is a negative number, this function extracts from the end of the string
      If input len is ommited, the output is whole substring starting from pos.
      This function applies to normal table, child table and super table
1707 1708
      This function applies to bother out query and inner query
      Supported after version 2.6.0.x    
1709 1710


涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1711
- **Four Operations**
1712

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1713 1714 1715 1716 1717 1718 1719 1720 1721 1722 1723 1724 1725
    ```mysql
    SELECT field_name [+|-|*|/|%][Value|field_name] FROM { tb_name | stb_name }  [WHERE clause];
    ```
    Function: Calculation results of addition, subtraction, multiplication, division and remainder of values in a column or among multiple columns in statistics/STable.
    
    Returned Data Type: Double.
    
    Applicable Fields: All types except timestamp, binary, nchar, bool.
    
    Note: 
    
    1. Calculation between two or more columns is supported, and the calculation priorities can be controlled by parentheses();
    2. The NULL field does not participate in the calculation. If a row involved in calculation contains NULL, the calculation result of the row is NULL.
1726

1727 1728 1729 1730 1731 1732 1733 1734 1735 1736 1737 1738 1739 1740 1741 1742 1743 1744 1745 1746 1747 1748 1749 1750 1751 1752 1753 1754 1755 1756 1757 1758 1759 1760 1761 1762 1763 1764 1765 1766 1767 1768 1769 1770 1771 1772 1773 1774 1775 1776 1777 1778 1779 1780 1781 1782 1783 1784 1785 1786 1787 1788 1789 1790 1791 1792 1793 1794 1795 1796 1797 1798 1799 1800 1801 1802 1803 1804 1805 1806 1807 1808 1809 1810 1811 1812 1813 1814 1815 1816 1817
- **STATECOUNT**
    ```mysql
    SELECT STATECOUNT(field_name, oper, val) FROM { tb_name | stb_name } [WHERE clause];
    ```
    Function: Returns the number of consecutive records that meet a certain condition, and the result is appended to each row as a new column. The condition is calculated according to the parameters. If the condition is true, it will be increased by 1. If the condition is false, it will be reset to -1. If the data is NULL, the data will be skipped.

    Range:
    - oper : LT(<),GT(>),LE(<=),GE(>=),NE(!=),EQ(=),case insensitive.
    - val  : Number.

    Returned Data Type: Integer。

    Applicable Fields: All types except timestamp, binary, nchar, bool.

    Supported version: Version after 2.6.0 .

    Note:
    - This function can be applied to ordinary tables. When a separate timeline is divided by group by, it is used for super tables (i.e. group by TBNAME).
    - Cannot be used with window operations,such as interval/state_window/session_window.

    Example:
    ```mysql
    taos> select ts,dbig from statef2;
              ts               |         dbig          |
    ========================================================
    2021-10-15 00:31:33.000000000 |                     1 |
    2021-10-17 00:31:31.000000000 |                  NULL |
    2021-12-24 00:31:34.000000000 |                     2 |
    2022-01-01 08:00:05.000000000 |                    19 |
    2022-01-01 08:00:06.000000000 |                  NULL |
    2022-01-01 08:00:07.000000000 |                     9 |
    Query OK, 6 row(s) in set (0.002977s)
  
    taos> select stateCount(dbig,GT,2) from statef2;
    ts               |         dbig          | statecount(dbig,gt,2) |
    ================================================================================
    2021-10-15 00:31:33.000000000 |                     1 |                    -1 |
    2021-10-17 00:31:31.000000000 |                  NULL |                  NULL |
    2021-12-24 00:31:34.000000000 |                     2 |                    -1 |
    2022-01-01 08:00:05.000000000 |                    19 |                     1 |
    2022-01-01 08:00:06.000000000 |                  NULL |                  NULL |
    2022-01-01 08:00:07.000000000 |                     9 |                     2 |
    Query OK, 6 row(s) in set (0.002791s)
   ```

- **STATEDURATION**
    ```mysql
    SELECT stateDuration(field_name, oper, val, unit) FROM { tb_name | stb_name } [WHERE clause];
    ```
    Function: Returns the length of time of continuous records that meet a certain condition, and the result is appended to each row as a new column. The condition is calculated according to the parameters. If the condition is true, the length of time between two records will be added (the length of time of the first record that meets the condition is recorded as 0). If the condition is false, it will be reset to -1. If the data is NULL, the data will be skipped.

    Range:
    - oper : LT(<),GT(>),LE(<=),GE(>=),NE(!=),EQ(=),case insensitive.
    - val  : Number.
    - unit : Unit of time length, range [1s, 1M, 1H], less than one unit is rounded off. The default is 1s.

    Returned Data Type: Integer。

    Applicable Fields: All types except timestamp, binary, nchar, bool.

    Supported version: Version after 2.6.0 .
    
    Note:
    - This function can be applied to ordinary tables. When a separate timeline is divided by group by, it is used for super tables (i.e. group by TBNAME).
    - Cannot be used with window operations,such as interval/state_window/session_window.

    Example:
    ```mysql
    taos> select ts,dbig from statef2;
              ts               |         dbig          |
    ========================================================
    2021-10-15 00:31:33.000000000 |                     1 |
    2021-10-17 00:31:31.000000000 |                  NULL |
    2021-12-24 00:31:34.000000000 |                     2 |
    2022-01-01 08:00:05.000000000 |                    19 |
    2022-01-01 08:00:06.000000000 |                  NULL |
    2022-01-01 08:00:07.000000000 |                     9 |
    Query OK, 6 row(s) in set (0.002407s)
  
    taos> select stateDuration(dbig,GT,2) from statef2;
    ts               |         dbig          | stateduration(dbig,gt,2) |
    ===================================================================================
    2021-10-15 00:31:33.000000000 |                     1 |                       -1 |
    2021-10-17 00:31:31.000000000 |                  NULL |                     NULL |
    2021-12-24 00:31:34.000000000 |                     2 |                       -1 |
    2022-01-01 08:00:05.000000000 |                    19 |                        0 |
    2022-01-01 08:00:06.000000000 |                  NULL |                     NULL |
    2022-01-01 08:00:07.000000000 |                     9 |                        2 |
    Query OK, 6 row(s) in set (0.002613s)
     ```

1818 1819
## <a class="anchor" id="aggregation"></a> Time-dimension Aggregation

1820
TDengine supports aggregating by intervals (time range). Data in a table can partitioned by intervals and aggregated to generate results. For example, a temperature sensor collects data once per second, but the average temperature needs to be queried every 10 minutes. This aggregation is suitable for down sample operation, and the syntax is as follows:
1821 1822 1823 1824 1825 1826 1827 1828 1829 1830 1831 1832 1833 1834 1835 1836 1837 1838 1839 1840 1841

```mysql
SELECT function_list FROM tb_name
  [WHERE where_condition]
  INTERVAL (interval [, offset])
  [SLIDING sliding]
  [FILL ({NONE | VALUE | PREV | NULL | LINEAR | NEXT})]

SELECT function_list FROM stb_name
  [WHERE where_condition]
  INTERVAL (interval [, offset])
  [SLIDING sliding]
  [FILL ({ VALUE | PREV | NULL | LINEAR | NEXT})]
  [GROUP BY tags]
```

- The length of aggregation interval is specified by keyword INTERVAL, the min time interval is 10 milliseconds (10a), and offset is supported (the offset must be less than interval). In aggregation queries, the aggregator and selector functions that can be executed simultaneously are limited to functions with one single output: count, avg, sum, stddev, leastsquares, percentile, min, max, first, last. Functions with multiple rows of output results (such as top, bottom, diff, and four operations) cannot be used.

- WHERE statement specifies the start and end time of a query and other filters

- FILL statement specifies a filling mode when data missed in a certain interval. Applicable filling modes include the following:
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1842
  
B
Bo Ding 已提交
1843
  1. Do not fill: NONE (default filing mode).
涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1844 1845 1846 1847
  2. VALUE filling: Fixed value filling, where the filled value needs to be specified. For example: fill (VALUE, 1.23).
  3. NULL filling: Fill the data with NULL. For example: fill (NULL).
  4. PREV filling: Filling data with the previous non-NULL value. For example: fill (PREV).
  5. NEXT filling: Filling data with the next non-NULL value. For example: fill (NEXT).
1848 1849 1850

Note:

涛思数据(TDengine)'s avatar
涛思数据(TDengine) 已提交
1851 1852 1853
  1. When using a FILL statement, a large number of filling outputs may be generated. Be sure to specify the time interval for the query. For each query, system can return no more than 10 million results with interpolation.
  2. In a time-dimension aggregation, the time-series in returned results increases strictly monotonously.
  3. If the query object is a STable, the aggregator function will act on the data of all tables under the STable that meet the value filters. If group by statement is not used in the query, the returned result increases strictly monotonously according to time-series; If group by statement is used to group in the query, each group in the returned result does not increase strictly monotonously according to time-series.
1854 1855 1856 1857 1858 1859 1860 1861 1862 1863 1864 1865 1866 1867 1868 1869 1870 1871 1872

Example: The statement for building a database for smart meter is as follows:

```mysql
CREATE TABLE meters (ts TIMESTAMP, current FLOAT, voltage INT, phase FLOAT) TAGS (location BINARY(64), groupId INT);
```

According to the data collected by the smart meter, the average value, maximum value, median current of current data in the past 24 hours are calculated in a phase of 10 minutes, and the current trend with time changes is fitted to a straight line. If there is no calculated value, fill it with the previous non-NULL value. The query statement used is as follows:

```mysql
SELECT AVG(current), MAX(current), LEASTSQUARES(current, start_val, step_val), PERCENTILE(current, 50) FROM meters
  WHERE ts>=NOW-1d
  INTERVAL(10m)
  FILL(PREV);
```

## <a class="anchor" id="limitation"></a> TAOS SQL Boundary Restrictions

- Max database name length is 32
1873
- Max length of table name is 192, and max length of each data row is 48K (it's 16K prior to 2.1.7.0) characters
1874
- Max length of column name is 64, max number of columns allowed is 1024, and min number of columns allowed is 2. The first column must be a timestamp
1875
- Max number of tags allowed is 128, down to 1, and total length of tags does not exceed 16K characters
1876 1877 1878 1879 1880 1881 1882
- Max length of SQL statement is 65480 characters, but it can be modified by system configuration parameter maxSQLLength, and max length can be configured to 1M
- Number of databases, STables and tables are not limited by system, but only limited by system resources

## Other TAOS SQL Conventions

**Restrictions on group by**

1883
TAOS SQL supports group by operation on tags, tbnames and ordinary columns, required that only one column and which has less than 100,000 unique values.
1884 1885 1886

**Restrictions on join operation**

1887
TAOS SQL supports join columns of two tables by Primary Key timestamp between them, and does not support four arithmetic operations after tables aggregated for the time being.
1888 1889 1890

**Availability of is no null**

L
Lin_X 已提交
1891
Is not null supports all types of columns. Non-null expression is < > "" and only applies to columns of non-numeric types.
wmmhello's avatar
wmmhello 已提交
1892 1893 1894 1895 1896 1897 1898 1899 1900 1901 1902 1903 1904 1905 1906 1907 1908 1909 1910 1911 1912 1913 1914 1915 1916 1917 1918 1919 1920 1921 1922 1923 1924 1925 1926 1927 1928 1929 1930 1931 1932 1933 1934 1935 1936 1937 1938 1939 1940 1941 1942 1943 1944 1945 1946 1947 1948 1949 1950 1951 1952 1953 1954 1955 1956 1957 1958 1959 1960 1961 1962 1963 1964 1965 1966 1967 1968 1969 1970 1971 1972 1973 1974 1975 1976 1977 1978 1979 1980

**Restrictions on order by**

- A non super table can only have one order by.
- The super table can have at most two order by expression, and the second must be ts.
- Order by tag must be the same tag as group by tag. TBNAME is as logical as tag.
- Order by ordinary column must be the same ordinary column as group by or top/bottom. If both group by and top / bottom exist, order by must be in the same column as group by.
- There are both order by and group by. The internal of the group is sorted by ts
- Order by ts.

## JSON type instructions
- Syntax description

  1. Create JSON type tag

     ```mysql
     create stable s1 (ts timestamp, v1 int) tags (info json)

     create table s1_1 using s1 tags ('{"k1": "v1"}')
     ```
  3. JSON value operator(->)

     ```mysql   
     select * from s1 where info->'k1' = 'v1'

     select info->'k1' from s1 
     ```
  4. JSON key existence operator(contains)

     ```mysql
     select * from s1 where info contains 'k2'
    
     select * from s1 where info contains 'k1'
     ```

- Supported operations

  1. In where condition,support match/nmatch/between and/like/and/or/is null/is no null,in operator is not support.

     ```mysql 
     select * from s1 where info→'k1' match 'v*'; 

     select * from s1 where info→'k1' like 'v%' and info contains 'k2';

     select * from s1 where info is null; 
  
     select * from s1 where info->'k1' is not null
     ```

  2. JSON tag is supported in group by、order by、join clause、union all and subquery,like group by json->'key'

  3. Support distinct operator.

     ```mysql 
     select distinct info→'k1' from s1
     ```

  5. Tag

     Support change JSON tag(full coverage)

     Support change the name of JSON tag

     Not support add JSON tag, delete JSON tag

- Other constraints

  1. Only tag columns can use JSON type. If JSON tag is used, there can only be one tag column.

  2. Length limit:The length of the key in JSON cannot exceed 256, and the key must be printable ASCII characters; The total length of JSON string does not exceed 4096 bytes.

  3. JSON format restrictions:

    1. JSON input string can be empty (""," ","\t" or null) or object, and cannot be nonempty string, boolean or array.
    2. Object can be {}, if the object is {}, the whole JSON string is marked as empty. The key can be "", if the key is "", the K-V pair will be ignored in the JSON string.
    3. Value can be a number (int/double) or string, bool or null, not an array. Nesting is not allowed.
    4. If two identical keys appear in the JSON string, the first one will take effect.
    5. Escape is not supported in JSON string.

  4. Null is returned when querying the key that does not exist in JSON.

  5. When JSON tag is used as the sub query result, parsing and querying the JSON string in the sub query is no longer supported in the upper level query.

     The following query is not supported:
     ```mysql 
     select jtag→'key' from (select jtag from stable)
      
     select jtag->'key' from (select jtag from stable) where jtag->'key'>0
     ```
1981
## Escape character description
1982
- Special Character Escape Sequences (since version 2.4.0.4)
1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000

  | Escape Sequence    | **Character Represented by Sequence**  |
      | :--------:     |   -------------------   |
  | `\'`             |  A single quote (') character    | 
  | `\"`             |  A double quote (") character      |
  | \n             |  A newline (linefeed) character       |
  | \r             |  A carriage return character       |
  | \t             |  A tab character       |
  | `\\`             |  A backslash (\) character        |
  | `\%`            |  A % character; see note following the table    |
  | `\_`             |  A _ character; see note following the table    |

- Escape character usage rules
  - The escape characters that in a identifier (database name, table name, column name)
    1. Normal identifier:    The wrong identifier is prompted directly, because the identifier must be numbers, letters and underscores, and cannot start with a number.
    2. Backquote`` identifier: Keep it as it is.
  - The escape characters that in a data
    3. The escape character defined above will be escaped (% and _ see the description below). If there is no matching escape character, the escape character will be ignored.
2001
    4. The `\%` and `\_` sequences are used to search for literal instances of % and _ in pattern-matching contexts where they would otherwise be interpreted as wildcard characters.If you use `\%` or `\_` outside of pattern-matching contexts, they evaluate to the strings `\%` and `\_`, not to % and _.