Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
taosdata
TDengine
提交
4b0a8007
T
TDengine
项目概览
taosdata
/
TDengine
12 个月 前同步成功
通知
1180
Star
22014
Fork
4786
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
1
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
T
TDengine
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
1
Issue
1
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
未验证
提交
4b0a8007
编写于
9月 07, 2022
作者:
W
wade zhang
提交者:
GitHub
9月 07, 2022
浏览文件
操作
浏览文件
下载
差异文件
Merge pull request #16592 from taosdata/test/chr/TD-14699
test: modify checkpackages scritps
上级
6c0598ec
07dd0e30
变更
4
隐藏空白更改
内联
并排
Showing
4 changed file
with
147 addition
and
94 deletion
+147
-94
packaging/MPtestJenkinsfile
packaging/MPtestJenkinsfile
+60
-45
packaging/checkPackageRuning.py
packaging/checkPackageRuning.py
+15
-8
packaging/debRpmAutoInstall.sh
packaging/debRpmAutoInstall.sh
+2
-0
packaging/testpackage.sh
packaging/testpackage.sh
+70
-41
未找到文件。
packaging/MPtestJenkinsfile
浏览文件 @
4b0a8007
...
...
@@ -5,13 +5,6 @@ def sync_source(branch_name) {
echo ''' + branch_name + '''
'''
sh '''
cd ${TDINTERNAL_ROOT_DIR}
git reset --hard
git fetch || git fetch
git checkout ''' + branch_name + ''' -f
git branch
git pull || git pull
git log | head -n 20
cd ${TDENGINE_ROOT_DIR}
git reset --hard
git fetch || git fetch
...
...
@@ -64,17 +57,12 @@ pipeline {
defaultValue:'2.1.2',
description: 'This number of baseVerison is generally not modified.Now it is 3.0.0.1'
)
string (
name:'nasPassword',
defaultValue:'password',
description: 'the pasword of the NAS server which has installPackage-192.168.1.131'
)
}
environment{
WORK_DIR = '/var/lib/jenkins/workspace'
TDINTERNAL_ROOT_DIR = '/var/lib/jenkins/workspace/TDinternal'
TDENGINE_ROOT_DIR = '/var/lib/jenkins/workspace/TDinternal/community'
BRANCH_NAME = '
3.0
'
BRANCH_NAME = '
test/chr/TD-14699
'
TD_SERVER_TAR = "TDengine-server-${version}-Linux-x64.tar.gz"
BASE_TD_SERVER_TAR = "TDengine-server-${baseVersion}-Linux-x64.tar.gz"
...
...
@@ -107,7 +95,7 @@ pipeline {
}
stages {
stage ('
RUN
') {
stage ('
Test Server
') {
parallel {
stage('ubuntu16') {
agent{label " ubuntu16 "}
...
...
@@ -116,17 +104,17 @@ pipeline {
sync_source("${BRANCH_NAME}")
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_SERVER_TAR} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server
${nasPassword}
bash testpackage.sh ${TD_SERVER_TAR} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server
python3 checkPackageRuning.py
'''
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_SERVER_LITE_TAR} ${version} ${BASE_TD_SERVER_LITE_TAR} ${baseVersion} server
${nasPassword}
bash testpackage.sh ${TD_SERVER_LITE_TAR} ${version} ${BASE_TD_SERVER_LITE_TAR} ${baseVersion} server
python3 checkPackageRuning.py
'''
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_SERVER_DEB} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server
${nasPassword}
bash testpackage.sh ${TD_SERVER_DEB} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server
python3 checkPackageRuning.py
'''
}
...
...
@@ -139,24 +127,21 @@ pipeline {
sync_source("${BRANCH_NAME}")
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_SERVER_TAR} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server ${nasPassword}
python3 checkPackageRuning.py
'''
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_SERVER_LITE_TAR} ${version} ${BASE_TD_SERVER_LITE_TAR} ${baseVersion} server ${nasPassword}
bash testpackage.sh ${TD_SERVER_TAR} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server
python3 checkPackageRuning.py
'''
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_SERVER_
DEB} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server ${nasPassword}
bash testpackage.sh ${TD_SERVER_
LITE_TAR} ${version} ${BASE_TD_SERVER_LITE_TAR} ${baseVersion} server
python3 checkPackageRuning.py
'''
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_
CLIENT_TAR} ${version} ${BASE_TD_CLIENT_TAR} ${baseVersion} client ${nasPassword}
bash testpackage.sh ${TD_
SERVER_DEB} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server
python3 checkPackageRuning.py
dpkg -r tdengine
'''
}
}
}
...
...
@@ -167,17 +152,17 @@ pipeline {
sync_source("${BRANCH_NAME}")
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_SERVER_TAR} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server
${nasPassword}
bash testpackage.sh ${TD_SERVER_TAR} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server
python3 checkPackageRuning.py
'''
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_SERVER_LITE_TAR} ${version} ${BASE_TD_SERVER_LITE_TAR} ${baseVersion} server
${nasPassword}
bash testpackage.sh ${TD_SERVER_LITE_TAR} ${version} ${BASE_TD_SERVER_LITE_TAR} ${baseVersion} server
python3 checkPackageRuning.py
'''
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_SERVER_RPM} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server
${nasPassword}
bash testpackage.sh ${TD_SERVER_RPM} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server
python3 checkPackageRuning.py
'''
}
...
...
@@ -190,28 +175,23 @@ pipeline {
sync_source("${BRANCH_NAME}")
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_SERVER_TAR} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server
${nasPassword}
bash testpackage.sh ${TD_SERVER_TAR} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server
python3 checkPackageRuning.py
'''
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_SERVER_LITE_TAR} ${version} ${BASE_TD_SERVER_LITE_TAR} ${baseVersion} server
${nasPassword}
bash testpackage.sh ${TD_SERVER_LITE_TAR} ${version} ${BASE_TD_SERVER_LITE_TAR} ${baseVersion} server
python3 checkPackageRuning.py
'''
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_SERVER_RPM} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server ${nasPassword}
python3 checkPackageRuning.py
'''
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_CLIENT_LITE_TAR} ${version} ${BASE_TD_CLIENT_LITE_TAR} ${baseVersion} client ${nasPassword}
bash testpackage.sh ${TD_SERVER_RPM} ${version} ${BASE_TD_SERVER_TAR} ${baseVersion} server
python3 checkPackageRuning.py
'''
sudo rpm -e tdengine
'''
}
}
}
}
stage('arm64') {
agent{label 'linux_arm64'}
steps {
...
...
@@ -219,18 +199,53 @@ pipeline {
sync_source("${BRANCH_NAME}")
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_SERVER_ARM_TAR} ${version} ${BASE_TD_SERVER_ARM_TAR} ${baseVersion} server
${nasPassword}
bash testpackage.sh ${TD_SERVER_ARM_TAR} ${version} ${BASE_TD_SERVER_ARM_TAR} ${baseVersion} server
python3 checkPackageRuning.py
'''
}
}
}
}
}
stage ('Test Client') {
parallel {
stage('ubuntu18') {
agent{label " ubuntu18 "}
steps {
timeout(time: 30, unit: 'MINUTES'){
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_CLIENT_
ARM_TAR} ${version} ${BASE_TD_CLIENT_ARM_TAR} ${baseVersion} client ${nasPassword}
python3 checkPackageRuning.py
'''
bash testpackage.sh ${TD_CLIENT_
TAR} ${version} ${BASE_TD_CLIENT_TAR} ${baseVersion} client
python3 checkPackageRuning.py
192.168.0.21
'''
}
}
}
stage('centos8') {
agent{label " centos8_3 "}
steps {
timeout(time: 30, unit: 'MINUTES'){
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_CLIENT_LITE_TAR} ${version} ${BASE_TD_CLIENT_LITE_TAR} ${baseVersion} client
python3 checkPackageRuning.py 192.168.0.24
'''
}
}
}
}
}
}
}
stage('arm64-client') {
agent{label " linux_arm64 "}
steps {
timeout(time: 30, unit: 'MINUTES'){
sh '''
cd ${TDENGINE_ROOT_DIR}/packaging
bash testpackage.sh ${TD_CLIENT_ARM_TAR} ${version} ${BASE_TD_CLIENT_ARM_TAR} ${baseVersion} client
python3 checkPackageRuning.py 192.168.0.21
'''
}
}
}
}
}
\ No newline at end of file
packaging/checkPackageRuning.py
浏览文件 @
4b0a8007
...
...
@@ -19,12 +19,19 @@ import subprocess
# from this import d
import
time
if
(
len
(
sys
.
argv
)
>
1
):
serverHost
=
sys
.
argv
[
1
]
else
:
serverHost
=
"localhost"
# install taospy
out
=
subprocess
.
getoutput
(
"pip3 show taospy|grep Version| awk -F ':' '{print $2}' "
)
print
(
"taospy version %s "
%
out
)
if
(
out
==
""
):
os
.
system
(
"pip install git+https://github.com/taosdata/taos-connector-python.git"
)
os
.
system
(
"pip
3
install git+https://github.com/taosdata/taos-connector-python.git"
)
print
(
"install taos python connector"
)
else
:
os
.
system
(
"pip3 install --upgrade taospy "
)
...
...
@@ -32,19 +39,19 @@ else:
# start taosd prepare
os
.
system
(
"rm -rf /var/lib/taos/*"
)
os
.
system
(
"systemctl restart taosd "
)
#
os.system("rm -rf /var/lib/taos/*")
#
os.system("systemctl restart taosd ")
# wait a moment ,at least 5 seconds
time
.
sleep
(
5
)
# prepare data by taosBenchmark
os
.
system
(
"taosBenchmark -y -n 100 -t 100
"
)
os
.
system
(
"taosBenchmark -y -n 100 -t 100
-h %s "
%
serverHost
)
import
taos
conn
=
taos
.
connect
(
host
=
"
localhost"
,
conn
=
taos
.
connect
(
host
=
"
%s"
%
serverHost
,
user
=
"root"
,
password
=
"taosdata"
,
database
=
"test"
,
...
...
@@ -80,15 +87,15 @@ os.system("rm -rf /tmp/dumpdata/*")
# dump data out
print
(
"taosdump dump out data"
)
os
.
system
(
"taosdump -o /tmp/dumpdata -D test -y
"
)
os
.
system
(
"taosdump -o /tmp/dumpdata -D test -y
-h %s "
%
serverHost
)
# drop database of test
print
(
"drop database test"
)
os
.
system
(
" taos -s ' drop database test ;'
"
)
os
.
system
(
" taos -s ' drop database test ;'
-h %s "
%
serverHost
)
# dump data in
print
(
"taosdump dump data in"
)
os
.
system
(
"taosdump -i /tmp/dumpdata -y
"
)
os
.
system
(
"taosdump -i /tmp/dumpdata -y
-h %s "
%
serverHost
)
result
=
conn
.
query
(
"SELECT count(*) from test.meters"
)
...
...
packaging/debRpmAutoInstall.sh
浏览文件 @
4b0a8007
...
...
@@ -11,3 +11,5 @@ expect "*one:"
send
"
\r
"
expect
"*skip:"
send
"
\r
"
expect eof
\ No newline at end of file
packaging/testpackage.sh
浏览文件 @
4b0a8007
...
...
@@ -68,11 +68,37 @@ fi
}
function
wgetFile
{
file
=
$1
if
[
!
-f
${
file
}
]
;
then
echoColor BD
"wget https://www.taosdata.com/assets-download/3.0/
${
file
}
"
wget https://www.taosdata.com/assets-download/3.0/
${
file
}
else
echoColor YD
"
${
file
}
already exists "
fi
}
function
newPath
{
buildPath
=
$1
if
[
!
-d
${
buildPath
}
]
;
then
echoColor BD
"mkdir -p
${
buildPath
}
"
mkdir
-p
${
buildPath
}
else
echoColor YD
"
${
buildPath
}
already exists"
fi
}
echoColor G
"===== install basesoft ====="
cmdInstall tree
cmdInstall wget
cmdInstall
sshpass
cmdInstall
expect
echoColor G
"===== Uninstall all components of TDeingne ====="
...
...
@@ -97,45 +123,28 @@ echoColor G "===== new workroom path ====="
installPath
=
"/usr/local/src/packageTest"
oriInstallPath
=
"/usr/local/src/packageTest/3.1"
if
[
!
-d
${
installPath
}
]
;
then
echoColor BD
"mkdir -p
${
installPath
}
"
mkdir
-p
${
installPath
}
else
echoColor YD
"
${
installPath
}
already exists"
fi
newPath
${
installPath
}
if
[
-d
${
installPath
}
/
${
tdPath
}
]
;
then
echoColor BD
"rm -rf
${
installPath
}
/
${
tdPath
}
/*"
rm
-rf
${
installPath
}
/
${
tdPath
}
/
*
fi
newPath
${
oriInstallPath
}
if
[
!
-d
${
oriInstallPath
}
]
;
then
echoColor BD
"mkdir -p
${
oriInstallPath
}
"
mkdir
-p
${
oriInstallPath
}
else
echoColor YD
"
${
oriInstallPath
}
already exists"
fi
if
[
-d
${
oriInstallPath
}
/
${
originTdpPath
}
]
;
then
echoColor BD
"rm -rf
${
oriInstallPath
}
/
${
originTdpPath
}
/*"
rm
-rf
${
oriInstallPath
}
/
${
originTdpPath
}
/
*
fi
if
[
-d
${
installPath
}
/
${
tdPath
}
]
;
then
echoColor BD
"rm -rf
${
installPath
}
/
${
tdPath
}
/*"
rm
-rf
${
installPath
}
/
${
tdPath
}
/
*
fi
echoColor G
"===== download installPackage ====="
# cd ${installPath}
# wget https://www.taosdata.com/assets-download/3.0/${packgeName}
# cd ${oriInstallPath}
# wget https://www.taosdata.com/assets-download/3.0/${originPackageName}
cd
${
installPath
}
&&
wgetFile
${
packgeName
}
cd
${
oriInstallPath
}
&&
wgetFile
${
originPackageName
}
cd
${
installPath
}
cp
-r
${
scriptDir
}
/debRpmAutoInstall.sh
.
if
[
!
-f
{
packgeName
}
]
;
then
echoColor BD
"sshpass -p
${
password
}
scp -oStrictHostKeyChecking=no 192.168.1.131:/nas/TDengine3/v
${
version
}
/community/
${
packgeName
}
."
sshpass
-p
${
password
}
scp
-oStrictHostKeyChecking
=
no
-oStrictHostKeyChecking
=
no 192.168.1.131:/nas/TDengine3/v
${
version
}
/community/
${
packgeName
}
.
fi
packageSuffix
=
$(
echo
${
packgeName
}
|
awk
-F
'.'
'{print $NF}'
)
...
...
@@ -181,8 +190,7 @@ elif [[ ${packgeName} =~ "tar" ]];then
cd
${
oriInstallPath
}
if
[
!
-f
{
originPackageName
}
]
;
then
echoColor YD
"download base installPackage"
echoColor BD
"sshpass -p
${
password
}
scp -oStrictHostKeyChecking=no 192.168.1.131:/nas/TDengine3/v
${
originversion
}
/community/
${
originPackageName
}
."
sshpass
-p
${
password
}
scp
-oStrictHostKeyChecking
=
no 192.168.1.131:/nas/TDengine3/v
${
originversion
}
/community/
${
originPackageName
}
.
wgetFile
${
originPackageName
}
fi
echoColor YD
"unzip the base installation package"
echoColor BD
"tar -xf
${
originPackageName
}
"
&&
tar
-xf
${
originPackageName
}
...
...
@@ -222,24 +230,45 @@ fi
cd
${
installPath
}
if
([[
${
packgeName
}
=
~
"Lite"
]]
&&
[[
${
packgeName
}
=
~
"tar"
]])
||
[[
${
packgeName
}
=
~
"client"
]]
;
then
echoColor G
"===== install taos-tools when package is lite or client ====="
cd
${
installPath
}
sshpass
-p
${
password
}
scp
-oStrictHostKeyChecking
=
no 192.168.1.131:/nas/TDengine3/v
${
version
}
/community/taosTools-2.1.2-Linux-x64.tar.gz
.
# wget https://www.taosdata.com/assets-download/3.0/taosTools-2.1.2-Linux-x64.tar.gz
tar
xf taosTools-2.1.2-Linux-x64.tar.gz
cd
taosTools-2.1.2
&&
bash install-taostools.sh
elif
[[
${
packgeName
}
=
~
"Lite"
]]
&&
[[
${
packgeName
}
=
~
"deb"
]]
;
then
if
[[
${
packgeName
}
=
~
"Lite"
]]
||
([[
${
packgeName
}
=
~
"x64"
]]
&&
[[
${
packgeName
}
=
~
"client"
]])
||
([[
${
packgeName
}
=
~
"deb"
]]
&&
[[
${
packgeName
}
=
~
"server"
]])
||
([[
${
packgeName
}
=
~
"rpm"
]]
&&
[[
${
packgeName
}
=
~
"server"
]])
;
then
echoColor G
"===== install taos-tools when package is lite or client ====="
cd
${
installPath
}
sshpass
-p
${
password
}
scp
-oStrictHostKeyChecking
=
no 192.168.1.131:/nas/TDengine3/v
${
version
}
/community/
taosTools-2.1.2-Linux-x64.tar.gz
.
wgetFile
taosTools-2.1.2-Linux-x64.tar.gz
.
tar
xf taosTools-2.1.2-Linux-x64.tar.gz
cd
taosTools-2.1.2
&&
bash install-taostools.sh
elif
[[
${
packgeName
}
=
~
"Lite"
]]
&&
[[
${
packgeName
}
=
~
"rpm"
]]
;
then
echoColor G
"===== install taos-tools
when package is lite or
client ====="
elif
([[
${
packgeName
}
=
~
"arm64"
]]
&&
[[
${
packgeName
}
=
~
"client"
]])
;
then
echoColor G
"===== install taos-tools
arm when package is arm64-
client ====="
cd
${
installPath
}
sshpass
-p
${
password
}
scp
-oStrictHostKeyChecking
=
no
-oStrictHostKeyChecking
=
no 192.168.1.131:/nas/TDengine3/v
${
version
}
/community/taosTools-2.1.2-Linux-x
64.tar.gz
.
tar
xf taosTools-2.1.2-Linux-
x
64.tar.gz
wgetFile taosTools-2.1.2-Linux-arm
64.tar.gz
.
tar
xf taosTools-2.1.2-Linux-
arm
64.tar.gz
cd
taosTools-2.1.2
&&
bash install-taostools.sh
fi
echoColor G
"===== start TDengine ====="
if
[[
${
packgeName
}
=
~
"server"
]]
;
then
echoColor BD
" rm -rf /var/lib/taos/* && systemctl restart taosd "
rm
-rf
/var/lib/taos/
*
systemctl restart taosd
fi
# if ([[ ${packgeName} =~ "Lite" ]] && [[ ${packgeName} =~ "tar" ]]) || [[ ${packgeName} =~ "client" ]] ;then
# echoColor G "===== install taos-tools when package is lite or client ====="
# cd ${installPath}
# wgetFile taosTools-2.1.2-Linux-x64.tar.gz .
# tar xf taosTools-2.1.2-Linux-x64.tar.gz
# cd taosTools-2.1.2 && bash install-taostools.sh
# elif [[ ${packgeName} =~ "Lite" ]] && [[ ${packgeName} =~ "deb" ]] ;then
# echoColor G "===== install taos-tools when package is lite or client ====="
# cd ${installPath}
# wgetFile taosTools-2.1.2-Linux-x64.tar.gz .
# tar xf taosTools-2.1.2-Linux-x64.tar.gz
# cd taosTools-2.1.2 && bash install-taostools.sh
# elif [[ ${packgeName} =~ "Lite" ]] && [[ ${packgeName} =~ "rpm" ]] ;then
# echoColor G "===== install taos-tools when package is lite or client ====="
# cd ${installPath}
# wgetFile taosTools-2.1.2-Linux-x64.tar.gz .
# tar xf taosTools-2.1.2-Linux-x64.tar.gz
# cd taosTools-2.1.2 && bash install-taostools.sh
# fi
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录