- 07 9月, 2020 1 次提交
-
-
由 xiaoxiao 提交于
* fix gpload fial when capital letters in column name in merge mode add double quotations for column names when create staging table omit distributio Co-authored-by: NXiaoxiaoHe <hxiaoxiao@vmware.com>
-
- 03 9月, 2020 1 次提交
-
-
由 xiaoxiao 提交于
fix match column condition to resovle primary key conflict when using the gpload merge mode to import data to the Multi-level partition table fix fail when special char and capital letters in column names Co-authored-by: NXiaoxiaoHe <hxiaoxiao@vmware.com>
-
- 03 8月, 2020 1 次提交
-
- 10 6月, 2020 1 次提交
-
- 04 6月, 2020 1 次提交
-
-
由 Wen Lin 提交于
-
- 21 5月, 2020 1 次提交
-
-
由 Wen Lin 提交于
while gpload is loading data if the configure file contains "error_table" and doesn't contain "preload", an error of no attribute "staging_table" or "fast_path" occurs.
-
- 24 9月, 2019 1 次提交
-
-
由 Paul Guo 提交于
* Ship modified python module subprocess32 again subprocess32 is preferred over subprocess according to python documentation. In addition we long ago modified the code to use vfork() against fork() to avoid some "Cannot allocate memory" kind of error (false alarm though - memory is actually sufficient) on gpdb product environment that is usually with memory overcommit disabled. And we compiled and shipped it also but later it was just compiled but not shipped somehow due to makefile change (maybe a regression). Let's ship it again. * Replace subprocess with our own subprocess32 in python code. Cherry-picked 9c4a885b and da724e8d and a8090c13 and 4354f28c
-
- 30 7月, 2019 1 次提交
-
-
由 Daniel Gustafsson 提交于
The installation target in gpMgmt/ blindly copied Perl programs and modules in order for the gpload test to be able to run gpdiff from PATH. This causes non-production code to be erroneously installed and required an elaborate dance to remove before packaging. This removes the installation and instead installs the required Perl code from regress as symlinks just like how other test suites are doing it. A careful observer might note that TEST_REMOTE.py still call the Perl programs from PATH, and that's Ok (for now) as it's only to be invoked via the clients package CI and that CI performs a copy step of gpdiff much like how this patch does a symlink. There are probably parts of that which can be cleaned up and simplified but for now we are focusing on the core server parts. Removing the non-defunct NON_PRODUCTION_FILES step remains as a task after this. Reviewed-by: NHeikki Linnakangas <hlinnakangas@pivotal.io> Reviewed-by: NJacob Champion <pchampion@pivotal.io> Reviewed-by: NAmil Khanzada <akhanzada@pivotal.io> (cherry picked from commit 52a9618b)
-
- 25 6月, 2019 1 次提交
-
-
由 Tingfang Bao 提交于
1) Run TEST_REMOTE.py of gpload 2) Run psql SSL, gpfdist Windows pipe testing Co-authored-by: NPeifeng Qiu <pqiu@pivotal.io> Co-authored-by: NTingfang Bao <bbao@pivotal.io> Co-authored-by: NXiaoran Wang <xiwang@pivotal.io> Co-authored-by: NXiaodong Huo <xhuo@pivotal.io>
-
- 09 5月, 2019 1 次提交
-
-
由 Peifeng Qiu 提交于
In the past several weeks, gpload test case 22 failed two times. It may report: Fatal Python error: GC object already tracked. We have reproduced this issue locally and in dev pipeline for 3 days, but it can't be reproduced. So we decide to disable it now, in order to not blocking other PRs.
-
- 29 11月, 2018 1 次提交
-
-
由 Daniel Gustafsson 提交于
While == None works for comparison, it's a wasteful operation as it performs type conversion and expansion. Instead move to using the "is" operator which is the documented best practice for Python code. Reviewed-by: Jacob Champion
-
- 14 11月, 2018 1 次提交
-
-
由 Huiliang.liu 提交于
* Add external table encoding option as condition of finding reusable table Get database default encoding if ENCODING is not set in config file. Find encoding code by encoding string and then add encoding code as one of conditions of finding reusable table.
-
- 24 7月, 2018 1 次提交
-
-
由 Huiliang.liu 提交于
- The results of fast_match SQL don't include shema name, so we need add shema name to extSchemaTable for fast_match - Remove locationStr which is unused.
-
- 23 7月, 2018 1 次提交
-
-
由 Huiliang.liu 提交于
- add fast_match option in gpload config file. If both reuse_tables and fast_match are true, gpload will try fast match external table(without checking columns). If reuse_tables is false and fast_match is true, it will print warning message.
-
- 09 5月, 2018 2 次提交
-
-
由 Jacob Champion 提交于
"False is not true" is not particularly helpful when looking at the CI. Dump the diff file as part of the assertion message.
-
由 Jacob Champion 提交于
Diff the actual against the expected, instead of the other way around, and use three lines of unified context.
-
- 26 2月, 2018 1 次提交
-
-
由 huiliang-liu 提交于
- if the data file contains "\N" as the delimiter, it would not be recognized properly by gpload - root cause: gpload replace the quote in nullas option as well as replace '\' as '\\' - solution: add quote_no_slash function to handle nullas option
-
- 19 1月, 2018 1 次提交
-
-
由 huiliang-liu 提交于
to definite the reusing external table by themselves instead of searching in gpload, which may have bad performance if there are too many external tables.
-
- 27 12月, 2017 1 次提交
-
-
由 Jialun 提交于
- Fix gpload.py, add schema prefix to every external table name when EXTERNAL.SCHEMA is set - Add new test cases
-
- 13 11月, 2017 1 次提交
-
-
由 Jialun 提交于
gpload ERROR_TABLE configuration is forbidden in GPDB5 and use LOG_ERRORS instead. That's why Informatica 9.x connector can't load data into GPDB5. So we accept ERROR_TABLE, if ERROR_TABLE is set, we will not create it as before, but set LOG_ERRORS and REUSE_TABLE to true instead.
-
- 30 10月, 2017 1 次提交
-
-
由 Jialun 提交于
gpload error count is incorrect when more than one segment has format error, for the cmdtime is different, and only errors with the newest cmdtime is counted. So we add startTime which will be used for counting all the errors occured during the same gpload operation.
-
- 25 9月, 2017 1 次提交
-
-
由 Peifeng Qiu 提交于
Concourse doesn't support AIX natively, we need to clone the repo with the correspond commit on remote machine, compile the packages, and download them back to concourse container as output. Testing client and loader for platform without gpdb server is another challenge. We setup GPDB server on concourse container just like most installcheck tests, and use SSH tunnel to forward ports from and to the remote host. This way both CL tools and GPDB server feel they are on the same machine, and the test can run normally.
-
- 01 9月, 2017 1 次提交
-
-
由 Peifeng Qiu 提交于
The original gpload test suites is intended to be run locally, so gpdb cluster and test must be on the same machine. For platform that doesn't have GPDB server available but have loader package, we need to run the test remotely.
-
- 19 6月, 2017 1 次提交
-
-
由 Ashwin Agrawal 提交于
-
- 25 5月, 2017 1 次提交
-
-
由 Jimmy Yih 提交于
For subselect_gp test, we were removing the distribution policy of a table to see if it would do a gather motion or not. Since it's technically a corrupted table, we should delete it after we're done with it. We also remove a quicklz reference that should not have been there. For gppc test, they were using the regression database. This made our gpcheckcat call at the end of ICW relatively useless since all our data would have been deleted due to gppc tests recreating the regression database. For gpload test, some generated files were previously commited. We should be actively cautious of this and remove them when we see them.
-
- 08 5月, 2017 1 次提交
-
-
由 Ning Wu 提交于
0, default database doesn't exist in some env. 1, reports good even the cases failed. 2, init_file ignores too many lines. This commit fixes these.
-
- 05 5月, 2017 1 次提交
-
-
由 Ning Wu 提交于
-
- 19 4月, 2017 1 次提交
-
-
由 Melanie Plageman 提交于
Signed-off-by: NMarbin Tan <mtan@pivotal.io>
-
- 18 4月, 2017 1 次提交
-
-
由 Ning Wu 提交于
1. fix an error if the quote and escape options are not specified in the CSV format. 2. add codes for delimiter, escape and quote options to process a ASCII, unicode-encoded or escaped single character in order to find the correct table to reuse when load external data.
-
- 10 4月, 2017 1 次提交
-
-
由 Ning Wu 提交于
The old cdbfast test suite had these, good to move to ICW.
-