Commit Graph

22048 Commits

Author SHA1 Message Date
Xiaoxi Wang 85916e26f4 remove pqCanCheck because it's unnecessary 2022-08-09 10:28:02 -07:00
A.J. Beamon 9abb1095f0 Changes needed on the server-side or to data stored in the database in preparation for the metacluster 2022-08-09 10:12:26 -07:00
Nim Wijetunga 25880d5907 format code 2022-08-09 10:04:30 -07:00
Nim Wijetunga 09a106c847 make function inline 2022-08-09 09:57:02 -07:00
Hui Liu 79423ef546 fdbcli: add more info to blob worker status 2022-08-09 09:38:07 -07:00
Vaidas Gasiunas d0905704c9
Disable shim library tests in sanitizer builds (#7821) 2022-08-09 11:27:52 +02:00
Chaoguang Lin 15523ff2e6
Extend url support for azure blob backup (#7776)
* Change to old url format azure://<endpoint>/<account>/<container>/

* Remove unnecessary dependency

* Add cmake_minimum_required  for azure backup cmake file

* Add the comments for new supported urls

* Add the host name resolution logic

* format files

* refactor part of the code

* Add documentation about Azure backup testing

* Add more comments, update the doc
2022-08-09 01:37:24 -07:00
Xiaoxi Wang 97f654adbb disable default constructor of RelocateShard 2022-08-08 22:18:48 -07:00
Nim Wijetunga 6d0b20b07a Merge branch 'main' of github.com:sfc-gh-nwijetunga/foundationdb into nim/refactor-encryption-flag
* 'main' of github.com:sfc-gh-nwijetunga/foundationdb: (32 commits)
  Store rocksdb::DBOptions and rocksdb::ColumnFamilyOptions to (#7766)
  Update CONTRIBUTING.md
  Update tests/rare/SpecificUnitTests.toml
  fix ASAN OOM problem
  Update CONTRIBUTING.md
  Write tracing and ALP special key errors as JSON
  Fix: the static tenant map in the Java tester was being accessed concurrently from multiple threads. Make it a concurrent map. (#7805)
  Run clang-format
  Print SIGNAL output to stdout
  Print to stderr only upon errors
  Testing upgrades to a future version of FDB (#7780)
  Flush gcov coverage upon SIGTERM
  Report the unit tests being run in test harness
  Fix a bug in a storage wiggler unit test where some servers were added with too recent a timestamp
  Fix undefined behavior in versioned btree test due to integer overflow
  When a transaction operation gets an unknown tenant error, it needs to reset the tenant ID so it can be updated in the next tenant lookup request.
  Don't buggify max tenants per cluster globally; instead buggify it in specific tests
  Remove non-existing unittest
  Add unit tests to the correctness package
  Add comment to INetwork
  ...
2022-08-08 22:07:05 -07:00
Xiaoxi Wang d5a101a1eb remove RelocateShard::INVALID; add priority uniqueness check 2022-08-08 21:44:45 -07:00
Xiaoxi Wang 384ee1ee6e fix build warning 2022-08-08 21:29:54 -07:00
Jingyu Zhou a907c444a0
Merge pull request #7819 from jzhou77/main
Add knobs for min/max Ratekeeper limit
2022-08-08 21:02:44 -07:00
Xiaoxi Wang 769b503d17 fix RelocateShard invalid initialized bug (remove RelocationReason::INVALID 2022-08-08 20:43:35 -07:00
A.J. Beamon e84fecf392
Merge pull request #7796 from sfc-gh-ajbeamon/decommission-cleanup-global-state
Fix: Decommissioning a metacluster could fail if some global state fields were set
2022-08-08 18:12:50 -07:00
A.J. Beamon 15939dbf2b
Merge pull request #7774 from sfc-gh-ajbeamon/detect-invalid-special-keys-errors
Add checking for invalid special keys errors in simulation
2022-08-08 18:12:38 -07:00
Jingyu Zhou eba77d78f4 Add knobs for min/max Ratekeeper limit
The default has no effects.
2022-08-08 15:27:21 -07:00
Jingyu Zhou dbedd06d4b
Merge pull request #7817 from Arjun-Sharda-Contribution-Forks/patch-1
docs(CONTRIBUTING.md) Update wording
2022-08-08 14:33:31 -07:00
Xiaoxi Wang 6ee0db4932
Merge pull request #7818 from sfc-gh-xwang/fix/main/AsanOOM
fix ASAN OOM problem in ResumeFromShard unit test
2022-08-08 14:27:02 -07:00
He Liu a2dc4e20e9
Store rocksdb::DBOptions and rocksdb::ColumnFamilyOptions to (#7766)
* Store rocksdb::DBOptions and rocksdb::ColumnFamilyOptions to
SharedRocksDBState.

* Make KeyValueStoreRocksDBTest.toml `UNIT`.

* Added TEST_STORAGE_ENGINE_TYPE

* Added readOptions.
2022-08-08 13:38:02 -07:00
Arjun Sharda 45c03686ca
Update CONTRIBUTING.md 2022-08-08 15:28:06 -05:00
Xiaoxi Wang ed91ddf5af
Update tests/rare/SpecificUnitTests.toml 2022-08-08 12:57:07 -07:00
A.J. Beamon b0655d9292 Add checking for invalid special keys errors in simulation 2022-08-08 12:47:56 -07:00
A.J. Beamon 1569f033c8 Reduce the number of extra databases to prevent using too many files 2022-08-08 12:47:35 -07:00
A.J. Beamon 91ccb82605 Fix: Decommissioning a metacluster could fail if some global state fields were set in the metacluster. Update the metacluster management workload to decommission the metacluster at the end. 2022-08-08 12:47:35 -07:00
Xiaoxi Wang 55c47c74e0 fix ASAN OOM problem 2022-08-08 12:46:51 -07:00
Arjun Sharda 6a26625a40
Update CONTRIBUTING.md 2022-08-08 14:35:47 -05:00
Nim Wijetunga c63b30f698 address pr comments 2022-08-08 11:32:49 -07:00
Markus Pilman 86ee76ec50
Merge pull request #7816 from sfc-gh-mdvorsky/mdvorsky/coverage
Flush gcov coverage upon SIGTERM
2022-08-08 12:03:22 -06:00
Nim Wijetunga 30c985e6d2 format 2022-08-08 11:02:59 -07:00
Nim Wijetunga f112022e66 fix pr issues 2022-08-08 10:48:22 -07:00
Lukas Joswiak a4c4eadffc Write tracing and ALP special key errors as JSON 2022-08-08 10:31:10 -07:00
Markus Pilman c9865809e0
Merge pull request #7786 from sfc-gh-mdvorsky/mdvorsky/net2_unittest
Add Net2 unittests for ThreadSafeQueue and Net2::onMainThread
2022-08-08 11:23:31 -06:00
Markus Pilman 828d15907e
Merge pull request #7798 from sfc-gh-mdvorsky/mdvorsky/unittests_in_joshua
Add unit tests to the correctness package
2022-08-08 11:23:22 -06:00
A.J. Beamon 351656af6a
Fix: the static tenant map in the Java tester was being accessed concurrently from multiple threads. Make it a concurrent map. (#7805) 2022-08-08 10:19:43 -07:00
Andrew Noyes 3ba2cd2fc9 Sort unit tests before selecting random unit test
This makes it so that the selected unit test does not depend on static
initialization order
2022-08-08 10:06:34 -07:00
Andrew Noyes 2002ebf6ef Track resident memory usage in test harness
We switched to limiting based on resident memory usage, so track that
instead.
2022-08-08 10:05:39 -07:00
Andrew Noyes 2e9f5f138d Sort test files before picking one based on JOSHUA_SEED
Previously it was dependent on whatever order files were listed in a
directory, which is suboptimal.
2022-08-08 10:05:39 -07:00
Xiaoxi Wang 2b2bc12cc1 Update Document; set log limit 2022-08-08 10:04:48 -07:00
Marian Dvorsky e268ae9a86 Run clang-format 2022-08-08 18:48:15 +02:00
Jingyu Zhou 8fa7c4c823
Merge pull request #7737 from Arjun-Sharda-Contribution-Forks/patch-1
docs(pull_request_template) Update pull_request_template.md
2022-08-08 09:47:37 -07:00
Markus Pilman 02b69e3c66
Merge pull request #7806 from sfc-gh-ajbeamon/fix-unknown-tenant-handling
When a transaction operation gets an unknown tenant error, it needs to reset the tenantID
2022-08-08 10:33:10 -06:00
Markus Pilman 956326dd5f
Merge pull request #7804 from sfc-gh-ajbeamon/move-max-tenants-buggify
Don't buggify max tenants per cluster globally; instead buggify it in specific tests
2022-08-08 10:32:02 -06:00
Marian Dvorsky b8370e5129 Print SIGNAL output to stdout 2022-08-08 18:28:11 +02:00
Jingyu Zhou 0a91b5e46e
Merge pull request #7807 from sfc-gh-ajbeamon/fix-versionedbtree-test-ub
Fix undefined behavior in versioned btree test due to integer overflow
2022-08-08 09:27:47 -07:00
Jingyu Zhou 98c4c22d92
Merge pull request #7809 from sfc-gh-ajbeamon/test-harness-report-unit-tests
Report the unit tests being run in test harness's summarized output
2022-08-08 09:26:05 -07:00
Marian Dvorsky 77269d0506 Print to stderr only upon errors 2022-08-08 18:11:35 +02:00
Vaidas Gasiunas 79571dd2b4
Testing upgrades to a future version of FDB (#7780)
* Enable configuring the next future protocol version as the current protocol version in FDB client, fdbserver, and fdbcli

* Auto format python files used in upgrade tests

* Add a test for upgrading to a future FDB version

* Emphasize that the options for using future protocol version are intended for test purposes only

* Make the global variable for current protocol version visible only locally

* Refactirng to avoid using currentProtocolVersion() in static intialization

* Update go bindings
2022-08-08 17:29:49 +02:00
Marian Dvorsky 722f66beb7 Flush gcov coverage upon SIGTERM 2022-08-08 17:11:20 +02:00
Xiaoxi Wang 24e50edd87
Merge pull request #7808 from sfc-gh-ajbeamon/fix-wiggler-unit-test
Fix a bug in a storage wiggler unit test where some servers were added with too recent a timestamp
2022-08-07 21:25:33 -07:00
A.J. Beamon b42cb48dd4 Report the unit tests being run in test harness 2022-08-07 07:37:29 -07:00