Commit Graph

20009 Commits

Author SHA1 Message Date
Chaoguang Lin 9f110b0f51 Update documentations and comments 2022-04-21 10:19:44 -07:00
Chaoguang Lin 6bfa4f6ac4 Fix typos; Polish documentations according to comments 2022-04-19 13:57:11 -07:00
Chaoguang Lin 36c876b769 Fix a typo; Fix a format error in special-keys.rst 2022-04-18 18:10:17 -07:00
Chaoguang Lin 4af36fa9ea Update documentations 2022-04-18 17:59:28 -07:00
Chaoguang Lin c0264a8522 Remove the client profiling special keys and update related documentations 2022-04-18 17:54:50 -07:00
Lukas Joswiak 07d11ec2e1 Fix failing upgrades due to non-persisted initial cluster version 2022-04-18 10:59:17 -07:00
Markus Pilman 3cbba4bea4
Don't test requests that don't initialize properly (#6880)
* Don't test requests that don't initialize properly

Some request objects don't initialize their members
properly when being constructed using the default
constructor. This makes valgrind unhappy. Don't test
these endpoints for now.

* fixed code formatting
2022-04-18 10:44:56 -07:00
Jingyu Zhou 17dc1a61f3 ClientDBInfo may be unintentionally not set
The ClientDBInfo's comparison is through an internal UID and shrinkProxyList()
can change proxies inside ClientDBInfo. Since the UID is not changed by that
function, subsequent set can be unintentionally skipped.

This was not a big issue before. However, VV introduces a change that the
client side compares the returned proxy ID with its known set of GRV proxies
and will retry GRV if the returned proxy ID is not in the set. Due the above
bug, GRV returned by a proxy is not within the client set, and results in
indefinite retrying GRVs.
2022-04-18 09:09:14 -07:00
Markus Pilman 1f26943099
Merge pull request #6859 from sfc-gh-ajbeamon/check-tenant-clear-range
When clearing the database between tests, check that the normal key-space is empty
2022-04-16 11:24:41 -06:00
A.J. Beamon 6151f9c858
Merge pull request #6873 from sfc-gh-ajbeamon/tenant-test-fix
The tenant deletion test now deletes multiple tenants concurrently rather than serially
2022-04-15 14:29:47 -07:00
Jingyu Zhou 0a03b190da Fix multiple PeekStream requests to log routers
There is a bug in how a log router handles streaming read:
* Log router has a `logRouterPeekStream` actor A running.
* Remote tlog detects some problem and starts another streaming connection (maybe just reuse the connection?)
* Log router now has a new `logRouterPeekStream` actor B running.
* B runs and found that popped version > reqBegin, so `LogRouterPeekPopped` . This is because A is still running and changed the popped version.
* A ends with `TLogPeekStreamEnd operation_obsolete`
* B become stuck at `wait(req.reply.onReady() && store(reply.rep, future)`, because the future was sent `Never()`.

As a result, the remote tlog can no longer retrieve data from this log router.

Fix by killing the `logRouterPeekStream` B.
2022-04-15 14:11:52 -07:00
Vaidas Gasiunas eb436ec14b
Merge pull request #6868 from sfc-gh-vgasiunas/vgasiunas-disable-upgrade-tests-sanitizer
Disable upgrade tests in sanitizer builds
2022-04-15 22:55:15 +02:00
A.J. Beamon e2222355dc The tenant deletion test now deletes multiple tenants concurrently rather than serially. Fix some variable shadowing in the delete test. 2022-04-15 13:17:19 -07:00
neethuhaneesha 5ffd9e0172
Merge pull request #6867 from neethuhaneesha/rocksdb-aggrProperty
RocksDb using aggr property metrics for pendingCompactionBytes.
2022-04-15 11:02:29 -07:00
Vaidas Gasiunas 5abdb1e655 Upgrade Tests: Disable upgrade tests in sanitizer builds 2022-04-15 16:33:48 +02:00
Neethu Haneesha Bingi 6543bce8ae RocksDb using aggr property metrics for pendingCompactionBytes. 2022-04-14 18:08:42 -07:00
Andrew Noyes 29cf5f1fbf
Fix an ASSERT when an fdbcli command times out (#6857)
* Re-throw operation_cancelled

There's a few places in fdbcli where we don't rethrow operation
cancelled but wait on a future. It's very unusual that you don't want to
rethrow operation_cancelled.

* Update ASSERT

It's possible to get error_code_broken_promise here if the network has
already shutdown.
2022-04-14 12:09:25 -07:00
A.J. Beamon cf5d3c83a1 Fix formatting issues. 2022-04-14 12:03:39 -07:00
A.J. Beamon 19d78cf2a3 When clearing the database between tests, check that clearing the tenant left the entire normal key-space empty. Update the configuration of some tests. Disable a special key-space test that is invoking broken behavior. 2022-04-14 11:39:02 -07:00
A.J. Beamon 218ab6377c
Merge pull request #6651 from sfc-gh-vgasiunas/vgasiunas-upgrade-test
Automated end-to-end upgrade tests
2022-04-14 09:36:52 -07:00
Vaidas Gasiunas 0a6b74ad3f Upgrade Tests: Remove 6.2 from regression testing, because of sporadic failures 2022-04-14 14:30:55 +02:00
Markus Pilman 3598c6b56b
Merge pull request #6675 from sfc-gh-jshim/tenant-token-sign
Sign and verify auth tokens for multi-tenant FDB
2022-04-13 16:55:20 -06:00
Zhe Wang 2f75a4bd78
Use actor collection for rocksdb histogram actors. (#6805)
Co-authored-by: Zhe Wang <zhewang@Zhes-MacBook-Pro.local>
2022-04-13 14:41:54 -07:00
Junhyun Shim edc659d339 Use camelCase & move error code to 6xxx 2022-04-13 21:11:52 +02:00
Junhyun Shim b6a0c0f942 Merge remote-tracking branch 'upstream/main' into tenant-token-sign 2022-04-13 19:55:37 +02:00
Jingyu Zhou 71acfd5a7e Fix provisional GRV Proxy ID in GetReadVersionReply
This was not set and can cause infinite loop in simulation where the client
calls getConsistentReadVersion(), in which we do "continue" for stale GRV reply
and retry. Then this repeats forever.
2022-04-13 10:35:10 -07:00
Vaidas Gasiunas a03ba928e4 Upgrade Tests: Introduce transaction retry limit; Trace long retry chains; An option to run the test binary with gdb 2022-04-13 16:50:02 +02:00
Vaidas Gasiunas 871cdece0e Merge remote-tracking branch 'apple/main' into vgasiunas-upgrade-test 2022-04-13 14:17:46 +02:00
Vaidas Gasiunas f7636ecf3b Upgrade Tests: Addressing review comments 2022-04-13 14:17:23 +02:00
Ray Jenkins 327c1da0a0 Remove to_7.2.0 tests from CMakeLists.txt 2022-04-12 17:06:18 -07:00
Ray Jenkins f07fa29105 move ConfigureStorageMigrationTestRestarts to to_7.1.0 directory and remove to_7.2.0 2022-04-12 17:06:18 -07:00
Ray Jenkins 3f61f869e6 fix to_7.x tests 2022-04-12 17:06:18 -07:00
Lukas Joswiak 0783b044fe Add protocol feature 2022-04-12 14:35:09 -07:00
Lukas Joswiak 08a8eb2b37 Check for viable version before deserializing 2022-04-12 14:35:09 -07:00
FoundationDB CI 6fb84adc67
update version after 7.1.0 release 2022-04-12 19:55:58 +00:00
Sreenath Bodagala e902ac543a
Merge pull request #6829 from sbodagala/main
Version vector encoding
2022-04-12 14:19:31 -04:00
Vaidas Gasiunas 9e46128b6f Upgrade Test: Include only currently working tests into the ctest suite 2022-04-12 20:03:29 +02:00
Vaidas Gasiunas 1e2541f1db Upgrade Tests: Log long waits on futures 2022-04-12 19:44:06 +02:00
Vaidas Gasiunas 73ed1c6e97 Upgrade Tests: update for 7.2 2022-04-12 14:06:20 +02:00
Vaidas Gasiunas 580010e64c Merge remote-tracking branch 'apple/main' into vgasiunas-upgrade-test 2022-04-12 13:43:36 +02:00
Aaron Molitor 1328c34323 update version to 7.2.0 -- address pr comments 2022-04-11 23:23:27 -05:00
Aaron Molitor 5ba8b82ba6 update version to 7.2.0 -- address pr comments 2022-04-11 23:23:27 -05:00
Aaron Molitor 6b2d0e5d6b update version to 7.2.0 -- protocol version 2022-04-11 23:23:27 -05:00
Aaron Molitor 63a2e317fb update version to 7.2.0 -- pr comment 2022-04-11 23:23:27 -05:00
Aaron Molitor c440365779 update version to 7.2.0 -- pr comment protocol version 2022-04-11 23:23:27 -05:00
Aaron Molitor f49b761d14 update version to 7.2.0 -- pr comment 2022-04-11 23:23:27 -05:00
Aaron Molitor 8db8545db2 update version to 7.2.0 -- protocol version changes 2022-04-11 23:23:27 -05:00
Aaron Molitor cbaef8f03b update version to 7.2.0 2022-04-11 23:23:27 -05:00
Johannes M. Scheuermann dca18ac71e Add support for the reboot command in go bindings 2022-04-11 14:56:18 -07:00
Sreenath Bodagala cb3add17b8 - Encode version vector before sending it over the wire.
Encoding methods used:

  - Tag localities: Run length encoding
  - Tag ids: Compact representation
  - Commit versions: delta encoding.

  If "n" is the number of entries in the version vector, with the tags
  spread over "m" data centers, these techniques will reduce the number
  of bytes to represent the version vector from "(11 * n)" bytes to
  "(3 * m + 2 * n)" / "(3 * m + 3 * n)" bytes (depending on the max tag
  id value, and ignoring some constants) in the best case.
2022-04-11 21:03:09 +00:00