Commit Graph

25143 Commits

Author SHA1 Message Date
Steve Atherton 5969616af8 Merge commit '6de85e7cd8e9dd74a571de9e04679e669bcbb5b6' into client-read-options 2023-02-21 20:46:20 -08:00
A.J. Beamon 6de85e7cd8
Merge pull request #9349 from sfc-gh-jfu/split-tenant-metadata
Use separate metadata objects for management and data/standalone clusters
2023-02-21 20:35:33 -08:00
A.J. Beamon 3c67ac4efa
Don't clear the database after creating tenants 2023-02-21 15:16:18 -08:00
Jon Fu ff7174065f Merge branch 'main' of github.com:apple/foundationdb into split-tenant-metadata 2023-02-21 14:16:13 -08:00
Steve Atherton bb4fb3d81d
Merge pull request #9419 from sfc-gh-satherton/page-rebuild-fix
Optimize/fix node rebuild vs update trigger in Redwood
2023-02-21 13:49:14 -08:00
Josh Slocum 33c0b35ee6
No RK throttling on blob workers if no blob ranges (#9425) 2023-02-21 15:23:40 -06:00
Jon Fu 5edf78ddce fix fdbcli_tests 2023-02-21 13:00:57 -08:00
Markus Pilman 15d8548c0e Merge remote-tracking branch 'origin/main' into features/tenant-lock2
# Conflicts:
#	fdbserver/ApplyMetadataMutation.cpp
#	fdbserver/storageserver.actor.cpp
2023-02-21 13:39:35 -07:00
Markus Pilman 5befe6541e
Merge pull request #9430 from sfc-gh-mpilman/features/testharness-add-runtime
Add Runtime measured by TestHarness
2023-02-21 13:36:43 -07:00
Jon Fu 37fa579587 fix compile issues 2023-02-21 11:46:11 -08:00
Ata E Husain Bohra 4652eaf85d
EaR: Reduce logging level for RESTClient (#9429)
Description

Reduce the logging level to SevDebug for RESTClient operation

Testing

compiles
2023-02-21 11:43:28 -08:00
Jon Fu 2d74d10a91 use MetaclusterAPI namespace over TenantAPI for TenantState 2023-02-21 11:33:36 -08:00
Josh Slocum 958f3b531b
Plumbing blob worker mapping through commit proxy like storage server (#9401)
* Plumbing blob worker mapping through commit proxy like storage server mapping

* review comments

* formatting
2023-02-21 13:21:44 -06:00
Jon Fu c0b332501b update code to match style 2023-02-21 11:17:25 -08:00
Hui Liu 2eeb29132c
Merge pull request #9413 from sfc-gh-huliu/counters
Add stats counters for manifest dump
2023-02-21 11:13:36 -08:00
Jon Fu da688f9b77 update documentation 2023-02-21 11:13:35 -08:00
Jon Fu f27c3e24a8 fix code formatting 2023-02-21 11:09:14 -08:00
Jingyu Zhou 81f8c360db
Merge pull request #8811 from sfc-gh-tclinkenbeard/expose-tag-throttled-duration 2023-02-21 10:47:35 -08:00
Markus Pilman 5f49a17b16 Include configure string in test harness output 2023-02-21 11:45:44 -07:00
Jon Fu 9e01cffef0 fix some merge conflicts and address review comments 2023-02-21 10:29:36 -08:00
Markus Pilman 4878762af4 Add Runtime measured by TestHarness 2023-02-21 11:15:13 -07:00
Jon Fu 428eb07766 Merge branch 'main' of github.com:apple/foundationdb into split-tenant-metadata 2023-02-21 10:11:35 -08:00
Junhyun Shim 2497aa5701
Clamp GetKeyServerLocations result to tenant prefix (#9424) 2023-02-21 18:55:24 +01:00
Ankita Kejriwal bef39ffc64
Merge pull request #9084 from sfc-gh-akejriwal/fdbcli
Add fdbcli commands for checking the status of and clearing old idempotency ids
2023-02-21 08:44:46 -08:00
Junhyun Shim 06ee5f1e76
Disable client memory wipe test for all XSAN builds (#9409) 2023-02-21 14:10:44 +01:00
Steve Atherton 246fd1dd4e Remove auto cache option since there is no meaningful implementation of this yet. Change places using trState in a native Transaction to set cache mode or Low/Normal/High priority to use the new transaction options instead. 2023-02-21 02:50:30 -08:00
Steve Atherton 9bf28899d4 Add transaction option definitions for read priority and read server side cache mode. 2023-02-21 00:54:35 -08:00
Ata E Husain Bohra fa60f1b4fa
RESTClient: Initialize RESTClient connection pool instance (#9414)
Description

Patch fixes an issue where new connection for a corresponding
'connectKey' isn't getting added to the connectionPoolMap.

Testing

Standlone fdbserver triggering RESTClient connection path
2023-02-20 19:32:10 -08:00
sfc-gh-tclinkenbeard 398079db3a Merge remote-tracking branch 'origin/main' into expose-tag-throttled-duration 2023-02-20 17:54:06 -08:00
Steve Atherton a5238eaeb3
Allow fetch keys to do more work when mutation stream is infrequent and low throughput. (#9398) 2023-02-20 13:38:04 -08:00
Josh Slocum bfb3ffc509
added c and java apis for granule flush (#9412) 2023-02-20 10:28:11 -06:00
Vaidas Gasiunas 175307a590
Fix determinism in the generated bindingtester API tests (#9420)
* Reformat bindingtester api test generator with black

* Fix determinism in the generated bindingtester API tests
2023-02-20 15:58:51 +01:00
Steve Atherton e169e65021 Fix to BTree node rebuild logic - rebuild when imbalance hits a limit controlled by a new knob. 2023-02-19 16:40:28 -08:00
A.J. Beamon 487b444da9
Merge pull request #9416 from sfc-gh-ajbeamon/fix-tester-tenant-delete-bug
When clearing tenants at the end of a simulation test, reset the transaction when looping
2023-02-18 20:25:15 -08:00
Yi Wu eac757d186
EaR: cleanup encryption knobs (#9386)
Changes:
* Cleanup all encryption knobs 
* Update simulated cluster to randomly enable encryption with higher probability
2023-02-18 13:18:20 -08:00
A.J. Beamon c2ca21cdb4
Merge pull request #9417 from sfc-gh-ajbeamon/fix-restore-id-logic
Fixes to metacluster restore ID
2023-02-18 06:35:13 -08:00
A.J. Beamon 3163201201 Restore ID fixes: we weren't generating a restore ID; we weren't setting the restore ID on the management cluster in some restore modes; it is possible in some test scenarios to encounter a restore conflict, in which case we need to retry. 2023-02-17 21:20:06 -08:00
Ankita Kejriwal b74a35a986 Enable STORAGE_QUOTA_ENABLED knob by default 2023-02-17 21:14:46 -08:00
A.J. Beamon 95156198b5 When clearing tenants at the end of a simulation test, reset the transaction when looping 2023-02-17 21:13:53 -08:00
sfc-gh-tclinkenbeard 1aef6cb5f7 Merge remote-tracking branch 'origin/main' into expose-tag-throttled-duration 2023-02-17 20:41:59 -08:00
Santosh Porwal a524c563c5
Merge pull request #9411 from sfc-gh-sporwal/sanporwa_cmakelists_change
Adding support to pass custom fdb_build timestamp, required to achieve uniform naming across different builds
2023-02-17 17:22:43 -08:00
Hui Liu 323a257f1f Add stats counters for manifest dump 2023-02-17 16:22:45 -08:00
Jon Fu 8e6800663b add missing txn reset 2023-02-17 15:22:04 -08:00
Jon Fu 762cbcdc5d unconditionally set restore id 2023-02-17 14:41:41 -08:00
Jon Fu edb7a51b7e Revert "let client supply restore id"
This reverts commit 5fe32b8503.
2023-02-17 14:37:22 -08:00
Jon Fu 5fe32b8503 let client supply restore id 2023-02-17 14:01:58 -08:00
Jingyu Zhou 5d12b05090
Merge pull request #9369 from sfc-gh-ahusain/ahusain-fdbcore-3951 2023-02-17 13:11:00 -08:00
Hui Liu bdba85a86f
Merge pull request #9303 from sfc-gh-huliu/logtruncation
Truncate mutation logs after flushing blob granules
2023-02-17 12:52:45 -08:00
Yanqin Jin 07cdd34f26
Update metacluster_fdbcli_tests.py (#9406)
Update metacluster_fdbcli_tests.py

This commit has no impact on functionality.

Test plan:
- ctest -R metacluster_fdbcli_tests.py
2023-02-17 12:40:02 -08:00
Ata E Husain Bohra b3d3889328 EaR: Fix ASAN OOM failure - EncryptionOps
Description

Fix ASAN build OOM failure while running OOM error.
Patch addresses the issue by avoiding using a global arena shortening
the lifecycle of allocation per iteration. Recently test was extended
to support 'configurable encryption' codepath coverage, hence, per
iteration the memory allocation was doubled.

Testing

EncryptionOps - ASAN compatible
2023-02-17 11:49:16 -08:00