wbtiger
/
foundationdb
mirror of https://github.com/apple/foundationdb.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
24,972 Commits 34 Branches 312 Tags 239 MiB
Commit Graph

24972 Commits

Author SHA1 Message Date
A.J. Beamon 6a2f63029e
Merge pull request #9354 from sfc-gh-ajbeamon/disable-tenants-in-downgrade-tests 
Disable tenants in downgrade tests to versions before 7.3
 2023-02-11 12:11:46 -08:00
A.J. Beamon b4f45a0a87 Fix logic in MetaclusterManagementWorkload when retrying a tenant creation with an invalid assigned cluster 2023-02-11 12:09:17 -08:00
A.J. Beamon ee1b48323d
Merge pull request #9346 from sfc-gh-nwijetunga/nim/global-tenant-ids 
Support for Two Byte Prefix for Tenant IDs
 2023-02-11 11:31:24 -08:00
A.J. Beamon b32eebac30
Merge pull request #9241 from sfc-gh-ajbeamon/storage-quota-in-tenant-metadata-space 
Refactor storage quotas to store them in a key backed map in the tenant metadata space
 2023-02-11 10:12:46 -08:00
A.J. Beamon 69fd1addec Disable tenants in downgrade tests to versions before 7.3. For some tests, use an alternate method to disable tenants. 2023-02-11 09:58:29 -08:00
A.J. Beamon 4579a4319d Merge branch 'main' into storage-quota-in-tenant-metadata-space 2023-02-11 09:04:15 -08:00
Xiaoxi Wang a0f7943fc3 simplify implementation of lowerBoundTenantId and withinSingleTenant 2023-02-10 22:14:59 -08:00
Yi Wu a37d8f757c Redwood: fix restart test failure with xor encoding 2023-02-10 21:01:52 -08:00
Jingyu Zhou 1ea8d63a39
Merge pull request #9348 from sfc-gh-satherton/status-details-rss 
Since FDB now limits memory by RSS, report RSS in `status details` view.
 2023-02-10 19:25:33 -08:00
Nim Wijetunga 640f1afd77 address pr comments 2023-02-10 16:39:06 -08:00
Nim Wijetunga 9e5c61e127 address pr comments 2023-02-10 15:56:41 -08:00
Jingyu Zhou 814350c4e6
Merge pull request #9338 from jzhou77/fix 
Fix DD stuck when remote DC is dead
 2023-02-10 15:19:17 -08:00
Nim Wijetunga de9eef72ff address pr comments 2023-02-10 13:49:15 -08:00
Xiaoxi Wang ffc5733e9c add comments 2023-02-10 12:51:13 -08:00
Xiaoxi Wang bb8d96c026 Merge branch 'main' of https://github.com/apple/foundationdb into feature/main/clearRange 2023-02-10 12:30:16 -08:00
Xiaoxi Wang ffadea08cb change isSingleTenant check; add unit tests 2023-02-10 12:29:38 -08:00
Jingyu Zhou 5232a21005
Merge pull request #9344 from sfc-gh-akejriwal/valgrind 2023-02-10 12:04:31 -08:00
Steve Atherton df165e43ad Since FDB now limits memory by RSS, report RSS in `status details` view. 2023-02-10 11:30:29 -08:00
A.J. Beamon a6b47c1da4 Fix merge issue 2023-02-10 11:12:36 -08:00
Jingyu Zhou 622520bd2d Return the source team if remote DC is dead 
Also refactor the code with findTeamFromServers().
 2023-02-10 11:11:07 -08:00
Jingyu Zhou 9aa15b459c Clean up trace events 2023-02-10 11:11:07 -08:00
Jingyu Zhou 6c4a9b5f23 Fix DD stuck when remote DC is dead 
When remote DC is down, the remote team collection of DD can initializing
waiting for the remote to recover (all_tlog_recruited state). However, the
getTeam request can already be served by the remote team collection. So, for
a RelocateShard (data movement such as split, move), it will get a team for
the remote DC. But the data movement can't make progress on the remote team
because the remote DC hasn't recovered yet. Because of the stuck of data
movement, the primary cannot reach the "storage_recovered" state and stay in
accepting_commit state.

The specifc test failure: slow/ApiCorrectness.toml -s 339026305 -b on
at commit:  0edd899d65

In this test, primary DC has 1 SS killed, remote DC has 2 TLog and 2 SS killed.
So the remote is dead, the remaining 2 SSes can't make progress because of the
loss of 2 TLogs. The repairDeadDatacenter() can't reach the "storage_recovered"
state due to DD's failure of moving shards away from the killed SS in the
primary.

The fix is to exclude all remote in repairDeadDatacenter() so that tells DD to
mark all SSes in the remote as unhealthy. Another fix is to return empty
results for getTeam request if the remote team collection is not ready. This
will allow the data movement to continue, essentially remote team is not changed
for the data movement.
 2023-02-10 11:11:07 -08:00
A.J. Beamon 13eee09ce8 Merge branch 'main' into metacluster-mgmt-restore 2023-02-10 10:58:01 -08:00
A.J. Beamon 0e078435ab Remove unnecessary try/catch 2023-02-10 10:57:37 -08:00
A.J. Beamon 4b13c9c211 Make a few minor fixes, refactor some code for clarity, and improve throughput of repopulating a management cluster 2023-02-10 10:41:55 -08:00
Ata E Husain Bohra ce49bfb8ac
EaR: Fix RandomUnitTest (#9339) 
Description

Set `enable_configurable_encryption` knob in the unit test to make
RandomUnitTest runs happy

Testing

BlobCipherUnitTest
EncryptionOps
RandomUnitTest
 2023-02-10 10:35:08 -08:00
Nim Wijetunga f775116214 fix test 2023-02-10 02:26:32 -08:00
Nim Wijetunga 8a3f3ea674 clean up code 2023-02-10 01:01:16 -08:00
dependabot[bot] 905af6ccf8
Bump github.com/emicklei/go-restful in /fdbkubernetesmonitor (#9336) 
Bumps [github.com/emicklei/go-restful](https://github.com/emicklei/go-restful) from 2.9.5+incompatible to 2.16.0+incompatible.
- [Release notes](https://github.com/emicklei/go-restful/releases)
- [Changelog](https://github.com/emicklei/go-restful/blob/v3/CHANGES.md)
- [Commits](https://github.com/emicklei/go-restful/compare/v2.9.5...v2.16.0)

---
updated-dependencies:
- dependency-name: github.com/emicklei/go-restful
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-02-10 08:15:57 +01:00
Nim Wijetunga dd57e85064 remove traces 2023-02-09 23:05:43 -08:00
Xiaoxi Wang 09da7efdc0 handle clear range when tenantMap.size() == 0 2023-02-09 22:28:18 -08:00
Ata E Husain Bohra f30c5a13ac
EaR: Configurable Encryption feature support for BlobGranules (#9343) 
Description

Patch update BlobGranule encryption code to support Configurable
encryption semantics

Testing

BlobGranuleCorrectness* - 100K
 2023-02-09 21:13:56 -08:00
Nim Wijetunga fed650894d working version 2023-02-09 21:10:40 -08:00
Ankita Kejriwal f5a01ebac1 Add a default value for version in `WaitMetricsRequest` 2023-02-09 19:37:45 -08:00
Xiaoxi Wang 53923c77cb Merge branch 'main' of https://github.com/apple/foundationdb into fix/main/tenantList 2023-02-09 17:27:54 -08:00
Yi Wu f17024e615
Redwood: fix btree unit test reopen memory only pager (#9334) 
The Redwood btree test are not suppose to reopen the pager if it is memory only, which will open an empty pager.
 2023-02-09 17:12:50 -08:00
A.J. Beamon 788095536b Merge branch 'main' into storage-quota-in-tenant-metadata-space 2023-02-09 16:52:44 -08:00
A.J. Beamon f9a68056ac Add support for modifying a data cluster that is being restored so that we can manage conflicts 2023-02-09 15:33:40 -08:00
Nim Wijetunga b7ef50d1f8 inital commit 2023-02-09 14:32:29 -08:00
Xiaoxi Wang 76d8c1555f accept review comments 2023-02-09 14:02:57 -08:00
Hui Liu cb9d4d8bb5
Merge pull request #9276 from sfc-gh-huliu/manifest 
Split blob manifest as segments when writting
 2023-02-09 13:54:02 -08:00
Junhyun Shim 380a5aa8e8
Merge pull request #9335 from sfc-gh-jshim/fix-mako-token-reassign-after-reset 
Mako: fix token not being reassigned after every reset
 2023-02-09 22:14:39 +01:00
Xiaoxi Wang 47ac2a8fb2 fix the way verifyListFilter detect tenant state change 2023-02-09 11:34:14 -08:00
sfc-gh-tclinkenbeard 31c3365215 Increase default value for MAX_TRANSACTION_TAG_LENGTH 2023-02-09 11:31:10 -08:00
Hui Liu 6b6959d35f Split blob manifest as segments when writting 2023-02-09 11:26:19 -08:00
Jingyu Zhou 70a3b10849
Merge pull request #9326 from apple/sfc-gh-dadkins/commit-debug-monotonic 
Add timer_monotonic() to CommitDebug trace events.
 2023-02-09 08:58:21 -08:00
A.J. Beamon 2d59c5681d Bug fixes and test improvements for management cluster restoration 2023-02-09 08:42:23 -08:00
A.J. Beamon 1815254b76
Merge pull request #9333 from sfc-gh-xwang/fix/main/tenantList 
Fix list tenant name bug
 2023-02-09 08:33:23 -08:00
Josh Slocum 81c984e48a
adding encryption at rest support to local cluster and api tester (#9325) 
* adding encryption at rest support to local cluster and api tester

* adding encrypted variant of bg tenant test and renaming ear
 2023-02-09 10:23:17 -06:00
Junhyun Shim 357cec17d8 Mako: fix createNewTransation return value 
Should return token instead of tenant name
 2023-02-09 16:00:48 +01:00