Commit Graph

24540 Commits

Author SHA1 Message Date
Yi Wu 5d6ba48da0
Fix /redwood/correctness/EnforceEncodingType unit test (#9095)
The unit test intentionally cause unexpected_encoding_type being thrown, which would hit a simulation only assert failure. Disabling that assert in this case.
2023-01-06 14:13:59 -08:00
Zhe Wu a444bcdf39
Merge pull request #9100 from halfprice/zhewu/satellite-disconnection-trigger-recovery
Disconnection to satellite TLog should trigger recovery in gray failure detection
2023-01-06 14:09:54 -08:00
Ankita Kejriwal 72121204d6
Merge pull request #9057 from sfc-gh-anoyes/anoyes/idempotency-docs
Add initial documentation for automatic idempotency
2023-01-06 13:43:09 -08:00
Xiaoxi Wang 6546061a6d Merge branch 'main' of https://github.com/apple/foundationdb into feature/main/watchTenant 2023-01-06 12:42:21 -08:00
Xiaoxi Wang aa14c4529b fix canReplyWith; TenantManagementWorkload refactoring and adding watch check 2023-01-06 12:41:27 -08:00
Zhe Wu 4f7f5ec4d8 Merge remote-tracking branch 'upstream/main' into zhewu/satellite-disconnection-trigger-recovery 2023-01-06 11:28:15 -08:00
Xiaoxi Wang 92465bc7b8 Merge branch 'main' of https://github.com/apple/foundationdb into feature/main/tenantCheck 2023-01-06 10:49:11 -08:00
He Liu 33a43cde79
Fixed error type. (#9101) 2023-01-06 10:45:58 -08:00
Zhe Wu 6aaf5af75d Disconnection to satellite TLog should trigger recovery in gray failure detection 2023-01-05 22:23:02 -08:00
Xiaoxi Wang abe6a45184 add watch check in TenantManagementWorkload.actor.cpp 2023-01-05 16:51:05 -08:00
Jingyu Zhou 078d0db943 Remove dangerous label for streaming knobs
i.e., FETCH_USING_STREAMING and PEEK_USING_STREAMING
2023-01-05 15:51:48 -08:00
Xiaoxi Wang c6c34ba1d2 add sendError method to AsyncMap 2023-01-05 12:06:51 -08:00
A.J. Beamon b69bec758d Merge branch 'main' into expand-optional-erroror-map 2023-01-05 09:30:33 -08:00
Xiaoxi Wang b8391a5dfc disable tenant in DrUpgrade test 2023-01-04 23:16:49 -08:00
Xiaoxi Wang 5dadd7addd Merge branch 'main' of https://github.com/apple/foundationdb into feature/main/tenantCheck 2023-01-04 21:35:36 -08:00
Xiaoxi Wang eb6b312758 check illegal tenant access in fuzz api workload 2023-01-04 21:10:06 -08:00
Nim Wijetunga 21611761bd
Backup uses DB Config (#8941)
* add encryption db config

* address pr comments

* address pr comments

* add comments

* remove knobs from backup

* remove import

* cp uses db config

* modify simulated cluster

* remove includes

* fix tests

* fix tests

* modify comment

* add encryption enabled method

* change error to warn

* Trigger Build

* Trigger Build

* Trigger Build
2023-01-04 22:43:51 -05:00
Xiaoxi Wang e3d09a5cbd Merge branch 'main' of https://github.com/apple/foundationdb into feature/main/tenantCheck 2023-01-04 16:16:15 -08:00
Xiaoxi Wang 8266f52dea
Merge pull request #9012 from sfc-gh-xwang/feature/main/wiggleDelay
Persist accumulated wiggle delay
2023-01-04 16:14:09 -08:00
A.J. Beamon 62604bcc28 Merge branch 'main' into expand-optional-erroror-map 2023-01-04 15:46:23 -08:00
A.J. Beamon e72a1332af Use const& for functor arguments 2023-01-04 14:56:09 -08:00
Hui Liu 46d92bbf3f
Merge pull request #8984 from sfc-gh-huliu/restoretest
Add correctness test for blob restore
2023-01-04 14:43:49 -08:00
He Liu 34b3172e34
Improved SHARD_ENCODE_LOCATION_METADATA migration. (#9077)
* Improved SHARD_ENCODE_LOCATION_METADATA migration.

* Cleanup.

* Cancel itself if a data move finds a conflicting data move. Fixed
transaction reset issue.

* Cancel data move in a retry loop to avoid corrupted mutations.

Co-authored-by: He Liu <heliu@apple.com>
2023-01-04 12:57:33 -08:00
Hui Liu e3bf79cf71 Add correctness test for blob restore 2023-01-04 11:10:34 -08:00
Xiaoxi Wang fc89287ef1 add DataForDc in StorageWiggleData; rename KeyBackedConfig to KeyBackedStruct 2023-01-04 09:02:20 -08:00
dependabot[bot] b6dd94c408 Bump setuptools from 65.3.0 to 65.5.1 in /documentation/sphinx
Bumps [setuptools](https://github.com/pypa/setuptools) from 65.3.0 to 65.5.1.
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/CHANGES.rst)
- [Commits](https://github.com/pypa/setuptools/compare/v65.3.0...v65.5.1)

---
updated-dependencies:
- dependency-name: setuptools
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-01-04 10:52:10 -06:00
Jingyu Zhou 1e98e4facd
Merge pull request #9089 from jzhou77/fix
Fix use after free bug
2023-01-03 15:01:47 -08:00
sfc-gh-tclinkenbeard 1efe06da20 Move SingletonRecruitThrottler to SingletonRoles.h 2023-01-03 14:08:09 -08:00
sfc-gh-tclinkenbeard 68547a2dbd Remove dead code from ClusterController.actor.cpp 2023-01-03 14:08:09 -08:00
sfc-gh-tclinkenbeard 9e9415eff0 Move singleton role logic into its own file 2023-01-03 14:08:09 -08:00
sfc-gh-tclinkenbeard d7e8c6d7f9 Improve const-correctness in ClusterController.actor.h 2023-01-03 14:08:09 -08:00
Nim Wijetunga cd01c3a711
Blob Worker uses Encryption DB Config (#8934)
* add encryption db config

* address pr comments

* address pr comments

* add comments

* cp uses db config

* remove includes

* fix tests

* fix tests

* modify comment

* add encryption enabled method

* Blob worker uses encryption db config

* fix simulation encrypt mode choice

* Trigger Build

* address pr comments

* change comment

* formatting fixes
2023-01-03 16:56:02 -05:00
Jingyu Zhou 52a32c837f Fix use after free bug
Line 948 hit this bug where id was free'ed at line 946
946	pendingDeletionShards.pop_front();
948	physicalShards.erase(id);
2023-01-03 13:48:18 -08:00
sfc-gh-tclinkenbeard a408a90cd0 Removed unnecessary rare annotations 2023-01-03 11:17:07 -08:00
Jingyu Zhou 36d9f6fe46
Merge pull request #9063 from apple/dependabot/pip/tests/authorization/cryptography-38.0.3
Bump cryptography from 37.0.4 to 38.0.3 in /tests/authorization
2023-01-03 11:06:29 -08:00
Mohamed Oulmahdi 6472282e07 Fix Windows build broken by #8904 2023-01-03 12:45:59 -06:00
Yi Wu 17fdbc46a5
EaR: Add page checksum to Redwood pages in no-auth mode (#8965)
Previously with EaR we always enable authentication (e.g. we encrypt Redwood pages). The authentication is a form of checksum, so dedicated page checksum was not needed. This PR adds back xxhash page checksum when authentication is disabled. Also change the knob to default disable authentication.
2023-01-03 10:30:07 -08:00
Xiaoxi Wang 5de0c87654 add comments; remove unnecessary actor suffix; code format 2023-01-02 23:59:46 -08:00
Xiaoxi Wang bbcb3cc018 extract KeyBackedConfig, StorageWiggleData class; solve template resolution problem; solve MV txn and native api conflict by splitting RunTransaction file 2023-01-02 23:34:39 -08:00
Andrew Noyes f0cb73a941 Address review comments 2022-12-28 13:29:57 -08:00
Xiaoxi Wang 1e0f401ae4 Merge branch 'main' of https://github.com/apple/foundationdb into feature/main/tenantCheck 2022-12-28 09:30:24 -07:00
neethuhaneesha c9fd51d2ec
Adding rocksdb read latency metrics. (#9036) 2022-12-22 13:00:43 -08:00
Zhe Wu bcd86679c5
Merge pull request #9078 from halfprice/zhewu/fix-elaps-time-logging
fix health monitor last logged time
2022-12-22 10:14:44 -08:00
A.J. Beamon f8e2fdc6f2
Merge pull request #9080 from sfc-gh-ajbeamon/fix-ipallowlist-memcpy
Fix use of uninitialized memory in IP AllowList test
2022-12-22 10:02:17 -08:00
A.J. Beamon 0d49b26e0b Fix memcpy invocation to copy the correct number of bytes in order to avoid use of uninitialized memory in test 2022-12-22 08:46:51 -08:00
A.J. Beamon f842213bbf
Merge pull request #9079 from sfc-gh-ajbeamon/fix-cmake-error
Fix unquoted variable in cmake that cause certain builds to fail
2022-12-22 08:17:57 -08:00
Xiaoxi Wang ba43de6a87 move KeyBackedConfig to a separate file 2022-12-21 22:03:00 -08:00
Zhe Wu 2909116925 fix health monitor last logged time 2022-12-21 16:20:38 -08:00
A.J. Beamon 7ba1438d3f Fix unquoted variable in cmake that cause certain builds to fail 2022-12-21 16:20:20 -08:00
A.J. Beamon 8b5a5bb95b
Merge pull request #9075 from sfc-gh-ajbeamon/fix-remove-renamed-tenant-bug
Properly reject tenant deletion for the rename destination of a tenant
2022-12-21 14:35:41 -08:00