Commit Graph

21038 Commits

Author SHA1 Message Date
Johannes M. Scheuermann b9afde3d4c Fix permission in Dockerfile 2022-07-05 20:02:51 -07:00
Jingyu Zhou 2d9b854a9f
Merge pull request #7527 from sbodagala/main
Microbenchmark version vector serialization/deserialization code
2022-07-05 15:04:02 -07:00
Sreenath Bodagala c366adb4b7 - Benchmark for version vector serialization/deserialization code 2022-07-05 16:37:49 +00:00
Marian Dvorsky 975978d938
Add getKey support to ApiCorrectnessWorkload (#7517)
* Add getKey support to ApiCorrectnessWorkload

* Address review comments
2022-07-05 10:16:29 +02:00
Junhyun Shim db449b80f7
Authz JWKS (#7519)
* Add JsonWebKeySet parser/stringifier

* Update header directory

* Make JWKS parser correctness clean for OpenSSL 1.x

Add RSA keygen support

* Make JWKS parser correctness clean for OpenSSL 3.x

+extend unique_ptr for scoped destruction of OpenSSL objects

* Use PKey::{sign|verify}() in TokenSign

* Apply AutoCPointer to MkCert

* Apply Clang format

* JWKS::toStringRef() returns StringRef > Optional<StringRef>

* Fix Mac/Windows build error

* Fix incorrect fix of Mac build

* Fix filename in license comment for AutoCPointer.h

* Refactor complex C macros into function templates
2022-07-05 10:13:09 +02:00
Steve Atherton c417df83f3
Merge pull request #7515 from sfc-gh-ajbeamon/more-generic-key-backed-types
Update key backed types to support multiple transaction types and different codecs
2022-07-01 14:37:02 -07:00
Markus Pilman 14f07944b3
Merge pull request #7516 from sfc-gh-jslocum/awscreds_cleanup
Cleaning up AWS creds
2022-07-01 14:51:46 -06:00
Josh Slocum 08ca0a9883
Merge pull request #7509 from sfc-gh-jslocum/cf_memory_perf
Change Feed Reading CPU optimization
2022-07-01 14:06:39 -05:00
Josh Slocum bee8fdcb97 formatting 2022-07-01 13:51:17 -05:00
Josh Slocum 236ef93324 Cleaning up AWS creds 2022-07-01 13:30:53 -05:00
Dan Lambright ea42e9f59c
Do not delay sending empty messages twice (#7462) 2022-07-01 14:22:53 -04:00
A.J. Beamon 9e659b62ee Fix idempotent spelling 2022-07-01 10:34:10 -07:00
A.J. Beamon fd568a1179 Fix some missed ReadYourWritesTransaction instances 2022-07-01 10:24:06 -07:00
A.J. Beamon 62683b4140 Update key backed types to support a templated Codec. This required updating the existing Codec to convert from objects into byte strings through tuples. 2022-07-01 10:11:02 -07:00
A.J. Beamon 1dc78a3b3f Add support for different transaction types (Reference<ITransaction>, Reference<ReadYourWritesTransaction>) to key backed types 2022-07-01 10:02:39 -07:00
Sreenath Bodagala 89a5eeb8fc
Merge pull request #7482 from sbodagala/main
Optimize out the version vector specific code (on the client) when the feature is disabled
2022-07-01 11:28:59 +05:30
Sreenath Bodagala 037c06a688 Merge remote-tracking branch 'apple-upstream/main' 2022-07-01 04:51:17 +00:00
Steven Li d4273c4dda revise prerelease pkg format 2022-06-30 18:04:38 -05:00
Josh Slocum f943efb3b1 Change Feed Reading CPU optimization 2022-06-30 15:32:41 -05:00
Josh Slocum 48bcf6eaba
parameterizing min split size instead of hardcoding it to min_shard_bytes (#7404) 2022-06-30 12:28:22 -07:00
Xiaoxi Wang e85e7794c2
Merge pull request #7501 from sfc-gh-xwang/features/ppw-pause-state
Add timeout handler for storage wiggler status fetcher
2022-06-30 11:23:29 -07:00
Jingyu Zhou d60cab788e
Merge pull request #7502 from jzhou77/main
Add pipelining for secondary queries in index prefetch
2022-06-30 10:27:29 -07:00
A.J. Beamon 76a147a104
Merge pull request #7496 from sfc-gh-ajbeamon/refactor-tenant-map-encoding
Refactor how tenant map entries are encoded and decoded
2022-06-30 09:48:38 -07:00
Marian Dvorsky 0baa76c430
Add AtomicOpsCorrectness client API workload test (#7419)
Add AtomicOpsCorrectness client API workload test
2022-06-30 18:47:16 +02:00
Jingyu Zhou 4910f69f60
Update fdbserver/storageserver.actor.cpp
Co-authored-by: Hao Fu <77984096+hfu94@users.noreply.github.com>
2022-06-30 09:19:19 -07:00
Dan Lambright 98b18e3a18
Remove code obsoleted by commit c48d5690 (#7499) 2022-06-30 12:16:23 -04:00
Jingyu Zhou 467642ac7f Remove semicolons 2022-06-30 09:12:58 -07:00
Xiaoxi Wang e69604be42 Merge branch 'main' of https://github.com/apple/foundationdb into features/ppw-pause-state 2022-06-30 09:01:29 -07:00
Xiaoxi Wang 0beaf3bb93
Merge pull request #7504 from sfc-gh-tclinkenbeard/monitor-client-rates
Make GlobalTagThrottlerTesting::monitorClientRates more lenient
2022-06-30 09:00:22 -07:00
Markus Pilman 3d529fb145
Merge pull request #7055 from sfc-gh-tclinkenbeard/remove-tpcc
Remove TPC-C workloads
2022-06-30 09:49:09 -06:00
sfc-gh-tclinkenbeard 3e542b7ab1 Make GlobalTagThrottlerTesting::monitorClientRates less strict 2022-06-30 00:59:26 -07:00
Mohamed Oulmahdi 958b1faf81
Merge pull request #7498 from apple/7477
7477 - Fix Windows build
2022-06-30 09:54:37 +02:00
Xiaoxi Wang 801c1e8be2 Schema fix 2022-06-29 23:07:04 -07:00
Xiaoxi Wang b51e9430a5 fix timeout buggify 2022-06-29 22:46:50 -07:00
sfc-gh-tclinkenbeard 72f5335460 Remove TPCC workloads 2022-06-29 22:31:56 -07:00
Jingyu Zhou 842004f3b3 Code clean-up 2022-06-29 21:29:41 -07:00
Jingyu Zhou ba5e2ed72d Add batching for secondary queries in index prefetch
This is to reduce excessive load being issued concurrently, controlled by knob
MAX_PARALLEL_QUICK_GET_VALUE.
2022-06-29 21:17:11 -07:00
Xiaoxi Wang 1b0780398f Merge branch 'main' of https://github.com/apple/foundationdb into features/ppw-pause-state 2022-06-29 21:03:47 -07:00
Jingyu Zhou da26a4c373 Issue secondary query in parallel for GetMappedKeyValues
In case the subquery is a local miss, it becomes a remote call. Then such an
optimization can significantly reduce latency.
2022-06-29 17:45:10 -07:00
Markus Pilman 3576eae9bc
Merge pull request #7500 from sfc-gh-mpilman/bugfixes/separate-rapidxml
move rapidxml to its own target
2022-06-29 18:20:20 -06:00
Mohamed Oulmahdi bf7f9dca9f Empty 2022-06-30 01:52:25 +02:00
Xiaoxi Wang 570dfd6760 add timeout handler 2022-06-29 15:30:37 -07:00
Mohamed Oulmahdi 6fcbf5784c Formatting 2022-06-30 00:10:47 +02:00
Markus Pilman 8123070c2a move rapidxml to its own target 2022-06-29 16:10:14 -06:00
Mohamed Oulmahdi 7af9b2fae3 Enhance TOML dependencies 2022-06-29 23:45:28 +02:00
Mohamed Oulmahdi a5cf6f38f3 Add missing Windows crc32 headers 2022-06-29 23:44:33 +02:00
Mohamed Oulmahdi 954c590944 Add missing dependencies for fdbservice 2022-06-29 23:43:38 +02:00
Yi Wu 364644673f
Support TLog encryption in commit proxy (#6942)
This PR add support for TLog encryption through commit proxy. The encryption is done on per-mutation basis. As CP writes mutations to TLog, it inserts encryption header alongside encrypted mutations. Storage server (and other consumers of TLog such as storage cache and backup worker) decrypts the mutations as they peek TLog.
2022-06-29 14:21:05 -07:00
Xiaoxi Wang c9366f8b01
Merge pull request #7491 from sfc-gh-xwang/bug/remotekv
Make g_simulator.datacenterDead() don't take spawn KV process into account
2022-06-29 11:43:27 -07:00
Chaoguang Lin 29f98f3654
Avoid duplicate snapshot on one process if it serves as multiple roles (#7294)
* Fix comments

* Add simulation value for SERVER_KNOBS->SNAP_CREATE_MAX_TIMEOUT

* A work version with correctness clean

* Remove unnecessay comments; debugging symbols

* Only check secondary address for coordinators, same as before

* Change the trace to SevError and remove the ASSERT(false)

* Remove TLogSnapRequest handling on TlogServer, which is changed to use WorkerSnapRequest

* Add retry for network failures

* Add retry limit for network failures; still allow duplicate snapshots on processes are both tlog and storage to avoid race

* Add retry limit as a knob and make backoff exponentail

* Add getDatabaseConfiguration(Transaction* tr)

* revert back to send request for each role once

* update some comments
2022-06-29 11:23:07 -07:00