wbtiger
/
foundationdb
mirror of https://github.com/apple/foundationdb.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
21,748 Commits 34 Branches 304 Tags 265 MiB
Commit Graph

21748 Commits

Author SHA1 Message Date
Xiaoxi Wang 3c76ad9e72 move waitForMost into generic actors 2022-08-02 10:38:11 -07:00
Josh Slocum 4b66645d80
Granule file performance benchmark and improvements (#7742) 
* added cpu microbenchmark for blob granule files

* Added edge case read benchmarks, and sorting memory deltas

* Sorted merge for granule files

* key block comparison optimization in granule files

* More performance improvements to granule file read

* fixing zlib not supported build

* fixing formatting

* Added debug macro for new debugging prints

* review comments

* more strict compression size validation assert
 2022-08-02 11:36:44 -05:00
Josh Slocum b1ff8b8340
Merge pull request #7753 from sfc-gh-jslocum/cf_op_chaos 
Add Chaos to Change Feed Operations test
 2022-08-02 09:04:38 -05:00
Josh Slocum 7b9a9c0176
Merge pull request #7752 from sfc-gh-jslocum/rearrange_granule_tests 
disable movekeys granule test and shift other granule tests around
 2022-08-02 09:03:36 -05:00
A.J. Beamon daa7d3ae72 Remove unused variable 2022-08-02 05:50:58 -07:00
Hao Fu 9db19b9a7c
Retain debug id in prefetch server-server call (#7754) 2022-08-01 19:46:45 -07:00
Xiaoge Su fd3c3f0774 fixup! Reformat source 2022-08-01 18:56:50 -07:00
Xiaoge Su 195890dd7b Add ratekeeper ID for storage server busiest write tag report 2022-08-01 18:56:50 -07:00
Xiaoge Su ca482784d4 Empty commit, retrigger tests 2022-08-01 18:56:50 -07:00
Xiaoge Su aa69f5f36e fixup! Update per code review 2022-08-01 18:56:50 -07:00
Xiaoge Su 75b69d7774 fixup! gcc build error 2022-08-01 18:56:50 -07:00
Xiaoge Su ead1aa5bc1 fixup! Remove C++20 attribute 2022-08-01 18:56:50 -07:00
Xiaoge Su 90b887f394 fixup! Update per comments 2022-08-01 18:56:50 -07:00
Xiaoge Su ec40c6bfec fixup! Add a wrapper of ResourceWeakRef for better support of self pointer 2022-08-01 18:56:50 -07:00
Xiaoge Su 1ab8d388af fixup! Reformat source 2022-08-01 18:56:50 -07:00
Xiaoge Su 2ce456bd3f fixup! Fix minor issues 
* Reintroduce the anonymous namespace deleted by accident
 * Rename the guardian definition in OwningResource.h
 2022-08-01 18:56:50 -07:00
Xiaoge Su bc9d2e8cbe fixup! Fix per upstream change 2022-08-01 18:56:50 -07:00
Xiaoge Su cf04afe925 fixup! Non-owning reference to an object 
See documents in flow/OwningResource.h
 2022-08-01 18:56:50 -07:00
Xiaoge Su 26877a8924 fixup! Remove the boost/bind.hpp in TLSTest.cpp 
Not used, and causes gcc emit warning
 2022-08-01 18:56:50 -07:00
Xiaoge Su 542b5e61cf Let the storage server reports busiest write tag 
Issue #7258

The ratekeeper is recording the busiest write tag for *all* storage
servers, which throttles the traceevent. Distribute the busiest write
tag to corresponding storage servers should reduces this throttling
issue.
 2022-08-01 18:56:50 -07:00
Ata E Husain Bohra ef6012c1d1
Encrypt BlobGranule delta files (#7735) 
* Encrypt  BlobGranule delta files

Description

 diff-1: Address review comments

Major changes proposed by the patch are:
1. Refactor code to allow caching of 'encryption key ctx' as part of
BlobFilePointerRef. The refactoring allows snapshot and/or delta files
to store their own file encryption context.
2. Enable BlobGranule delta file encryption/decryption semantics.

Testing

BlobGranuleCorrrectness  
BlobGranuleCorrectnessClean
BlobGranuleFileUnitTestToml

Description

Testing
 2022-08-01 16:34:44 -07:00
Josh Slocum c5c423f2b7 Disabling update/clear post-stop for now in change feed ops 2022-08-01 17:42:32 -05:00
A.J. Beamon 1b693a588a Merge branch 'main' into feature-metacluster 2022-08-01 14:43:14 -07:00
A.J. Beamon 953bc4252d Add a metacluster consistency check class and use it in various tenant/metacluster workloads 2022-08-01 14:41:46 -07:00
A.J. Beamon d9df813ce4 Fix a few metacluster accounting bugs 2022-08-01 14:34:21 -07:00
Josh Slocum 83806b4a31 disable movekeys granule test and shift other granule tests around 2022-08-01 14:48:38 -05:00
Renxuan Wang 51b92d59b9
Merge pull request #7733 from RenxuanW/hostname-backup 
Prefer IPv6 in hostname resolving.
 2022-08-01 12:34:02 -07:00
Renxuan Wang 4a0bea2230 Document for pickOneAddress(). 2022-08-01 10:54:04 -07:00
Markus Pilman 9caece6fc2
Merge pull request #7743 from sfc-gh-ajbeamon/fix-dummy-transaction 
Fix: Transactions could change tenant ID part way through
 2022-08-01 11:28:32 -06:00
Markus Pilman 204ef3a933
Merge pull request #7734 from sfc-gh-anoyes/anoyes/require-python3 
Disallow python2 for cmake scripts
 2022-07-31 22:18:56 -06:00
A.J. Beamon 41f519c300 Erase the cluster capacity index entry for a cluster when that cluster is removed 2022-07-30 20:32:43 -07:00
A.J. Beamon ad52c575a8 Merge branch 'main' into feature-metacluster 2022-07-30 18:33:19 -07:00
A.J. Beamon ea76eb2beb Transactions could change tenant ID part way through. The dummy transaction could set a new tenant ID but use the old tenant prefix. 2022-07-30 16:16:18 -07:00
A.J. Beamon eeefb12f14
Merge pull request #7744 from sfc-gh-ajbeamon/fix-token-unit-test 
Fix bug in token cache unit test where the expiration time was underflowing
 2022-07-30 15:40:14 -07:00
A.J. Beamon 5a071e1b19 Fix bug in token cache unit test where the expiration time was underflowing. 2022-07-30 14:22:24 -07:00
A.J. Beamon 9ded40b6e1 The metacluster management test should disallow creating any tenants in general workload setup. 2022-07-30 13:09:30 -07:00
A.J. Beamon fc92774b2b Fix: cleanup the metadata for a tenant creation that is permanently failed and is being replaced. 2022-07-30 11:08:11 -07:00
A.J. Beamon 8e50fe0cfc Fix a couple test bugs 2022-07-29 21:54:41 -07:00
Xiaoxi Wang 85f2200d6b
Merge pull request #7741 from sfc-gh-xwang/refactor/main/enableState 
create ShardsAffectedByTeamFailure.h
 2022-07-29 16:20:08 -07:00
A.J. Beamon 0d264f2731 Fix up a few things from review 2022-07-29 15:33:09 -07:00
Xiaoxi Wang dd902fc772 create ShardsAffectedByTeamFailure.h 2022-07-29 15:12:15 -07:00
A.J. Beamon 296f17e3e5 Merge branch 'main' into feature-metacluster 2022-07-29 15:06:48 -07:00
Andrew Noyes 1558edce8c Python_EXECUTABLE to Python3_EXECUTABLE 2022-07-29 14:57:29 -07:00
Andrew Noyes db348598a1 Update Python target name to Python3 2022-07-29 14:57:29 -07:00
Andrew Noyes 52e9990d32 Python_Interpreter_FOUND -> Python3_Interpreter_FOUND 2022-07-29 14:57:29 -07:00
Andrew Noyes efc3045834 Disallow python2 for cmake scripts 
The fdb c shim build requires python3. Let's not allow python2 to get
used there.

Otherwise we can see something like this:
```
FAILED: bindings/c/libfdb_c.so.init.c bindings/c/libfdb_c.so.tramp.S
cd /home/anoyes/workspace/foundationdb/build/bindings/c && /usr/bin/python2.7 /home/anoyes/workspace/foundationdb/contrib/Implib.so/implib-gen.py --target aarch64 --outdir /home/anoyes/workspace/foundationdb/build/bindings/c --dlopen-callback=fdb_shim_dlopen_callback /home/anoyes/workspace/foundationdb/build/lib/libfdb_c.so
  File "/home/anoyes/workspace/foundationdb/contrib/Implib.so/implib-gen.py", line 27
    sys.stderr.write(f'{me}: warning: {msg}\n')
```
 2022-07-29 14:57:29 -07:00
Markus Pilman 50fd0f11dd
Merge pull request #7738 from sfc-gh-mpilman/bugfixes/investigate-token-cache-segfaults 
fix token cache unit test
 2022-07-29 13:55:51 -06:00
A.J. Beamon a69164d160 Merge branch 'main' into feature-metacluster 2022-07-29 11:53:06 -07:00
Markus Pilman b600966cf9 fix token cache unit test 2022-07-29 12:47:55 -06:00
Nim Wijetunga 3e45b6657c
Merge pull request #7714 from sfc-gh-nwijetunga/nim/tenant-encryption-property 
Encryption as a tenant property
 2022-07-29 11:30:19 -07:00