Commit Graph

18689 Commits

Author SHA1 Message Date
sfc-gh-tclinkenbeard 5b8f4d9be1 Move SimpleIni.h to fdbclient 2022-02-07 13:31:04 -08:00
Andrew Noyes 00ceaeb1b3 Move generated part of Program.cs to its own file
This way editors/tools will understand that it's a c sharp file
2022-02-07 13:28:06 -08:00
sfc-gh-zyang 0968935665 rename params and add disallow users to set both of PROFILE_INSTR_GENERATE and PROFILE_INSTR_USE 2022-02-07 12:34:27 -08:00
Jon Fu 7e5ad88780 formatting for Github CI 2022-02-07 15:31:59 -05:00
Jon Fu 9c0a512cf5 Merge branch 'main' of github.com:apple/foundationdb into jfu-grv-cache 2022-02-07 14:51:12 -05:00
Jon Fu ec2bbf0343 clean up some more trace lines and leftover code snippets 2022-02-07 14:50:04 -05:00
A.J. Beamon 2973130443 Improve the help for fdbcli exclude. 2022-02-07 10:14:42 -08:00
Mohamed Oulmahdi 00d1532d32 Remove ClientLibManagement test 2022-02-07 16:54:36 +01:00
sfc-gh-zyang ddb05b6e8e fix typo during merge 2022-02-04 17:03:15 -08:00
sfc-gh-zyang eb1237c5fd Merge branch 'zyang/fdo' of https://github.com/sfc-gh-zyang/foundationdb into zyang/fdo 2022-02-04 17:01:06 -08:00
sfc-gh-zyang 93f22ea381 Merge https://github.com/sfc-gh-zyang/foundationdb into zyang/fdo 2022-02-04 16:59:16 -08:00
sfc-gh-zyang 2ec6633ef3 support fdo 2022-02-04 16:51:45 -08:00
zhenfeng yang c9c7f75321
Merge branch 'apple:main' into zyang/fdo 2022-02-04 16:49:56 -08:00
sfc-gh-zyang 58034d2554 support fdo 2022-02-04 16:46:17 -08:00
Xiaoxi Wang 1172761559 add proper downgrade/upgrade test for storage migration with PPW 2022-02-04 16:43:11 -08:00
Xiaoxi Wang 6dc5921575
createdTime based storage wiggler (#6219)
* add storagemetadata

* add StorageWiggler;

* fix serverMetadataKey bug

* add metadata tracker in storage tracker

* finish StorageWiggler

* update next storage ID

* change pid to server id

* write metadata when seed SS

* add status json fields

* remove pid based ppw iteration

* fix time expression

* fix tss metadata nonexistence; fix transaction retry when retrieving metadata

* fix checkMetadata bug when store type is wrong

* fix remove storage status json

* format code

* refactor updateNextWigglingStoragePID

* seperate storage metadata tracker and store type tracker

* rename pid

* wiggler stats

* fix completion between waitServerListChange and storageRecruiter

* solve review comments

* rename system key

* fix database lock timeout by adding lock_aware

* format code

* status json

* resolve code format/naming comments

* delete expireNow; change PerpetualStorageWiggleID's value to KeyBackedObjectMap<UID, StorageWiggleValue>

* fix omit start rount

* format code

* status json reset

* solve status json format

* improve status json latency; replace binarywriter/reader to objectwriter/reader; refactor storagewigglerstats transactions

* status timestamp
2022-02-04 15:04:30 -08:00
sfc-gh-tclinkenbeard ca7fb0b171 Fix stringop-overflow warning from gcc in StringRef::compare 2022-02-04 14:58:03 -08:00
zhenfeng yang 7603096349
Merge branch 'apple:main' into zyang/fdo 2022-02-04 14:35:57 -08:00
sfc-gh-tclinkenbeard a2b4fb91d0 Update copyright headers 2022-02-04 13:46:44 -08:00
Aaron Molitor 3a4e93604a
Update CONTRIBUTING.md 2022-02-04 13:29:49 -06:00
sfc-gh-tclinkenbeard 6ab4bc0a06 Move all TC*Info classes into TCInfo.h 2022-02-04 10:59:01 -08:00
sfc-gh-tclinkenbeard 0c8834ff66 Move TCServerInfo into its own files 2022-02-04 10:20:11 -08:00
Markus Pilman 4414df1914
Merge pull request #6279 from sfc-gh-rjenkins/threadname-issue-6064
Make better use of thread names.
2022-02-04 08:46:23 -07:00
sfc-gh-tclinkenbeard 68ec591cf9 Move DDTeamCollection into its own files 2022-02-04 00:39:42 -08:00
Johannes M. Scheuermann 9985e0d350 Fix go style issues 2022-02-03 20:48:19 -08:00
Andrew Noyes 84d26c7c13 Don't run downgrade tests for valgrind. Closes #6322 2022-02-03 16:53:56 -08:00
Andrew Noyes 4bf14e6c47
Create joshua package from ctest tests (#6237)
* Add ctest_to_joshua.py

* WIP

* Normalize python3

* set -euxo pipefail

* Strip binary files

* Remove unnecessary file copy

* Redirect stderr to stdout

* Fix syntax

* Set BASH_XTRACEFD=1
2022-02-03 15:07:41 -08:00
Jingyu Zhou f361f5a96c Rename isEmptyMessage to messagesWritten
The variable name means exactly the opposite.
2022-02-03 14:55:44 -08:00
Mohamed Oulmahdi f10b549bdf Remove Downgrade test
This test seems broken
2022-02-03 23:52:42 +01:00
Andrew Noyes 02fcb1a239
Deprecate transaction_include_port_in_address (#6332)
* Deprecate transaction_include_port_in_address

Update the description to start with Deprecated, so that it will be
deprecated in the generated java files.

* Update generated.go
2022-02-03 14:36:01 -08:00
Mohamed Oulmahdi d50ec42c87 Enhance the detection of missing test files 2022-02-03 22:26:10 +01:00
Mohamed Oulmahdi 6386eb191a Add missing test files 2022-02-03 22:25:11 +01:00
A.J. Beamon 1666211252
Merge pull request #6283 from sfc-gh-ajbeamon/adjust-protocol-version
Unset the last bit of the protocol version
2022-02-03 12:26:28 -08:00
Markus Pilman 66b43d4426
Merge pull request #6330 from sfc-gh-jslocum/tss_restarting_fix
Fixing TSS buggify in restarting tests
2022-02-03 08:02:38 -07:00
Josh Slocum b324cf4bc4 Fixing TSS buggify in restarting tests 2022-02-03 06:46:28 -06:00
Jon Fu 6d05ecffc2 remove all multi-version client code related to grv cache 2022-02-02 14:39:17 -05:00
Steven Li 36c6e23700
Add TraceEvent severity knob (#6326)
* add knob for trace event severity

* add knob for TraceEvent severity

* fix format

* fix switch format

* moved intToSeverity call inside __test initialization

* updated knob name

* fix line length format

* fix format

* git clang-format
2022-02-02 11:36:17 -08:00
Jon Fu d8e7fea421 clean up some comments and debug changes 2022-02-02 14:03:32 -05:00
A.J. Beamon 31adbce2f3 Clarify the expectations for the current protocol version and min invalid protocol version in comments. Add static asserts to validate those expectations, where possible. 2022-02-02 10:02:01 -08:00
Ray Jenkins dd45805312
Merge branch 'apple:main' into threadname-issue-6064 2022-02-01 17:40:07 -06:00
A.J. Beamon 65f2c14f31
Merge pull request #6320 from johscheuer/add-fdbcli-loggroup
Add LogGroup support to fdbcli
2022-02-01 09:13:18 -08:00
Ata E Husain Bohra 591ef57857
Upgrade AES 128 GCM -> AES 256, StreamCipher code refactor (#6314)
* Upgrade AES 128 GCM -> AES 256, StreamCipher code refactor

Major changes proposed are:
1. Refactor StreamCipher code to enable instantiation of
   multiple encryption keys. However, code still retains
   a globalEncryption key semantics used in Backup file
   encryption usecase.
2. Enhance StreamCipher to provide HMAC signature digest
   generation. Further, the class implements HMAC encryption
   key derivation function.
3. Upgrade StreamCipher to use AES 256 GCM mode from currently
   supported AES 128 GCM mode.
   Note: The code changes the encryption key size, however, the
         feature is NOT currently in use, hence, should be OK.
3. Add EncryptionOps validation and benchmark toml supported
   workload, it does the following:
   a. Allow user to configure encrypt-decrypt of a fixed size
      buffer or variable size buffer [100, 512K]
   b. Allow user to configure number of interactions of the runs,
      in each iteration: generate random data, derive an encryption
      key using HMAC SHA256 method, encrypt data and
      then decrypt data. It collects following metrics:
    i) time taken to derive encryption key.
    ii) time taken to encrypt the buffer.
    iii) time taken to decrypt the buffer.
    iv) total bytes encrypted and/or decrypted
   c. Along with stats it basic basic validations on the encrypted
      and decrypted buffer
   d. On completion for test, records the above mentioned metrics
      in trace files.
2022-01-31 19:52:44 -06:00
A.J. Beamon 8c00ba6716
Merge pull request #6324 from sfc-gh-ajbeamon/high-contention-allocator
Rename high contention allocator implementation in fdbclient
2022-01-31 15:51:03 -08:00
A.J. Beamon 7195d4dadd Fix formatting 2022-01-31 14:43:04 -08:00
A.J. Beamon 6affc58e97 Rename high contention allocator implementation in fdbclient 2022-01-31 14:25:38 -08:00
Markus Pilman 60cbce72c2
Merge pull request #6317 from sfc-gh-ajbeamon/high-contention-allocator
Added a generic high contention allocator implementation to fdbclient
2022-01-31 14:50:51 -07:00
A.J. Beamon 6ca8f08da8
Merge pull request #6293 from sfc-gh-ajbeamon/fdbcli-print-at-col-stream
Support other output streams in fdbcli printAtCol
2022-01-31 13:16:27 -08:00
Trevor Clinkenbeard e6b02532a6
Merge pull request #6192 from sfc-gh-tclinkenbeard/improve-commitbatcher-performance
Make `VectorRefPreserializer` move constructor noexcept
2022-01-31 09:52:51 -08:00
Johannes M. Scheuermann 3b0feebd5d Add LogGroup support to fdbcli 2022-01-31 17:47:39 +00:00
A.J. Beamon d7819f8387
Merge pull request #6304 from sfc-gh-ajbeamon/reset-copy-trstate
Copy transaction state during reset
2022-01-31 09:11:04 -08:00