f339819758
Merge remote-tracking branch 'origin/main' into reject-tag-throttled-txns
2022-10-25 11:59:35 -07:00
4f149b8705
Merge pull request #8545 from sfc-gh-tclinkenbeard/improve-fdbcli-quota-error
...
Improve error messages for `fdbcli` quota commands
2022-10-24 12:18:35 -07:00
90b17a937c
Merge pull request #8526 from sfc-gh-satherton/redwood-page-lifetimes
...
Bug fixes in IO buffer and class lifetimes in Redwood, DiskQueue, AsyncFileChaos, AsyncFileWriteChecker, BackupFile, AsyncFileEncrypted. Generic actor improvements.
2022-10-24 09:54:58 -07:00
59254436ab
Add more details in comment block about interface contract.
2022-10-23 01:08:53 -07:00
2a2d52ca50
Improve error messages for fdbcli quota commands
2022-10-22 18:24:48 -07:00
fe696183fc
Refactored quorum() to also accept an array instead of a vector and modified operator&&(Future, Future) to not create a temporary vector.
2022-10-22 00:48:26 -07:00
4c68bb0193
Added operator+ for Future + Future which waits for both futures in order and returns the result of the second.
2022-10-22 00:46:14 -07:00
9aad911001
Removed unnecessary instantiations of success().
2022-10-22 00:44:50 -07:00
b27bdf1da8
remove zlib
2022-10-21 17:45:22 -07:00
dfc11001af
Reject transactions that have been tag throttled for too long
2022-10-18 15:16:24 -07:00
14d13475db
Merge pull request #8437 from sfc-gh-tclinkenbeard/add-quota-clear-command
...
Add fdbcli "quota clear" command
2022-10-18 15:11:05 -07:00
142d46400b
Reduce severity of trace events for local_config_changed
2022-10-18 13:46:52 -07:00
a6a53b40fd
Merge pull request #8477 from sfc-gh-xwang/feature/main/moveKey
...
Implement mock mode moveKeys in MockDDTxnProcessor and simulation test
2022-10-18 11:02:27 -07:00
622f2a79db
api: add TenantBlobRangeApi feature flag and use for purge tenant api
2022-10-17 11:41:02 -05:00
d169875423
Add a knob for whether to allow guard pages in memory allocations done via mmapInternal(). The knob defaults to false.
2022-10-16 19:55:07 -07:00
e8e6f47e09
format code
2022-10-15 22:52:43 -07:00
737350cc47
setShardStatus (not tested yet)
2022-10-15 22:52:42 -07:00
e4752309a1
Merge pull request #8075 from liquid-helium/validate-data-consistency
...
Validate data consistency
2022-10-13 09:20:01 -07:00
1bfe00ca61
Merge pull request #8449 from sfc-gh-ahusain/ahusain-auth-token-cleanup
...
Remove MultiToken Encryption auth-token generation
2022-10-12 17:51:42 -07:00
c143f1db33
Merge pull request #8455 from sfc-gh-mpilman/features/token-audit-logging
...
Audit all AuthZ token usages
2022-10-12 14:22:55 -06:00
a43e424d8a
Merge branch 'main' of https://github.com/apple/foundationdb into validate-data-consistency
2022-10-12 13:01:07 -07:00
a4050a30c5
Merge pull request #8409 from sfc-gh-huliu/usezstd
...
Use raw ZSTD API for compression
2022-10-12 12:30:37 -07:00
ec76f89d97
use raw ZSTD API
2022-10-12 08:23:15 -07:00
858d562fce
Remove MultiToken Encryption auth-token generation
...
Description
The current code supports two modes for authentication encryption:
1. Single auth-token mode
2. Multi auth-token mode
The code currently uses SingleAuthToken mode only, the multi-auth
token mode was added to support large file (such as backup files)
encryption assisting encryption authentication by allowing reading
header independently from encrypted payload itself. However, the
backup files are organized as 'chunks' and every chunk is encrypted,
hence, MultiToken mode isn't used in the code.
Removing the usage saves 32 bytes per encryption header, which might
translate to decent storage saving, further, allows lesser encryption
header overhead when encrypting small Key-Value mutations.
Testing
BlobCipher unittests
EncryptionOps.toml
2022-10-11 22:49:53 -07:00
ff1b2df8f6
fdbcli: Add options for knob management
...
- setknob <knob_name> <knob_value> [config_class]
- getknob <knob_name> [config_class]
- Added new option to begin to specify if it's a configuration txn. Syntax is begin [config-txn]
- Added utility function for converting tuples to string
- Added knobmanagment test in fdbcli_tests.py
2022-10-11 15:32:01 -07:00
5239c491c4
Audit all AuthZ token usages
2022-10-11 14:34:10 -06:00
88c7304e04
Resolved comments.
2022-10-11 10:24:31 -07:00
117eba363f
Merge pull request #8446 from sfc-gh-mpilman/bugfixes/restart/7.1
2022-10-10 17:27:12 -07:00
8990891f8e
Fix restart failures from 7.1
2022-10-10 16:43:16 -06:00
a730e32164
Merge branch 'main' of https://github.com/apple/foundationdb into validate-data-consistency
2022-10-10 13:17:17 -07:00
c6c449d047
Extract TaskQueue out of Net2 and reuse it in sim2 ( #8330 )
...
* Extract TaskQueue out of Net2 and reuse it in sim2
* empty commit
* Address review comments
* Introduce MAX_RUNLOOP_SLEEP_DELAY
* Apply clang-format
2022-10-10 12:46:06 -07:00
b52edd8658
Merge branch 'main' of https://github.com/apple/foundationdb into validate-data-consistency
2022-10-10 11:00:05 -07:00
1931e3266f
Resolve comments.
2022-10-10 10:28:19 -07:00
da6cf36149
Only register SIGTERM with crashHandler for USE_GCOV
...
Otherwise SIGTERM (and rightly so) causes TSAN to lose its noodle when
fdbmonitor kills fdbserver in the normal way.
2022-10-07 13:42:23 -07:00
ea1325a552
Merge pull request #8319 from sfc-gh-tclinkenbeard/add-rare-code-probe-annotation
...
Add `rare` code probe decoration
2022-10-07 09:39:00 -06:00
c3e84f4e8f
Allow build FoundationDB with zstd compression library
...
With this patch, a new option, FLOW_USE_ZSTD, is introduced. If turned
ON, flow will compile with zstd compression library.
2022-10-05 12:52:39 -07:00
23edfd0d59
Fix formatting
2022-10-04 18:33:30 -06:00
550488b020
Merge remote-tracking branch 'origin/main' into bugfixes/open-for-ide
...
# Conflicts:
# bindings/c/CMakeLists.txt
# fdbclient/include/fdbclient/GetEncryptCipherKeys.actor.h
# fdbserver/BackupWorker.actor.cpp
# fdbserver/BlobWorker.actor.cpp
# fdbserver/CommitProxyServer.actor.cpp
# fdbserver/KeyValueStoreMemory.actor.cpp
# fdbserver/StorageCache.actor.cpp
# fdbserver/include/fdbserver/GetEncryptCipherKeys.actor.h
# fdbserver/storageserver.actor.cpp
# fdbserver/workloads/PhysicalShardMove.actor.cpp
# flow/CMakeLists.txt
2022-10-04 18:27:48 -06:00
97dfc6823f
fixed build with OPEN_FOR_IDE
2022-10-04 17:01:02 -06:00
55b880432e
Merge pull request #8379 from sfc-gh-ajbeamon/literal-string-ref-removal
...
LiteralStringRef removal
2022-10-04 09:41:42 -07:00
ab570df350
One more case where we need to remove the null byte
2022-10-03 10:18:18 -07:00
9795347aa9
Merge pull request #8346 from sfc-gh-anoyes/anoyes/followup-to-8338
...
Guarantee that IS_ARM_MAC is set in flow/CMakeLists.txt
2022-10-03 09:34:45 -07:00
843cb18d82
Merge pull request #8362 from sfc-gh-tclinkenbeard/split-failure-injection-workloads
...
Enable automated failure injection workloads in simulation
2022-10-03 09:20:42 -07:00
43dab2baeb
Creating string refs from literals needs to remove the terminating null byte
2022-10-03 09:20:15 -07:00
415e1aeb1f
Fix for a memory leak in database operations called after create database errors ( #8334 )
...
* ApiTester: cancel pending futures for non-transactional operations
* Clear future callback in case of abort signal to avoid memory leaks
* Abortable future: Make sure all callbacks are cleared in case of premature signal; addressing comments
* Abortable future: remove debugging asserts
* Abortable future: restore the previous method for cancelling wrapped future
* Removing debugging code
2022-10-01 11:30:52 +02:00
fec791be62
Merge remote-tracking branch 'origin/main' into split-failure-injection-workloads
2022-09-30 18:00:48 -07:00
aaa6dbec2d
Delete LiteralStringRef type and write out the final usage using a longer form
2022-09-30 16:08:24 -07:00
217630f327
Add a comparison operator for StringRef and char arrays; use it to get rid of a LiteralStringRef usage
2022-09-30 16:07:26 -07:00
111bf9e34d
Add macros for literal string ref versions of __FUNCTION__ and __FILE__
2022-09-30 16:05:47 -07:00
e1fe28b78b
Switch some usages of LiteralStringRef to use the _sr suffix
2022-09-30 16:04:16 -07:00
sfc-gh-tclinkenbeard