8d591fc5e7
address pr comments
2022-08-02 10:51:41 -07:00
af6db42b1b
temp
2022-08-01 15:19:21 -07:00
1de37afd52
Make TEST macros C++ only ( #7558 )
...
* proof of concept
* use code-probe instead of test
* code probe working on gcc
* code probe implemented
* renamed TestProbe to CodeProbe
* fixed refactoring typo
* support filtered output
* print probes at end of simulation
* fix missed probes print
* fix deduplication
* Fix refactoring issues
* revert bad refactor
* make sure file paths are relative
* fix more wrong refactor changes
2022-07-19 13:15:51 -07:00
4103b16793
Fix a performance bug in Resolver
...
The erased bytes from recent state transactions was accidently set to 0 and
cause anyPopped to be always false. Thus, when totalStateBytes will never
decrease and can cause high latency between "Resolver.resolveBatch.Before" and
"Resolver.resolveBatch.AfterQueueSizeCheck", in hundreds of milliseconds. This
will cause high server side commit latency.
2022-07-08 09:58:28 -07:00
ec9c3cf05c
Remove unused variables
2022-06-28 16:41:58 -04:00
6246664006
Support encrypting TxnStateStore ( #7253 )
...
Adding encryption support for TxnStateStore. It is done by supporting encryption. for KeyValueStoreMemory. The encryption is currently done on operation level when the operations are being write to the underlying log file. See inline comment for the encrypted data format.
This PR depends on #7252 . It is part of the effort to support TLog encryption #6942 .
2022-06-14 13:26:32 -07:00
3caa3bc595
Rename variable names
2022-05-06 12:33:19 -07:00
0cce5feae3
Optimize LogPushData to avoid constructing LogSystemConfig
...
Which seems to be a CPU hot spot in our testing.
2022-05-06 12:33:19 -07:00
b970d507c0
Avoid creating LogPushData when PROXY_USE_RESOLVER_PRIVATE_MUTATIONS is off
...
To save CPU cost, especially for creating LogSystemConfig.
2022-05-05 08:45:40 -07:00
dc9e782ccc
OpenTelemetry Tracing Perf Fixes ( #6990 )
2022-05-02 14:56:51 -05:00
1c5bf135d5
Revert "Migrate to OpenTelemetry tracing. ( #6855 )" ( #6941 )
...
This reverts commit 5df3bac110
2022-04-25 09:29:56 -05:00
5df3bac110
Migrate to OpenTelemetry tracing. ( #6855 )
2022-04-20 09:26:37 -05:00
e43fde16ec
formatting
2022-04-08 17:28:16 -04:00
62975f87d1
Formatting
2022-04-08 15:04:46 -04:00
cfcf0f152c
Merge branch 'main-4a085fc84' into vv
...
Fix Conflicts:
fdbclient/NativeAPI.actor.cpp
fdbserver/ClusterRecovery.actor.cpp
fdbserver/MasterInterface.h
fdbserver/masterserver.actor.cpp
flow/error_definitions.h
2022-03-30 22:28:06 -07:00
e9659b5dd4
Merge branch 'master-PR-6500' into vv
...
Fix Conflicts:
fdbclient/CommitProxyInterface.h
fdbclient/NativeAPI.actor.cpp
fdbserver/masterserver.actor.cpp
2022-03-30 14:53:49 -07:00
a71099471b
Update copyright header dates
2022-03-21 13:36:23 -07:00
250a88e682
Enforce that trace event suppression calls happen first when using trace event call chaining. Fix various instances where we weren't following this requirement.
2022-02-24 12:25:52 -08:00
608dabbf41
Fix Valgrind error of uninitialized data in CommitTransactionRef
2022-02-19 09:02:11 -08:00
1f67250402
Fix problem with PROXY_USE_RESOLVER_PRIVATE_MUTATIONS in resolver.
2022-01-21 10:39:06 -05:00
9544379cdf
rebase
2022-01-20 11:12:33 -05:00
49e89571fa
Set recoverAt to max(all tlogs rv) for recovered (crashed) tLogs in UNICAST mode.
2022-01-04 12:27:20 -05:00
f91afcd626
do not broadcast unless shard changed.
2021-12-14 16:21:58 -05:00
9f4ac866cd
Avoid context switch between appending version list and updating dv
...
Port PR 6117 (Resolver saves shardChanged in recent state transactions)
2021-12-13 13:02:32 -05:00
0222d8669d
fix simulation failures
2021-12-10 09:56:21 -05:00
90ced244eb
Fix -Wunused-but-set-variable warnings
2021-12-01 18:15:53 -08:00
23062b892e
Calculate tpcv on resolvers
2021-10-15 16:40:00 -04:00
e288348675
Fix forceRecovery flag to control private mutations
...
The flag change from initial commit should be ignored, while the rest should be
honored.
2021-10-15 09:47:23 -04:00
fc7325e923
Fix force recovery when generating private mutations
...
Resolver need to skip transactions after forceRecovery flag is true.
2021-10-15 09:47:23 -04:00
0a88d6a94c
Limit resolution balancing to normal keys
...
This is for resolver private mutation feature if used.
2021-10-15 09:47:23 -04:00
34e9932778
Separate \xff keyspace from keyResolvers
...
This is needed to make sure all Resolvers process all metadata mutations.
For commit proxy, we add all read/write conflict ranges for metadata mutations
to all resolvers.
We also send lock_aware flag for each transaction to resolvers.
2021-10-15 09:47:23 -04:00
0dc9c607f4
Add knob PROXY_USE_RESOLVER_PRIVATE_MUTATIONS
...
To control proxy to use private mutations from resolvers or not.
2021-10-15 09:47:23 -04:00
c1d7b03087
CommitProxy uses Resolver's private mutations
...
Note the commit proxy still runs applyMetadataMutations for setting up memory
states, and no longer generates private mutations.
2021-10-15 09:47:23 -04:00
90a27bedf5
fix conflict fdbserver/ApplyMetadataMutation.cpp
2021-10-15 09:47:20 -04:00
9ecdbc39ee
Add private mutations to Resolver reply messages
2021-10-15 09:45:57 -04:00
ad64ee9858
Format fix
2021-10-15 09:45:57 -04:00
ff75d22ce8
Fix test failures
...
Need to be careful what values applyMetadataMutation needs.
Need to call txnStateStore->enableSnapshot() after receiving the broadcast to
allow semiCommit to happen.
2021-10-15 09:45:57 -04:00
fbc6f45190
Generate private mutations at Resolvers
2021-10-15 09:45:57 -04:00
f79ca8d7fb
Add actor error handling in Resolvers
2021-10-15 09:45:57 -04:00
e0184bc8aa
resolve conflict
2021-10-15 09:45:52 -04:00
5e6fa0737a
Master broadcasts txnStateStore to Resolvers
2021-10-15 09:45:13 -04:00
abf73047ca
Enforce std:: specifier rather than using namespace
2021-09-16 19:40:28 -07:00
fe03cead96
Prevent resolver from modifying ServerDBInfo object
2021-07-11 22:04:58 -07:00
9b8c4a2ffc
Remove fdbserver/Orderer.actor.h
...
Apparently this is no longer used for many years.
Fix Conflicts:
fdbserver/CMakeLists.txt
2021-06-24 11:23:37 -07:00
f28ac955c3
Remove unnecessary temporary objects while growing objects of type std::vector<std::pair<A, B>>
2021-05-10 16:32:50 -07:00
2cd3f45fd6
Merge remote-tracking branch 'apple/release-6.3' into master-format-final
...
release-6.3 was recently merged, and there were two PRs which were
merged in between and got those changes in here. Hence, since all the
changes were in, discarded the incoming changes and accepted all
current.
2021-03-10 16:50:44 -08:00
df90cc89de
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-03-10 10:18:07 -08:00
8a8c488ede
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-03-05 18:13:38 -06:00
24ea35e56f
Merge pull request #3748 from sfc-gh-ljoswiak/visibility-2
...
Add TLogVersion::V6
2020-10-14 17:35:32 -07:00
2bac64edc7
Add more comments and refactor for SkipList
...
There are no functional changes.
2020-10-13 12:55:08 -07:00
Nim Wijetunga