Evan Tschannen
9463b91594
Update fdbbackup/backup.actor.cpp
...
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
2019-09-30 13:16:55 -07:00
Evan Tschannen
27db0ca530
Update fdbserver/storageserver.actor.cpp
...
Co-Authored-By: Jingyu Zhou <jingyuzhou@gmail.com>
2019-09-30 13:16:31 -07:00
Evan Tschannen
cadf82eca0
updated documentation for 6.2.5
2019-09-30 13:15:30 -07:00
Evan Tschannen
e5a6ebae7e
fixed compiler error
2019-09-30 12:46:30 -07:00
Evan Tschannen
4d659662b8
made cleanup handle retries better
2019-09-30 12:44:20 -07:00
Evan Tschannen
045175bd0e
added tracking for the size of the system keyspace
2019-09-27 22:39:19 -07:00
Evan Tschannen
4b5080fbea
added a few more missing data distribution priorities
2019-09-27 19:39:53 -07:00
Evan Tschannen
324d0bd3b0
Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-cleanup-mutations
2019-09-27 19:15:14 -07:00
Evan Tschannen
eee4404e4e
fix: when the shard pointer is replaced with a new AddingShard, we need to restart the warningLogger because the old one will have a pointer to the deleted AddingShard
2019-09-27 19:11:34 -07:00
Evan Tschannen
905c511485
Merge pull request #2137 from xumengpanda/mengxu/DD-localityfix-part2
...
DD:Trigger storage recruitment when an invalid address locality is corrected
2019-09-27 18:47:22 -07:00
Evan Tschannen
aa82a57502
Merge pull request #2168 from ajbeamon/fdb-future-get-version-cleanup
...
fdb_future_get_version cleanup
2019-09-27 18:42:00 -07:00
Evan Tschannen
3cc5d484a5
the include and exclude commands do not need to set the moveKeysLockOwnerKey, which will kill the data distribution algorithm
2019-09-27 18:33:56 -07:00
Evan Tschannen
3bb62e008c
lowered the priority of some delays in data distribution so that the process will prefer other work
2019-09-27 18:33:13 -07:00
Evan Tschannen
ef01ad2ed8
optimized log range clearing to clear everything for each possible hash (256 clears) if that would be more efficient than one clear per second that has elapsed
...
aborting a DR without the —cleanup flag will still attempt to cleanup for 30 seconds before giving up
added a cleanup command to fdbbackup which can remove mutations from orphaned DRs which were stopped without the —cleanup flag
2019-09-27 18:32:27 -07:00
A.J. Beamon
e2f4d19c34
Don't export the fdb_future_get_version_v619 symbol. Mark fdb_future_get_version as a removed function.
2019-09-27 15:31:09 -07:00
Meng Xu
c52d984d3a
Merge pull request #2140 from alexmiller-apple/delay-longer-in-configure-6.2
...
Make one case in ConfigureDatabase wait for >3s.
2019-09-26 09:04:14 -07:00
Meng Xu
44eee1a7fb
Merge pull request #2138 from jzhou77/fix-iterator
...
Add more tracing to move keys locking events
2019-09-25 15:52:04 -07:00
Alex Miller
60aaae248e
Make one case in ConfigureDatabase wait for >3s.
...
It turns out that in rare situations, simulation can run into a case
where recovering to the point that tlog generations can be dropped takes
longer than 3s, and thus tests fail with an OOM as an ever increasing
number of tlogs are recruited and never removed.
2019-09-25 15:36:07 -07:00
Jingyu Zhou
a004e091df
Move trace event after transaction commit
2019-09-24 21:18:28 -07:00
Jingyu Zhou
2bbc6d68ba
Add more tracing to move keys locking events
2019-09-24 13:41:40 -07:00
Meng Xu
32ebd08f9f
DD:Trigger storage recruitment when an invalid address locality is corrected
2019-09-24 13:35:38 -07:00
Alvin Moore
f13039e6d4
Switched to using CMAKE_CXX_STANDARD for setting c++17
2019-09-24 11:22:24 -07:00
Alvin Moore
9ae1125a85
Only enable `no-register ` option if ccache is enabled because of ccache problem
2019-09-24 11:22:24 -07:00
Alvin Moore
2bbaa917f8
Switched out C style cast to more favorable type
2019-09-24 11:22:24 -07:00
Alvin Moore
c447d5999d
Added support to allow USE_LIBCXX to be enabled via environmental variable
...
Changed use of '-std=c++17)' to setting the CXX standard via CMAKE_CXX_STANDARD keyword
Added c++ library for linking
Added compilation options to ignore certain command parameters when using CCACHE due to ccache bug
2019-09-24 11:22:24 -07:00
Alvin Moore
6354e63269
Added parenthesis around ntohl value to resolve problem with CLANG compiler
2019-09-24 11:22:24 -07:00
Alvin Moore
8f755f0f3a
Added parenthesis around macro condition which could cause problems with interpretation since being used in 'or' statement.
...
This is currently a problem for CLANG compiler
2019-09-24 11:22:24 -07:00
Meng Xu
3d7b7d86c9
Merge pull request #2132 from ajbeamon/fix-doc-errors
...
Fix a couple documentation errors
2019-09-23 09:13:42 -07:00
A.J. Beamon
d7f5cf1c3a
FoudnationDB -> FoundationDB
...
does not a -> does not have a
2019-09-23 09:10:36 -07:00
A.J. Beamon
c32e0ab8b4
Merge pull request #2120 from xumengpanda/mengxu/6.2.4-DD-patch-no-simulation
...
Improve FDB reliability from misconfigured localities - Part 1
2019-09-19 06:56:39 -07:00
Meng Xu
515689d07b
Update fdbserver/DataDistribution.actor.cpp
...
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
2019-09-18 14:45:18 -07:00
Meng Xu
d175b61a62
DD:Trace when invalid locality is corrected
...
Change getWorkers param from txn handler to db
2019-09-18 13:52:54 -07:00
Meng Xu
e69df4d7f8
Merge pull request #2113 from senthil-ram/print_uid
...
snapshot cli to print UID in failure cases too
2019-09-17 20:17:14 -07:00
Meng Xu
93bbc26a35
set:erase:Use return value of erase iterator as next iterator
2019-09-17 15:28:30 -07:00
Meng Xu
d2fd1f4931
DD:MisconfiguredLocality:Fix review comments
2019-09-17 13:04:21 -07:00
sramamoorthy
a4d38f1158
Fix #2057 snapshot cli to print UID in failure too
2019-09-17 05:18:28 -07:00
A.J. Beamon
2a857b5316
Merge pull request #2115 from AlvinMooreSr/GCC9-fix
...
Backport Fdbmonitor Link Fix
2019-09-16 19:06:47 -07:00
Alvin Moore
56a67148a1
Backported fix for linking pthread into fdbmonitor from master
2019-09-16 12:31:42 -07:00
Alvin Moore
6872ca1228
Added pthread library since used within fdbmonitor
2019-09-16 12:31:42 -07:00
Meng Xu
a8fff56f6e
ReleaseNotes:Add DD fix for 6.2.5
2019-09-15 11:33:36 -07:00
Meng Xu
37d2318eed
DD:Handle worker with incorrect locality
...
When a worker has incorrect locality, the worker will be excluded from
storage recruitment.
When the worker has its locality corrected by system operators,
the worker will be reincluded for storage recruitment.
2019-09-14 12:12:56 -07:00
Meng Xu
c3960aba17
DD:initializeStorage:Exclude worker with invalid locality
2019-09-13 22:05:41 -07:00
A.J. Beamon
051c8d15bb
Merge pull request #2112 from mpilman/fixes/check-memory-config
...
Verify that we have enough memory if cache_memory is set
2019-09-13 18:41:44 -07:00
Meng Xu
75460089e1
DD_VALIDATE_LOCALITY:Add comment for our future selves
...
When we add simulation test that misconfigure a cluster by not setting some
locality entries, we should set DD_VALIDATE_LOCALITY always true.
Otherwise, simulation tests may fail.
2019-09-13 16:26:54 -07:00
Meng Xu
78b8e48cef
DD:ValidLocality:Resolve review comment
2019-09-13 15:35:16 -07:00
Alvin Moore
c28aec3ca1
Fixed Docker label version to match image version
2019-09-13 15:31:37 -07:00
Alvin Moore
5c091cb7eb
Switched cmake build to use ninja which is included within docker file
2019-09-13 15:31:37 -07:00
Meng Xu
e1dcdbf3d2
LocalityData:Remove verbose check for valid locality
2019-09-13 15:11:13 -07:00
Markus Pilman
eb29541acb
Update fdbserver/fdbserver.actor.cpp
...
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
2019-09-13 15:10:24 -07:00
Meng Xu
8970d9858b
DD:isValidLocality:A generic way to check any replicationPolicy
2019-09-13 14:55:51 -07:00