Commit Graph

6665 Commits

Author SHA1 Message Date
Evan Tschannen 9463b91594
Update fdbbackup/backup.actor.cpp
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
2019-09-30 13:16:55 -07:00
Evan Tschannen 27db0ca530
Update fdbserver/storageserver.actor.cpp
Co-Authored-By: Jingyu Zhou <jingyuzhou@gmail.com>
2019-09-30 13:16:31 -07:00
Evan Tschannen cadf82eca0 updated documentation for 6.2.5 2019-09-30 13:15:30 -07:00
Evan Tschannen e5a6ebae7e fixed compiler error 2019-09-30 12:46:30 -07:00
Evan Tschannen 4d659662b8 made cleanup handle retries better 2019-09-30 12:44:20 -07:00
Evan Tschannen 045175bd0e added tracking for the size of the system keyspace 2019-09-27 22:39:19 -07:00
Evan Tschannen 4b5080fbea added a few more missing data distribution priorities 2019-09-27 19:39:53 -07:00
Evan Tschannen 324d0bd3b0 Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-cleanup-mutations 2019-09-27 19:15:14 -07:00
Evan Tschannen eee4404e4e fix: when the shard pointer is replaced with a new AddingShard, we need to restart the warningLogger because the old one will have a pointer to the deleted AddingShard 2019-09-27 19:11:34 -07:00
Evan Tschannen 905c511485
Merge pull request #2137 from xumengpanda/mengxu/DD-localityfix-part2
DD:Trigger storage recruitment when an invalid address locality is corrected
2019-09-27 18:47:22 -07:00
Evan Tschannen aa82a57502
Merge pull request #2168 from ajbeamon/fdb-future-get-version-cleanup
fdb_future_get_version cleanup
2019-09-27 18:42:00 -07:00
Evan Tschannen 3cc5d484a5 the include and exclude commands do not need to set the moveKeysLockOwnerKey, which will kill the data distribution algorithm 2019-09-27 18:33:56 -07:00
Evan Tschannen 3bb62e008c lowered the priority of some delays in data distribution so that the process will prefer other work 2019-09-27 18:33:13 -07:00
Evan Tschannen ef01ad2ed8 optimized log range clearing to clear everything for each possible hash (256 clears) if that would be more efficient than one clear per second that has elapsed
aborting a DR without the —cleanup flag will still attempt to cleanup for 30 seconds before giving up
added a cleanup command to fdbbackup which can remove mutations from orphaned DRs which were stopped without the —cleanup flag
2019-09-27 18:32:27 -07:00
A.J. Beamon e2f4d19c34 Don't export the fdb_future_get_version_v619 symbol. Mark fdb_future_get_version as a removed function. 2019-09-27 15:31:09 -07:00
Meng Xu c52d984d3a
Merge pull request #2140 from alexmiller-apple/delay-longer-in-configure-6.2
Make one case in ConfigureDatabase wait for >3s.
2019-09-26 09:04:14 -07:00
Meng Xu 44eee1a7fb
Merge pull request #2138 from jzhou77/fix-iterator
Add more tracing to move keys locking events
2019-09-25 15:52:04 -07:00
Alex Miller 60aaae248e Make one case in ConfigureDatabase wait for >3s.
It turns out that in rare situations, simulation can run into a case
where recovering to the point that tlog generations can be dropped takes
longer than 3s, and thus tests fail with an OOM as an ever increasing
number of tlogs are recruited and never removed.
2019-09-25 15:36:07 -07:00
Jingyu Zhou a004e091df Move trace event after transaction commit 2019-09-24 21:18:28 -07:00
Jingyu Zhou 2bbc6d68ba Add more tracing to move keys locking events 2019-09-24 13:41:40 -07:00
Meng Xu 32ebd08f9f DD:Trigger storage recruitment when an invalid address locality is corrected 2019-09-24 13:35:38 -07:00
Alvin Moore f13039e6d4 Switched to using CMAKE_CXX_STANDARD for setting c++17 2019-09-24 11:22:24 -07:00
Alvin Moore 9ae1125a85 Only enable `no-register ` option if ccache is enabled because of ccache problem 2019-09-24 11:22:24 -07:00
Alvin Moore 2bbaa917f8 Switched out C style cast to more favorable type 2019-09-24 11:22:24 -07:00
Alvin Moore c447d5999d Added support to allow USE_LIBCXX to be enabled via environmental variable
Changed use of '-std=c++17)' to setting the CXX standard via CMAKE_CXX_STANDARD keyword
Added c++ library for linking
Added compilation options to ignore certain command parameters when using CCACHE due to ccache bug
2019-09-24 11:22:24 -07:00
Alvin Moore 6354e63269 Added parenthesis around ntohl value to resolve problem with CLANG compiler 2019-09-24 11:22:24 -07:00
Alvin Moore 8f755f0f3a Added parenthesis around macro condition which could cause problems with interpretation since being used in 'or' statement.
This is currently a problem for CLANG compiler
2019-09-24 11:22:24 -07:00
Meng Xu 3d7b7d86c9
Merge pull request #2132 from ajbeamon/fix-doc-errors
Fix a couple documentation errors
2019-09-23 09:13:42 -07:00
A.J. Beamon d7f5cf1c3a FoudnationDB -> FoundationDB
does not a -> does not have a
2019-09-23 09:10:36 -07:00
A.J. Beamon c32e0ab8b4
Merge pull request #2120 from xumengpanda/mengxu/6.2.4-DD-patch-no-simulation
Improve FDB reliability from misconfigured localities - Part 1
2019-09-19 06:56:39 -07:00
Meng Xu 515689d07b
Update fdbserver/DataDistribution.actor.cpp
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
2019-09-18 14:45:18 -07:00
Meng Xu d175b61a62 DD:Trace when invalid locality is corrected
Change getWorkers param from txn handler to db
2019-09-18 13:52:54 -07:00
Meng Xu e69df4d7f8
Merge pull request #2113 from senthil-ram/print_uid
snapshot cli to print UID in failure cases too
2019-09-17 20:17:14 -07:00
Meng Xu 93bbc26a35 set:erase:Use return value of erase iterator as next iterator 2019-09-17 15:28:30 -07:00
Meng Xu d2fd1f4931 DD:MisconfiguredLocality:Fix review comments 2019-09-17 13:04:21 -07:00
sramamoorthy a4d38f1158 Fix #2057 snapshot cli to print UID in failure too 2019-09-17 05:18:28 -07:00
A.J. Beamon 2a857b5316
Merge pull request #2115 from AlvinMooreSr/GCC9-fix
Backport Fdbmonitor Link Fix
2019-09-16 19:06:47 -07:00
Alvin Moore 56a67148a1 Backported fix for linking pthread into fdbmonitor from master 2019-09-16 12:31:42 -07:00
Alvin Moore 6872ca1228 Added pthread library since used within fdbmonitor 2019-09-16 12:31:42 -07:00
Meng Xu a8fff56f6e ReleaseNotes:Add DD fix for 6.2.5 2019-09-15 11:33:36 -07:00
Meng Xu 37d2318eed DD:Handle worker with incorrect locality
When a worker has incorrect locality, the worker will be excluded from
storage recruitment.
When the worker has its locality corrected by system operators,
the worker will be reincluded for storage recruitment.
2019-09-14 12:12:56 -07:00
Meng Xu c3960aba17 DD:initializeStorage:Exclude worker with invalid locality 2019-09-13 22:05:41 -07:00
A.J. Beamon 051c8d15bb
Merge pull request #2112 from mpilman/fixes/check-memory-config
Verify that we have enough memory if cache_memory is set
2019-09-13 18:41:44 -07:00
Meng Xu 75460089e1 DD_VALIDATE_LOCALITY:Add comment for our future selves
When we add simulation test that misconfigure a cluster by not setting some
locality entries, we should set DD_VALIDATE_LOCALITY always true.
Otherwise, simulation tests may fail.
2019-09-13 16:26:54 -07:00
Meng Xu 78b8e48cef DD:ValidLocality:Resolve review comment 2019-09-13 15:35:16 -07:00
Alvin Moore c28aec3ca1 Fixed Docker label version to match image version 2019-09-13 15:31:37 -07:00
Alvin Moore 5c091cb7eb Switched cmake build to use ninja which is included within docker file 2019-09-13 15:31:37 -07:00
Meng Xu e1dcdbf3d2 LocalityData:Remove verbose check for valid locality 2019-09-13 15:11:13 -07:00
Markus Pilman eb29541acb
Update fdbserver/fdbserver.actor.cpp
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
2019-09-13 15:10:24 -07:00
Meng Xu 8970d9858b DD:isValidLocality:A generic way to check any replicationPolicy 2019-09-13 14:55:51 -07:00