Commit Graph

11293 Commits

Author SHA1 Message Date
Meng Xu 309f383be3 FR:Report error if controller throws error 2020-08-04 23:08:41 -07:00
Meng Xu 879998d01b FR:fix compilation error 2020-08-04 23:04:38 -07:00
Meng Xu 7992cef025 FR:Fix sample network pkg can be too big 2020-08-04 22:35:21 -07:00
Meng Xu e9adec421d FR:Add controller interface and send to roles 2020-08-03 15:06:15 -07:00
Meng Xu f071d81ad0 Report warning on FastRestoreApplierClearRangeMutationsStart if delayTime is too large 2020-08-03 14:08:31 -07:00
Meng Xu 14acebde1e Merge branch 'release-6.3' into mengxu/fr-fix-large-pkg-PR 2020-08-03 14:07:46 -07:00
Xin Dong 25a3fd638e
Merge pull request #3583 from xumengpanda/mengxu/fr-apply-async-PR
Fast Restore: Misc improvements
2020-08-03 10:06:15 -07:00
Meng Xu e1a5988c5b
Merge pull request #3566 from sfc-gh-anoyes/anoyes/issue-3565
Use IPAddress instead of NetworkAddress for exclude
2020-08-02 10:53:09 -07:00
Andrew Noyes 87098afdb4 Add braces around ifs 2020-08-02 17:26:35 +00:00
Meng Xu 0c49646486 Fix:FastRestore:rangeVersion must be 0 when no range file is used
otherwise, all mutations will be ignored by loaders as old mutations
2020-07-31 23:23:17 -07:00
Meng Xu 27a3d37594 RestoreApplier:Change receivedBytes from double to long 2020-07-31 22:10:18 -07:00
Meng Xu e22baa552b FastRestoreApplier:Init stats variables 2020-07-31 21:56:03 -07:00
Meng Xu f36d5aa180 FR:Applier received bytes per batch 2020-07-31 17:48:55 -07:00
Meng Xu fec3de9b7b Fix RestoreLoader loadedLogBytes counter 2020-07-31 16:00:15 -07:00
Meng Xu 47c35a7a69 FastRestore:Add stats to ApplierBatchData 2020-07-31 14:59:45 -07:00
Meng Xu e4d2ab72fe DumpVersionBatch with log and file summary info 2020-07-31 14:21:33 -07:00
Meng Xu 2f5293fcc7 Introduce knob FASTRESTORE_USE_LOG_FILE and FASTRESTORE_USE_RANGE_FILE 2020-07-31 10:40:29 -07:00
Meng Xu 37c3bd8615 FastRestore:Ensure FASTRESTORE_NOT_WRITE_DB only work in non simulation mode 2020-07-30 20:27:54 -07:00
Meng Xu 8cace30bb2 FastRestore:change TXN_BATCH_MAX_BYTES default to 1KB from 1MB 2020-07-30 16:43:35 -07:00
Meng Xu d16db8e733 FastRestore:Fix segmentation fault 2020-07-30 12:10:32 -07:00
Meng Xu d71361245b FastRestore:Short cut DB for get and clearange 2020-07-30 11:17:05 -07:00
Meng Xu ad915e462e Add knob FASTRESTORE_NOT_WRITE_DB to skip writting to DB 2020-07-30 10:17:17 -07:00
Evan Tschannen 440d46bccc
Merge pull request #3523 from Daniel-B-Smith/global-data-races
Fix some unprotected accesses to global data
2020-07-29 11:44:11 -07:00
Evan Tschannen 314d0a5255
Merge pull request #3573 from etschannen/post-release-cleanup-6.3.4
Post release cleanup 6.3.4
2020-07-28 23:56:59 -07:00
Evan Tschannen 0c8bec5e43 update installer WIX GUID following release 2020-07-28 23:17:10 -07:00
Evan Tschannen 7cdf0b5c31 update version to 6.3.5 2020-07-28 23:17:10 -07:00
Meng Xu 2b8aa296bb
Merge pull request #3482 from sfc-gh-tclinkenbeard/support-downgrades
Support and test downgrades
2020-07-28 17:00:54 -07:00
Meng Xu 6b28687c65
Merge pull request #3570 from sfc-gh-anoyes/anoyes/enable-Wall-Wextra
Re-enable -Wall -Wextra for clang
2020-07-28 14:35:38 -07:00
Andrew Noyes d2cf700bd4 Fix compiler warnings 2020-07-28 18:30:26 +00:00
Daniel Smith f4c54e5ee6 use std::atomic for simple counters 2020-07-28 17:51:21 +00:00
Andrew Noyes 1d22a21510 Revert "temporarily disable compiler warnings"
This reverts commit 29142fa382.
2020-07-28 17:19:52 +00:00
Balachandar Namasivayam 9c569c6ecf
Merge pull request #3569 from xumengpanda/mengxu/fr-fix-frtool-PR
FastRestoreTool: Fix --dest_cluster_file option
2020-07-28 09:56:00 -07:00
Meng Xu e232f805ee FastRestoreTool: Consume restoreClusterFileDest as fdbrestore does 2020-07-27 22:16:35 -07:00
Meng Xu 1a34f5c20e FastRestoreTool: Fix option list 2020-07-27 21:40:20 -07:00
Markus Pilman c6a2043d53
Merge pull request #3450 from sfc-gh-tclinkenbeard/6.3-use-vector-mutations
Replace VersionUpdateRef with VerUpdateRef
2020-07-27 15:21:47 -06:00
Evan Tschannen 6b1092be0b
Merge pull request #3567 from etschannen/release-6.3
Changed a few default knob values to improve recovery speeds
2020-07-27 12:10:15 -07:00
Andrew Noyes 29e328cf32 Use addressExcluded to compare exclusions and addresses
Don't convert the exclusion to a NetworkAddress use operator==, since that's problematic for two reasons:

1. The network address of the not-yet-excluded server might compare differently due to flags like private or public
2. The network address of the not-yet-excluded server will never compare equal to a whole-machine exclusion
2020-07-27 18:52:07 +00:00
Andrew Noyes 09cf3e2883 Revert "Use IPAddress instead of NetworkAddress for exclude"
This reverts commit 331ee4dab4.
2020-07-27 18:38:57 +00:00
Evan Tschannen 3f1e51c821
Merge pull request #3543 from dongxinEric/doc/add-explanation-about-accuracy-of-estiamted-range-size-api
Added some explanation about the accuracy about the get estimated ran…
2020-07-27 11:03:17 -07:00
Evan Tschannen c3348be3a0 changed knobs to improve master recovery speeds 2020-07-27 10:59:06 -07:00
Evan Tschannen ee9b3d1a9d do not let a single failed handshake prevent reconnection for 10 seconds 2020-07-27 10:58:30 -07:00
Evan Tschannen e0db748fb3
Merge pull request #3403 from satherton/tls-background-handshake
TLS handshaking in background threads
2020-07-27 10:55:00 -07:00
Evan Tschannen 9b683f8309
Merge pull request #3537 from etschannen/feature-lifetimetoken-fix
A master process would die immediately if dbInfo did not contain the correct cluster controller
2020-07-27 10:53:27 -07:00
Evan Tschannen 937df4f839 Merge branch 'release-6.3' of github.com:apple/foundationdb into feature-lifetimetoken-fix
# Conflicts:
#	documentation/sphinx/source/release-notes/release-notes-630.rst
2020-07-27 10:03:02 -07:00
Andrew Noyes 331ee4dab4 Use IPAddress instead of NetworkAddress for exclude
NetworkAddress has other fields like flags that aren't relevant for
exclude. Network addresses with equal ip addresses not comparing equal
appears to be the cause of #3565
2020-07-27 05:40:14 +00:00
Xin Dong 2ac7df8a18
Merge pull request #3563 from xumengpanda/mengxu/fr-filesize-PR
FastRestore:Add trace for file size and bc progress
2020-07-25 20:08:57 -07:00
Meng Xu 99d8399f4e FastRestore:Add trace for file size and bc progress 2020-07-25 19:12:25 -07:00
Meng Xu 9d3b1cc4e4
Merge pull request #3562 from sfc-gh-anoyes/anoyes/memory-error
Fix memory error in report conflicting keys special keys
2020-07-24 21:11:42 -07:00
Evan Tschannen 792eaa2174
Merge pull request #3560 from etschannen/release-6.3
Merge Release 6.2 into Release 6.3
2020-07-24 17:06:15 -07:00
Evan Tschannen cb00879c62
Merge pull request #3561 from satherton/feature-redwood
Redwood pager remapped page cleanup now coalesces writes within a large trailing version window.
2020-07-24 16:56:22 -07:00