Commit Graph

471 Commits

Author SHA1 Message Date
Bhaskar Muppana c766bcb797 Moving keyStateStatus to BackupConfig::stateEnum. 2017-08-30 10:38:06 -07:00
A.J. Beamon d9f2c858a0 Rollback version for docs change 2017-08-30 08:34:43 -07:00
A.J. Beamon 33c151d2f1 Merge branch 'release-5.0' 2017-08-29 16:23:45 -07:00
Yichi Chiang d9bc7edda0 Merge from release-5.0.4 2017-08-29 15:04:28 -07:00
Alex Miller 8d97a15c3f BUGGIFY recovery to lock only the minimum number of TLogs required to prevent a quorum.
This is to test the quorum logic introduced in the previous patch, and should
flush out any other bugs that rely on TLog locking during recovery.
2017-08-29 14:43:40 -07:00
Alex Miller f8486d1368 Only ensure a quorum of TLogs are unlocked to confirm the epoch hasn't ended.
Currently, GRV will wait to hear back from (almost) all TLogs to confirm that
they're unlocked and that the current epoch hasn't ended.  This confirms that
there isn't a new set of proxies and using the commit version from the old set
of proxies would violate causal consistency.

However, during recovery, we ensure that no quorum of TLogs exists before
starting a new epoch and allowing new commits on the new TLogs.  Thus, we only
need to wait until we have a quorum of TLogs that are unlocked.

This should be a significant improvement in latency particularly for the cases
when we start running >10 TLogs.
2017-08-29 14:43:40 -07:00
Alex Miller 4c1d61cd08 Assorted minor changes.
In which we:
* Clarify some math in a comment
* Remove misleading debugging information
* Add a useful trace event
2017-08-29 14:43:40 -07:00
Alex Miller dbfa94f735 LF -> CRLF
It appears a previous patch left parts of this file ending with LF, and the
majority of the file ends in CRLF.  I see no reason to keep this inconsistency,
but these line ending wars are going to drive me insane.
2017-08-29 14:43:40 -07:00
Yichi Chiang 6eb980db2f Update version.target to 5.0.5 as next patch version 2017-08-29 14:09:23 -07:00
Yichi Chiang 7f20756977 Merge branch 'release-5.0' of github.com:apple/foundationdb into release-5.0 2017-08-29 14:04:29 -07:00
Alvin Moore 6020d70863 Added trace event to track reboots initiated by ConsistencyCheck workload in simulation 2017-08-29 11:41:27 -07:00
Alvin Moore c95a1be5ec Add trace event for rebooting process during simulation for consistency check 2017-08-29 11:00:44 -07:00
Yichi Chiang 512f02bb8e Update GUID for release-5.0.4 2017-08-29 10:12:00 -07:00
Bhaskar Muppana 819566c166 keyFolderId is not used in File Backup anymore. We are instead using tag->uid based task validation. 2017-08-29 09:26:32 -07:00
Bhaskar Muppana df15dce000 Make BackupConfig subclass of KeyBackedConfig and remoe old way of Task
key validation.
2017-08-28 18:20:55 -07:00
A.J. Beamon 380b1791b6 Merge branch 'release-5.0' 2017-08-28 17:26:56 -07:00
A.J. Beamon 86774f6e42 Merge branch 'release-5.0' 2017-08-28 17:17:00 -07:00
A.J. Beamon 03478561b9 fix: Set lock aware at the transaction level for latency probe to avoid having to fill the shard cache every time. 2017-08-28 17:16:46 -07:00
Bhaskar Muppana 2ece658e60 Don't reuse backup logUid. 2017-08-28 16:50:39 -07:00
Bhaskar Muppana 32a690bce8 Generalize RestoreConfig class. 2017-08-28 16:48:26 -07:00
A.J. Beamon 9a0a3b6329 Merge commit '66528becb82d826e81fa644bb378212584ab580e' 2017-08-28 16:47:59 -07:00
Alec Grieser 38e5ac5095 Merge branch 'release-5.0' of github.com:apple/foundationdb into release-5.0 2017-08-28 16:46:20 -07:00
Yichi Chiang 6b2f1abbf8 release 5.0.4 preparation 2017-08-28 16:02:31 -07:00
Yichi Chiang 9fe927127f choose leader on the perferred process class 2017-08-28 14:41:04 -07:00
Bhaskar Muppana 8ac750672b Make RestoreTag and RestoreTags classes generic to be used with Backup. 2017-08-28 11:28:19 -07:00
Alvin Moore 44e0df78c5 Added support for tracking roles for simulation workers
Fixed the exclusion and inclusion address simulation API and integration within workloads
Added more information within trace events for simulation
2017-08-28 11:25:37 -07:00
Alvin Moore 581bd6c8ed Added option to delay the displaying of the simulation workers 2017-08-28 10:53:56 -07:00
Stephen Atherton 86d025f943 Bug fix: Metric base enabled state was not being initialized. Metrics are configured to be disabled upon construction, however if during construction it appears that a metric was initially enabled then a crash would result if the MetricsCollection global was not created. 2017-08-27 22:22:32 -07:00
Alec Grieser d5a198b547 Merge branch release-5.0' 2017-08-26 14:11:11 -07:00
Alec Grieser 300b5a17ed Merge branch 'release-5.0' 2017-08-25 18:55:33 -07:00
Alec Grieser dd635cb264 Merge branch 'release-5.0' of github.com:apple/foundationdb into release-5.0 2017-08-25 18:55:08 -07:00
Alec Grieser 9e2b0debcd made emboldening and capitalization consistent 2017-08-25 11:43:13 -07:00
Alec Grieser 9b10fb627c capitalize DEPRECATED 2017-08-25 11:39:08 -07:00
Alec Grieser fef18ee0a3 worked through some formatting issues 2017-08-25 11:38:21 -07:00
Alec Grieser 850ab5b64e MOAR NEWLINES 2017-08-25 11:36:33 -07:00
Alec Grieser 833c388d89 tried adding some newlines 2017-08-25 11:34:06 -07:00
Alec Grieser 9be6348580 added tuple spec to design section of repo 2017-08-25 11:30:46 -07:00
Evan Tschannen 272b4b984c fix: fixed a rare bug where we do not wait for a file in the process of being deleted to shutdown before rebooting a machine 2017-08-25 10:12:58 -07:00
Alec Grieser e31a7ff354 Merge branch 'release-5.0' 2017-08-24 17:07:35 -07:00
Alec Grieser 45ade048c4 use apple internal repos for node stuff 2017-08-24 16:30:39 -07:00
A.J. Beamon 45c0585891 Merge branch 'release-5.0' 2017-08-24 14:48:47 -07:00
Alec Grieser 63c2636ce5 Merge pull request #146 from cie/circus-retry-on-ssh-connection-closed
Retry SSH connections on connection failure
2017-08-24 14:23:08 -07:00
Alvin Moore 0c1be7537c Fixed OSX compilation warning about printf field value specification 2017-08-24 12:30:38 -07:00
A.J. Beamon 0d394a21fa Merge branch 'release-5.0' 2017-08-24 10:48:52 -07:00
Evan Tschannen 26a5b5e422 rollback workload now clogs the communication between one of the proxies and the tlogs, since that is what will cause a rollback 2017-08-23 16:08:13 -07:00
Alec Grieser b8c0b0e13f Merge branch 'release-5.0' 2017-08-23 15:53:58 -07:00
A.J. Beamon 4c706d33e9 Merge branch 'release-5.0' 2017-08-23 14:59:43 -07:00
Evan Tschannen be941b4bd1 sending void to committed could cause self to be deleted, so call cleanup before sending 2017-08-23 13:56:18 -07:00
Alvin Moore 7729f663e9 Ensured that the circus id is always lowercase 2017-08-23 13:45:00 -07:00
Evan Tschannen f9308b8fa6 Merge pull request #145 from cie/alexmiller/simrefactor
Refactor simulation to pull all configuration parameters into one struct.
2017-08-23 12:54:21 -07:00