Commit Graph

2083 Commits

Author SHA1 Message Date
Evan Tschannen e951df95b7 when doing data movement where one region has the data and the other doesn’t, first move a single replica to the other region to save WAN bandwidth 2018-06-19 23:15:30 -07:00
Evan Tschannen e7999e7a3e log routers need to use parallelGetMore when peeking because the latency to the primary datacenter makes the bandwidth of normal peeking too low. 2018-06-19 22:16:45 -07:00
Evan Tschannen df4c445e25 fix: we need to return from commit when stopped 2018-06-18 22:12:46 -07:00
Evan Tschannen 403fb5a2e9 removed unnecessary suppressFor 2018-06-18 17:59:29 -07:00
Evan Tschannen eaca0fb2ea fixed incorrect priorities on the log router 2018-06-18 17:36:40 -07:00
Evan Tschannen 0bdd25df23 ratekeeper does not control on remote storage servers 2018-06-18 17:23:55 -07:00
Evan Tschannen b79feaddd3 added a hard memory limit to the TLog to prevent it from running out of memory. Because remote logs are not ratekeeper controlled this is their only protection 2018-06-18 17:22:40 -07:00
Evan Tschannen 127c2ad775 fix: prevent adding the same location multiple times for satellite logs 2018-06-18 15:27:28 -07:00
Evan Tschannen 50e1e03130 fix: for configurations with anti-quorums to work, the push actors need to be put in the proxy’s actor collection 2018-06-18 15:25:54 -07:00
Evan Tschannen 1ccfb3a0f4 fix: log_anti_quorum was always 0 in simulation
removed durableStorageQuorum, because it is no longer a useful configuration parameter
2018-06-18 10:24:57 -07:00
Evan Tschannen e8c462882b re-added remote_logs as a parameter, because it could be useful to have a different number of logs between when recruited as primary and remote 2018-06-18 10:22:34 -07:00
Evan Tschannen 6cd7627113 updated release notes 2018-06-17 20:29:15 -07:00
Evan Tschannen 0913368651 added usable_regions to specify if we will replicate into a remote region
remote replication defaults to the primary replication
removed remote_logs, because they should be specified as an override in the regions object
2018-06-17 19:31:15 -07:00
Evan Tschannen 7aef5ec6f1 got rid of persistUnrecoveredBefore
added persistLocality
2018-06-17 14:44:33 -07:00
Evan Tschannen f637c680f1 fix: populateSatelliteTagLocations was broken
fix: satellites do not index the upgraded locality
2018-06-17 13:29:17 -07:00
Evan Tschannen 6931a00993 satellite log push locations are static per tag, which will reduce the number of tags each satellite log has to index, and reduce the proxy cpu when calculating push locations 2018-06-16 17:39:02 -07:00
Evan Tschannen f694f7c9ca removed hasBestPolicy 2018-06-15 12:36:19 -07:00
Evan Tschannen 0d87186821 use a specific locality for satellites 2018-06-15 11:06:38 -07:00
Evan Tschannen 09c92c887b fix: extraTlogEligibleMachines was not calculated correctly in all cases 2018-06-15 10:23:33 -07:00
Evan Tschannen 246abd1207 added full_replication to status 2018-06-14 21:14:18 -07:00
Evan Tschannen 284233baa1 added a key in the database with the locality of the current master 2018-06-14 19:36:02 -07:00
Evan Tschannen 0103b6f5ed added datacenter_version_difference to status 2018-06-14 19:09:25 -07:00
Evan Tschannen 99e21c869c fixed a number of status calculations, and re-enabled the status workload 2018-06-14 17:58:57 -07:00
Evan Tschannen feb8578c06 fix: only flush and exit in simulation 2018-06-14 13:48:30 -07:00
Evan Tschannen 0c6825eb43 allow multiple regions with the same priority
configurations must have at least one region with non-negative priority
2018-06-14 12:59:55 -07:00
Evan Tschannen 26b7dd32da fix: cluster controller did not respect usable dcs 2018-06-14 12:56:48 -07:00
Evan Tschannen 1796e00149 do not pop tags from logs that are not indexing that tag 2018-06-14 12:55:33 -07:00
Evan Tschannen fbb3f85c74 fix: logsKey was not being updated properly 2018-06-14 12:54:39 -07:00
Evan Tschannen 3bdbf89f24 Merge branch 'master' into feature-remote-logs
# Conflicts:
#	fdbclient/DatabaseConfiguration.cpp
#	fdbserver/SimulatedCluster.actor.cpp
2018-06-13 18:35:28 -07:00
Evan Tschannen 0059690502
Merge pull request #483 from alexmiller-apple/multidc_dcvector
MultiDC: Regions JSON should represent datacenters as an array.
2018-06-13 18:33:04 -07:00
Evan Tschannen a89a09d86f merge master 2018-06-13 18:16:03 -07:00
Evan Tschannen 889889323e The master will tell the cluster controller if it is going to take a long time to recruit new logs in its DC; the cluster controller can determine if the other DC would be better and recruit there.
The cluster controller will not switch to the other data center if remote logs are too far behind.
We will not recruit in DCs with negative priority.
2018-06-13 18:14:14 -07:00
Alex Miller 0042294566 MultiDC: Serialized JSON represents DC and Satellites in same array.
With a `"satellite": 1` property that differentiates them.  "satellite" will
likely also be deprecated in the future, but this is closer to what the final
serialized form will look like.
2018-06-13 17:55:55 -07:00
Evan Tschannen 2eb707c73b
Merge pull request #487 from richardalow/master
Merge release-5.2 into master
2018-06-13 12:33:05 -07:00
Richard Low 46855f5423 Remove 5.2 release notes 2018-06-13 10:12:43 -07:00
Evan Tschannen cad435499e
Merge pull request #485 from alexmiller-apple/feature-remotelogs-improvements
Feature remotelogs improvements
2018-06-13 09:52:08 -07:00
Richard Low 39894ea798 Merge remote-tracking branch 'apple/release-5.2' 2018-06-12 18:31:20 -07:00
Richard Low 497026003e
Merge pull request #486 from richardalow/release-5.2
Release 5.2
2018-06-12 18:26:59 -07:00
Richard Low a52430ff58 Bump versions.target 2018-06-12 18:25:41 -07:00
Richard Low a3ca2204b1 Update MSI package after 5.2.4 release 2018-06-12 18:24:51 -07:00
Alex Miller 8518f6a8a8 smartQuorum shouldn't return if more responses are desired than futures provided. 2018-06-12 16:50:25 -07:00
Alex Miller 6c2cb25c53 Rename BestOtherFit -> OkayFit.
The previous order of fitness was

  BestFit > GoodFit > BestOtherFit > ...

which is baffling.  It's now:

  BestFit > GoodFit > OkayFit > ...

which won't break anyone's expectations.
2018-06-12 16:50:25 -07:00
Alex Miller fcfa00928b Make RecoveryState an enum class.
This means that all the == 7 or != 0 checks go away, and explicit names must be used.
2018-06-12 16:50:25 -07:00
Richard Low 6292d021dc
Merge pull request #484 from richardalow/release-5.2
Release 5.2
2018-06-12 16:48:47 -07:00
Alex Miller ac1fc3660d MultiDC: Regions JSON should represent datacenters as an array.
This is so that the serialized format released in 6.0 will already include a
required change, which is to support >1 DC per region.
2018-06-12 16:18:54 -07:00
Richard Low b46862faa8 Update MSI package for 5.2.4 release 2018-06-12 13:57:07 -07:00
Richard Low 0bc629ce73 Update download links for 5.2.4 release 2018-06-12 13:55:12 -07:00
Richard Low d1a0da995c Merge remote-tracking branch 'apple/release-5.2' into release-5.2 2018-06-12 13:32:51 -07:00
Steve Atherton 75de22bb08
Merge pull request #482 from satherton/release-5.2
Reduce default backup parallel tasks to decrease memory usage.
2018-06-12 13:20:30 -07:00
Steve Atherton 731c3b38e8
Merge pull request #481 from satherton/release-5.2
Reduce backup parallel tasks to decrease memory usage.
2018-06-12 13:16:24 -07:00