Evan Tschannen
e951df95b7
when doing data movement where one region has the data and the other doesn’t, first move a single replica to the other region to save WAN bandwidth
2018-06-19 23:15:30 -07:00
Evan Tschannen
e7999e7a3e
log routers need to use parallelGetMore when peeking because the latency to the primary datacenter makes the bandwidth of normal peeking too low.
2018-06-19 22:16:45 -07:00
Evan Tschannen
df4c445e25
fix: we need to return from commit when stopped
2018-06-18 22:12:46 -07:00
Evan Tschannen
403fb5a2e9
removed unnecessary suppressFor
2018-06-18 17:59:29 -07:00
Evan Tschannen
eaca0fb2ea
fixed incorrect priorities on the log router
2018-06-18 17:36:40 -07:00
Evan Tschannen
0bdd25df23
ratekeeper does not control on remote storage servers
2018-06-18 17:23:55 -07:00
Evan Tschannen
b79feaddd3
added a hard memory limit to the TLog to prevent it from running out of memory. Because remote logs are not ratekeeper controlled this is their only protection
2018-06-18 17:22:40 -07:00
Evan Tschannen
127c2ad775
fix: prevent adding the same location multiple times for satellite logs
2018-06-18 15:27:28 -07:00
Evan Tschannen
50e1e03130
fix: for configurations with anti-quorums to work, the push actors need to be put in the proxy’s actor collection
2018-06-18 15:25:54 -07:00
Evan Tschannen
1ccfb3a0f4
fix: log_anti_quorum was always 0 in simulation
...
removed durableStorageQuorum, because it is no longer a useful configuration parameter
2018-06-18 10:24:57 -07:00
Evan Tschannen
e8c462882b
re-added remote_logs as a parameter, because it could be useful to have a different number of logs between when recruited as primary and remote
2018-06-18 10:22:34 -07:00
Evan Tschannen
6cd7627113
updated release notes
2018-06-17 20:29:15 -07:00
Evan Tschannen
0913368651
added usable_regions to specify if we will replicate into a remote region
...
remote replication defaults to the primary replication
removed remote_logs, because they should be specified as an override in the regions object
2018-06-17 19:31:15 -07:00
Evan Tschannen
7aef5ec6f1
got rid of persistUnrecoveredBefore
...
added persistLocality
2018-06-17 14:44:33 -07:00
Evan Tschannen
f637c680f1
fix: populateSatelliteTagLocations was broken
...
fix: satellites do not index the upgraded locality
2018-06-17 13:29:17 -07:00
Evan Tschannen
6931a00993
satellite log push locations are static per tag, which will reduce the number of tags each satellite log has to index, and reduce the proxy cpu when calculating push locations
2018-06-16 17:39:02 -07:00
Evan Tschannen
f694f7c9ca
removed hasBestPolicy
2018-06-15 12:36:19 -07:00
Evan Tschannen
0d87186821
use a specific locality for satellites
2018-06-15 11:06:38 -07:00
Evan Tschannen
09c92c887b
fix: extraTlogEligibleMachines was not calculated correctly in all cases
2018-06-15 10:23:33 -07:00
Evan Tschannen
246abd1207
added full_replication to status
2018-06-14 21:14:18 -07:00
Evan Tschannen
284233baa1
added a key in the database with the locality of the current master
2018-06-14 19:36:02 -07:00
Evan Tschannen
0103b6f5ed
added datacenter_version_difference to status
2018-06-14 19:09:25 -07:00
Evan Tschannen
99e21c869c
fixed a number of status calculations, and re-enabled the status workload
2018-06-14 17:58:57 -07:00
Evan Tschannen
feb8578c06
fix: only flush and exit in simulation
2018-06-14 13:48:30 -07:00
Evan Tschannen
0c6825eb43
allow multiple regions with the same priority
...
configurations must have at least one region with non-negative priority
2018-06-14 12:59:55 -07:00
Evan Tschannen
26b7dd32da
fix: cluster controller did not respect usable dcs
2018-06-14 12:56:48 -07:00
Evan Tschannen
1796e00149
do not pop tags from logs that are not indexing that tag
2018-06-14 12:55:33 -07:00
Evan Tschannen
fbb3f85c74
fix: logsKey was not being updated properly
2018-06-14 12:54:39 -07:00
Evan Tschannen
3bdbf89f24
Merge branch 'master' into feature-remote-logs
...
# Conflicts:
# fdbclient/DatabaseConfiguration.cpp
# fdbserver/SimulatedCluster.actor.cpp
2018-06-13 18:35:28 -07:00
Evan Tschannen
0059690502
Merge pull request #483 from alexmiller-apple/multidc_dcvector
...
MultiDC: Regions JSON should represent datacenters as an array.
2018-06-13 18:33:04 -07:00
Evan Tschannen
a89a09d86f
merge master
2018-06-13 18:16:03 -07:00
Evan Tschannen
889889323e
The master will tell the cluster controller if it is going to take a long time to recruit new logs in its DC; the cluster controller can determine if the other DC would be better and recruit there.
...
The cluster controller will not switch to the other data center if remote logs are too far behind.
We will not recruit in DCs with negative priority.
2018-06-13 18:14:14 -07:00
Alex Miller
0042294566
MultiDC: Serialized JSON represents DC and Satellites in same array.
...
With a `"satellite": 1` property that differentiates them. "satellite" will
likely also be deprecated in the future, but this is closer to what the final
serialized form will look like.
2018-06-13 17:55:55 -07:00
Evan Tschannen
2eb707c73b
Merge pull request #487 from richardalow/master
...
Merge release-5.2 into master
2018-06-13 12:33:05 -07:00
Richard Low
46855f5423
Remove 5.2 release notes
2018-06-13 10:12:43 -07:00
Evan Tschannen
cad435499e
Merge pull request #485 from alexmiller-apple/feature-remotelogs-improvements
...
Feature remotelogs improvements
2018-06-13 09:52:08 -07:00
Richard Low
39894ea798
Merge remote-tracking branch 'apple/release-5.2'
2018-06-12 18:31:20 -07:00
Richard Low
497026003e
Merge pull request #486 from richardalow/release-5.2
...
Release 5.2
2018-06-12 18:26:59 -07:00
Richard Low
a52430ff58
Bump versions.target
2018-06-12 18:25:41 -07:00
Richard Low
a3ca2204b1
Update MSI package after 5.2.4 release
2018-06-12 18:24:51 -07:00
Alex Miller
8518f6a8a8
smartQuorum shouldn't return if more responses are desired than futures provided.
2018-06-12 16:50:25 -07:00
Alex Miller
6c2cb25c53
Rename BestOtherFit -> OkayFit.
...
The previous order of fitness was
BestFit > GoodFit > BestOtherFit > ...
which is baffling. It's now:
BestFit > GoodFit > OkayFit > ...
which won't break anyone's expectations.
2018-06-12 16:50:25 -07:00
Alex Miller
fcfa00928b
Make RecoveryState an enum class.
...
This means that all the == 7 or != 0 checks go away, and explicit names must be used.
2018-06-12 16:50:25 -07:00
Richard Low
6292d021dc
Merge pull request #484 from richardalow/release-5.2
...
Release 5.2
2018-06-12 16:48:47 -07:00
Alex Miller
ac1fc3660d
MultiDC: Regions JSON should represent datacenters as an array.
...
This is so that the serialized format released in 6.0 will already include a
required change, which is to support >1 DC per region.
2018-06-12 16:18:54 -07:00
Richard Low
b46862faa8
Update MSI package for 5.2.4 release
2018-06-12 13:57:07 -07:00
Richard Low
0bc629ce73
Update download links for 5.2.4 release
2018-06-12 13:55:12 -07:00
Richard Low
d1a0da995c
Merge remote-tracking branch 'apple/release-5.2' into release-5.2
2018-06-12 13:32:51 -07:00
Steve Atherton
75de22bb08
Merge pull request #482 from satherton/release-5.2
...
Reduce default backup parallel tasks to decrease memory usage.
2018-06-12 13:20:30 -07:00
Steve Atherton
731c3b38e8
Merge pull request #481 from satherton/release-5.2
...
Reduce backup parallel tasks to decrease memory usage.
2018-06-12 13:16:24 -07:00