Commit Graph

2097 Commits

Author SHA1 Message Date
A.J. Beamon afdd992fca Move the computation of total unused allocated memory into FastAlloc.cpp 2018-06-20 14:33:59 -07:00
A.J. Beamon 4e4bc19c73 Add new status field to documentation schema 2018-06-20 14:12:51 -07:00
A.J. Beamon 618952f005 Fix whitespace mismatch 2018-06-20 12:12:26 -07:00
A.J. Beamon 62eeefcc8a Update status schema with new field 2018-06-20 12:09:28 -07:00
A.J. Beamon 5e81f4ac7e Track unused allocated memory in ProcessMetrics and report it in status. 2018-06-20 10:10:51 -07:00
Alex Miller 61031a397f Fix two issues from .actor.g.cpp move from commit aead2586
1. "Compiling     file" messages were lost, and have been returned

2. Dependency information for actor compiled files were lost, as it turned out
to be location dependant in a way that wasn't previously understood.
Dependencies has been verified to work correctly now.
2018-06-19 17:46:42 -07:00
Evan Tschannen 56b9fb09f0
Merge pull request #503 from etschannen/feature-remote-logs
fixed a bug with the tlog memory limit
2018-06-18 22:14:26 -07:00
Evan Tschannen df4c445e25 fix: we need to return from commit when stopped 2018-06-18 22:12:46 -07:00
Evan Tschannen 403fb5a2e9 removed unnecessary suppressFor 2018-06-18 17:59:29 -07:00
Alex Miller abf0e68364
Merge pull request #502 from etschannen/feature-remote-logs
fixed a few performance issues with multiple DC deployments
2018-06-18 17:46:37 -07:00
Evan Tschannen eaca0fb2ea fixed incorrect priorities on the log router 2018-06-18 17:36:40 -07:00
Evan Tschannen 0bdd25df23 ratekeeper does not control on remote storage servers 2018-06-18 17:23:55 -07:00
Evan Tschannen b79feaddd3 added a hard memory limit to the TLog to prevent it from running out of memory. Because remote logs are not ratekeeper controlled this is their only protection 2018-06-18 17:22:40 -07:00
Steve Atherton b078c0e859
Merge pull request #501 from alexmiller-apple/gcpptoobj
Move .actor.g.cpp files to .obj/
2018-06-18 17:12:22 -07:00
Alex Miller aead2586f4 Move .actor.g.cpp files to .obj.
This means that grep over our source tree doesn't return 2x the results.
2018-06-18 16:47:27 -07:00
Balachandar Namasivayam 1ed9df0825
Merge pull request #500 from etschannen/feature-remote-logs
Fixed an issue with setting log anti-quorums
2018-06-18 15:57:07 -07:00
Evan Tschannen 127c2ad775 fix: prevent adding the same location multiple times for satellite logs 2018-06-18 15:27:28 -07:00
Evan Tschannen 50e1e03130 fix: for configurations with anti-quorums to work, the push actors need to be put in the proxy’s actor collection 2018-06-18 15:25:54 -07:00
Alex Miller a3601af2a6
Merge pull request #435 from Liuchang0812/wip-rename-future-in-c-binding
rename opaque types in c binding to avoid conflicts with the standard library
2018-06-18 13:55:33 -07:00
Balachandar Namasivayam 01699c4377
Merge pull request #494 from etschannen/feature-remote-logs
a variety of multi-dc improvements
2018-06-18 11:38:37 -07:00
Evan Tschannen 1ccfb3a0f4 fix: log_anti_quorum was always 0 in simulation
removed durableStorageQuorum, because it is no longer a useful configuration parameter
2018-06-18 10:24:57 -07:00
Evan Tschannen e8c462882b re-added remote_logs as a parameter, because it could be useful to have a different number of logs between when recruited as primary and remote 2018-06-18 10:22:34 -07:00
Evan Tschannen 6cd7627113 updated release notes 2018-06-17 20:29:15 -07:00
Evan Tschannen 0913368651 added usable_regions to specify if we will replicate into a remote region
remote replication defaults to the primary replication
removed remote_logs, because they should be specified as an override in the regions object
2018-06-17 19:31:15 -07:00
Evan Tschannen 7aef5ec6f1 got rid of persistUnrecoveredBefore
added persistLocality
2018-06-17 14:44:33 -07:00
Evan Tschannen f637c680f1 fix: populateSatelliteTagLocations was broken
fix: satellites do not index the upgraded locality
2018-06-17 13:29:17 -07:00
Evan Tschannen 6931a00993 satellite log push locations are static per tag, which will reduce the number of tags each satellite log has to index, and reduce the proxy cpu when calculating push locations 2018-06-16 17:39:02 -07:00
Evan Tschannen b0f71ae108
Merge pull request #492 from etschannen/feature-remote-logs
Fixed a variety of miscellaneous issues
2018-06-15 16:00:07 -07:00
Evan Tschannen f694f7c9ca removed hasBestPolicy 2018-06-15 12:36:19 -07:00
Evan Tschannen 0d87186821 use a specific locality for satellites 2018-06-15 11:06:38 -07:00
Evan Tschannen 09c92c887b fix: extraTlogEligibleMachines was not calculated correctly in all cases 2018-06-15 10:23:33 -07:00
Evan Tschannen 246abd1207 added full_replication to status 2018-06-14 21:14:18 -07:00
Evan Tschannen 284233baa1 added a key in the database with the locality of the current master 2018-06-14 19:36:02 -07:00
Evan Tschannen 0103b6f5ed added datacenter_version_difference to status 2018-06-14 19:09:25 -07:00
Evan Tschannen 99e21c869c fixed a number of status calculations, and re-enabled the status workload 2018-06-14 17:58:57 -07:00
Evan Tschannen feb8578c06 fix: only flush and exit in simulation 2018-06-14 13:48:30 -07:00
Evan Tschannen 0c6825eb43 allow multiple regions with the same priority
configurations must have at least one region with non-negative priority
2018-06-14 12:59:55 -07:00
Evan Tschannen 26b7dd32da fix: cluster controller did not respect usable dcs 2018-06-14 12:56:48 -07:00
Evan Tschannen 1796e00149 do not pop tags from logs that are not indexing that tag 2018-06-14 12:55:33 -07:00
Evan Tschannen fbb3f85c74 fix: logsKey was not being updated properly 2018-06-14 12:54:39 -07:00
Alex Miller 73f0165491
Merge pull request #489 from etschannen/feature-remote-logs
Do not make a DC primary if it is too far behind the other DC
2018-06-14 10:37:18 -07:00
Evan Tschannen 3bdbf89f24 Merge branch 'master' into feature-remote-logs
# Conflicts:
#	fdbclient/DatabaseConfiguration.cpp
#	fdbserver/SimulatedCluster.actor.cpp
2018-06-13 18:35:28 -07:00
Evan Tschannen 0059690502
Merge pull request #483 from alexmiller-apple/multidc_dcvector
MultiDC: Regions JSON should represent datacenters as an array.
2018-06-13 18:33:04 -07:00
Evan Tschannen a89a09d86f merge master 2018-06-13 18:16:03 -07:00
Evan Tschannen 889889323e The master will tell the cluster controller if it is going to take a long time to recruit new logs in its DC; the cluster controller can determine if the other DC would be better and recruit there.
The cluster controller will not switch to the other data center if remote logs are too far behind.
We will not recruit in DCs with negative priority.
2018-06-13 18:14:14 -07:00
Alex Miller 0042294566 MultiDC: Serialized JSON represents DC and Satellites in same array.
With a `"satellite": 1` property that differentiates them.  "satellite" will
likely also be deprecated in the future, but this is closer to what the final
serialized form will look like.
2018-06-13 17:55:55 -07:00
Evan Tschannen 2eb707c73b
Merge pull request #487 from richardalow/master
Merge release-5.2 into master
2018-06-13 12:33:05 -07:00
Richard Low 46855f5423 Remove 5.2 release notes 2018-06-13 10:12:43 -07:00
Evan Tschannen cad435499e
Merge pull request #485 from alexmiller-apple/feature-remotelogs-improvements
Feature remotelogs improvements
2018-06-13 09:52:08 -07:00
Chang Liu 5492ea7f8c rename opaque types in c binding to avoid conflicts with the standard library
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2018-06-13 11:09:42 +08:00