Commit Graph

1100 Commits

Author SHA1 Message Date
Evan Tschannen 470f5c01f3 changed remoteDcId to a vector of ids, to support future configurations where there are multiple remote databases 2018-02-26 17:09:09 -08:00
Evan Tschannen a67296b373 do not test fearless configurations to merge with master 2018-02-26 13:31:06 -08:00
Evan Tschannen 8e966fdf9c simulated cluster tests all configurations. Still needs to randomize the remote and satellite replication, along with them number of remote tlogs, log routers, and satellite tlogs 2018-02-26 13:15:44 -08:00
Evan Tschannen e3c6b66240 fix: do not commit more data after being stopped
fix: prioritize dc locality above exclusion to prevent being stuck after excluding all machines in a data center
2018-02-26 13:13:37 -08:00
Evan Tschannen 37a6a81634 Merge commit '7f6fc3e039c911cd84b8540f7f799fc38a1c1822' into feature-remote-logs
# Conflicts:
#	fdbserver/workloads/RestartRecovery.actor.cpp
2018-02-23 12:33:28 -08:00
Evan Tschannen 7f6fc3e039
Merge pull request #1 from apple/master
Merge master
2018-02-23 12:31:50 -08:00
Evan Tschannen cfcf98cffc fix: log router tags were not stored at a best location 2018-02-23 12:26:19 -08:00
Alvin Moore de1551c20d Merge branch 'release-5.1' 2018-02-23 08:24:06 -08:00
Alvin Moore 5b7af56b62 Fixed package makefile 2018-02-23 08:21:59 -08:00
Alvin Moore a1382895a6 Fixed headers and some whitespace 2018-02-23 04:50:23 -08:00
Evan Tschannen a49e43000e fix: did not peek from log routers correctly 2018-02-22 16:13:56 -08:00
Evan Tschannen 719bb5bd0c
Merge pull request #4 from bnamasivayam/getKeyServers-refactor
Having 1000 as the limit for Limit for GetKeyServerLocationsRequest s…
2018-02-22 12:39:48 -08:00
Balachandar Namasivayam 2fe2b522d5 Simple refactor of code... 2018-02-22 12:38:14 -08:00
Alec Grieser e1162e9238 Merge remote-tracking branch 'upstream/release-5.1' 2018-02-22 11:16:12 -08:00
Balachandar Namasivayam e2030db5a8 Refactor getKeyServers to be more readable.
Fix possible memory corruption by returning KeyRange instead of KeyRangeRef in getKeyServers.
Simplify getMasterProxies on DatabaseContext class.
2018-02-21 17:11:50 -08:00
Evan Tschannen 2aa273df96 addStorageServer was advancing tags too much because of read errors 2018-02-21 17:05:39 -08:00
Evan Tschannen 310f56d98a fix: tlogs was resized incorrectly 2018-02-21 15:28:02 -08:00
Alec Grieser d93f7aa87a
Merge pull request #2 from alecgrieser/node-build-env-vars
Build for NodeJS now allows setting distribution and repo URLs
2018-02-21 14:28:36 -08:00
Evan Tschannen ddb484143c fix: do not peek from remote logs if they are not fully recovered 2018-02-21 14:06:44 -08:00
Alec Grieser 3ade71d60f
Merge pull request #6 from alecgrieser/header-remove-whitespace
Some latent formatting changes
2018-02-21 12:28:04 -08:00
Alec Grieser 0bae9880f1 remove trailing whitespace from our copyright headers ; fixed formatting of python setup.py 2018-02-21 10:25:11 -08:00
Balachandar Namasivayam 6218934c7b Having 1000 as the limit for Limit for GetKeyServerLocationsRequest sometimes generate large packet warnings. Reduce it to 100.
Fix the bug where some of the key server shards may not be fetched.
2018-02-20 17:41:34 -08:00
Evan Tschannen 1dc6a8d4bd fix: the tlog can peek from log systems that have been recovered even if it does not match its recoverFrom set 2018-02-20 14:50:13 -08:00
Alec Grieser aadc06de99 Merge remote-tracking branch 'upstream/release-5.1' 2018-02-20 14:28:29 -08:00
John Brownlee d8973c0867
Merge pull request #1 from alecgrieser/bindings-format
Reformat the go and python bindings
2018-02-20 14:09:29 -08:00
Evan Tschannen 9ea963ddd6 fix: the master did not detect core state changes if it changed while writing
fix: do not attempt to use three_data_hall when in a fearless deployment
fix: log router tags are ephemeral and can be cleared after every recovery
2018-02-19 16:49:57 -08:00
Alec Grieser 9f117426bf allow node repo and distribution URLs to be set through make/env variables 2018-02-19 13:25:14 -08:00
Alec Grieser 1c1ae7d70e Merge remote-tracking branch 'upstream/release-5.1' into bindings-format 2018-02-19 12:37:06 -08:00
Evan Tschannen 1b5628d2c5 testing a single configured fearless setup in simulated cluster
consolidated simulation connection disablers into one call in the tester
automatically reconfigure from a fearless setup in simulation
2018-02-18 12:59:43 -08:00
Evan Tschannen 31b89a638f added satellite_none and remote_none options to unconfigure from a fearless setup
fix: log_router configuration was broken
2018-02-17 13:51:17 -08:00
Stephen Atherton a9a9590058 Merge branch 'release-5.1' of github.com:apple/foundationdb into release-5.1 2018-02-16 19:44:36 -08:00
Stephen Atherton 54fc81b260 Improved backup error reporting in backup status. The most recent error for each error type is reported along with how long ago the error occurred, and errors are divided into two categories based on whether or not they occurred since the most recent backup progress. 2018-02-16 19:38:31 -08:00
Evan Tschannen dc93759e15 suppressed trace events that are spammy 2018-02-16 16:01:19 -08:00
Bhaskar Muppana d48417da0d Merge branch 'release-5.1' 2018-02-16 13:36:25 -08:00
Bhaskar Muppana fe3f0d9343 Bumping version to next minor release - 5.1.3 2018-02-16 13:33:48 -08:00
Balachandar Namasivayam 2eeb714c4b Trace memory usage of individual FastAllocator of different sizes as part of ProcessMetrics. 2018-02-16 13:30:00 -08:00
Bhaskar Muppana 816a609cb9 Generate new WIX Installer GUID - post release 2018-02-16 13:13:23 -08:00
Bhaskar Muppana 1debc59cb5 Generate new WIX Installer GUID 2018-02-16 11:06:01 -08:00
Evan Tschannen 8c53483838 fix: log ranges were not being cleared correctly 2018-02-16 10:27:10 -08:00
A.J. Beamon ceec580d2f fdbcli considered a backup running if the 'running_backup' field was present, not if it was true. 2018-02-16 10:09:03 -08:00
Evan Tschannen cb25564d38 simulated cluster supports fearless configurations
removed unused simulation variables
run the simulation with only 1 coordinator most of the time, since we protect the coordinator from being killed, and protecting too many things is bad for simulation
2018-02-15 18:32:39 -08:00
A.J. Beamon 814ae16016 Add destination tokens to Net2_LargePacket trace events. Add backtrace when a sent packet is too large. 2018-02-15 14:54:35 -08:00
Evan Tschannen ad19d3926b fix: make sure there are enough machines in each dc to support triple replication for the configure workload 2018-02-14 17:06:22 -08:00
Evan Tschannen 5303962af6 re-enabled configure database and remove servers safely, even though they do not work with fearless 2018-02-14 16:07:23 -08:00
Alex Miller 4768c5a772 Merge pull request #236 from cie/alexmiller/vishy-doc-changes
Fix a couple points in the pie storage comparison about Redis.
2018-02-14 15:28:32 -08:00
Evan Tschannen ead3892e77 fix: prevent fast spin for future version 2018-02-14 15:16:18 -08:00
Evan Tschannen 110309272c fix: do not count a server as read-write unless it has a recent version, because it could have been readable a long time ago 2018-02-14 15:09:19 -08:00
Balachandar Namasivayam f320b1b347 Change ConnectionClosed TraceEvent severity from SevError to SevWarnAlways. 2018-02-14 12:25:54 -08:00
A.J. Beamon 3300c2efed Enable slow task profiling in the consistency check processes. 2018-02-14 09:50:12 -08:00
Evan Tschannen d2b0c07558 storage servers continue to attempt to pop old tags after the log system updates 2018-02-13 18:34:13 -08:00