Commit Graph

3626 Commits

Author SHA1 Message Date
Meng Xu 2b41ad5e57 TeamCollection: Pick server team randomly
Pick server team purely randomly instead of picking the least used one.
This is to avoid creating correlation in the server teams we pick when
new machines are added.

The logic is:
First pick the one random least used server as chosen server;
Then pick a machine team that has the server;
Then pick a server on each machine in the machine team.
We make sure the chosen server is picked.

Signed-off-by: Meng Xu <meng_xu@apple.com>
2018-11-28 15:57:53 -08:00
A.J. Beamon 97847f517b throw platform_error; -> throw platform_error();. Convert some spaces to tabs. 2018-11-28 12:56:57 -08:00
A.J. Beamon 287474052b
Merge pull request #954 from alecgrieser/go-fmt-fix
Remove whitespace to fix go fmt check
2018-11-28 12:12:19 -05:00
Alec Grieser 3a38288d35
remove whitespace to fix go fmt check 2018-11-28 09:09:35 -08:00
Meng Xu e4c9d4cbae TeamCollection: Build all machine teams first
Before we build server teams, we build the desired number of machine teams.
Then we pick the least used server, from which we pick the least used machine team.
Then we pick the least used server on each machine in the least used machine team to get the server team.

Note: The logic of building machine teams should be independent from server teams.

Signed-off-by: Meng Xu <meng_xu@apple.com>
2018-11-27 18:06:36 -08:00
Evan Tschannen 584e8b3a10
Merge pull request #953 from etschannen/master
fixed merge error with BlobStore
2018-11-27 17:10:52 -08:00
Evan Tschannen ed789f841b fixed merge error with BlobStore 2018-11-27 17:10:09 -08:00
Hu Sheng b36be7106d Update README.md (#946)
Update README.md
2018-11-27 15:16:43 -08:00
Evan Tschannen 4681bebe45
Merge pull request #952 from etschannen/master
Merge 6.0 into master
2018-11-27 14:42:49 -08:00
Evan Tschannen 1f3b6e8bdf Merge branch 'release-6.0'
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
#	fdbclient/BackupContainer.actor.cpp
#	fdbclient/BlobStore.actor.cpp
#	versions.target
2018-11-27 14:41:46 -08:00
Evan Tschannen 2a0d9cd621
Merge pull request #951 from etschannen/post-release-cleanup-6.0.16
Post release cleanup 6.0.16
2018-11-27 14:31:04 -08:00
Evan Tschannen 84e07de161 update installer WIX GUID following release 2018-11-27 14:29:52 -08:00
Evan Tschannen 4a1c1ad860 update versions target to 6.0.17 2018-11-27 14:29:52 -08:00
Evan Tschannen 07b62ca30b
Merge pull request #950 from etschannen/release-6.0
updated downloads for 6.0.16
2018-11-27 13:24:16 -08:00
Evan Tschannen 3215d5b3a2 updated downloads for 6.0.16 2018-11-27 13:23:32 -08:00
Evan Tschannen 3e4d6300fb
Merge pull request #949 from etschannen/prepare-release-6.0.16
update installer WIX GUID following release
2018-11-27 13:22:17 -08:00
Evan Tschannen e948aadba3 update installer WIX GUID following release 2018-11-27 13:21:37 -08:00
A.J. Beamon 17fc409f55
Merge pull request #948 from etschannen/release-6.0
updated release notes for 6.0.16
2018-11-27 16:14:03 -05:00
Evan Tschannen b6d9763469 updated release notes for 6.0.16 2018-11-27 13:10:14 -08:00
Evan Tschannen 8b021d38d8
Merge pull request #939 from satherton/backup-smaller-snapshot-folders
New backup folder scheme which results in far fewer kv range folders
2018-11-27 11:18:52 -08:00
Evan Tschannen 3f8593d2d9
Merge pull request #945 from satherton/fix-dns-issues
DNS would fail if IPv6 responses are received, and shortened tcp_resolver lifetime
2018-11-27 11:18:07 -08:00
A.J. Beamon 81240a60b1
Merge pull request #947 from ajbeamon/merge-release-6.0-into-master
Merge release-6.0 into master
2018-11-27 12:52:42 -05:00
A.J. Beamon 975711c389 Merge branch 'release-6.0' of github.com:apple/foundationdb
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
2018-11-27 09:50:39 -08:00
Meng Xu 4c2c65c1b3 TeamCollection: Replace TraceEvent with ASSERT
Replace one TraceEvent that never happens in correctness test with an ASSERT.
Change format in one comment.

Signed-off-by: Meng xu <meng_xu@apple.com>
2018-11-27 09:48:24 -08:00
John Brownlee 82354e755c Moves the create_server_environment logic in the dockerfile into a sourceable function.
Adds an explicit coordinator container in the docker-compose sample to support recent changes in the name generation in docker-compose.
Bump a dependency version in the dockerfile.
Improves handling of coordinator lookup failures in the docker scripts.
2018-11-27 09:12:04 -08:00
Alec Grieser d462315809
Merge pull request #908 from pjvds/patch-1
document Begin and End members of KeyRange
2018-11-27 09:02:50 -08:00
Pieter Joost van de Sande 080464ba38
specify type on both begin and end field 2018-11-27 17:11:42 +01:00
A.J. Beamon 458d1ba83d
Merge pull request #943 from etschannen/release-6.0
txsPopVersions is not needed in configurations without remote logs
2018-11-27 11:05:45 -05:00
Pieter Joost van de Sande 1c2de49bf2
match KeyRange docs with the rest of the docs 2018-11-27 08:19:46 +01:00
Stephen Atherton b91b26ef75 Attempt at workaround of a rare issue where long running backup processes reach a state where DNS resolution requests always time out but other processes on the same host can still resolve successfully. In case this was somehow caused by a bad boost tcp_resolver state, each request now uses a unique tcp_resolver instance. 2018-11-26 20:02:03 -08:00
Stephen Atherton 32f434b2ee Bug fix, dns resolution would throw an error if any of the results were IPv6 addresses, which could happen depending on the host networking configuration. 2018-11-26 19:53:46 -08:00
Alec Grieser d2a217fb39
Merge pull request #944 from ajbeamon/fix-bindingtester-key-alignment-nan-bug
The binding tester wouldn't align keys that had nan in them. Also, the…
2018-11-26 15:41:53 -08:00
A.J. Beamon d1e6c81d99 The binding tester wouldn't align keys that had nan in them. Also, the ruby tester generated a few keys with byte strings instead of unicode. 2018-11-26 15:31:40 -08:00
Evan Tschannen 530b5e3763 fix: do not track txsPopVersions unless there are remote logs to pop from 2018-11-26 15:17:17 -08:00
Alec Grieser ce65118300
Merge pull request #941 from ajbeamon/fix-c-bindings-cluster-creation
Don't use null as the cluster pointer if the cluster file path is null…
2018-11-26 14:55:31 -08:00
Henry 7122a88704
Merge pull request #937 from zma/bugfix-fix-typo-in-configuration-to-upstream
fix a typo in the document about fstab
2018-11-26 13:14:18 -08:00
Alec Grieser 19d382780d
Merge pull request #940 from ajbeamon/release-6.0
Fix error name for code 2021 (no_commit_version) in documentation
2018-11-26 13:13:46 -08:00
A.J. Beamon b19ab6d3dc Don't use null as the cluster pointer if the cluster file path is null because the Java bindings don't work with a null cluster pointer. 2018-11-26 11:52:35 -08:00
Evan Tschannen 512c00d304 added dump token trace events for storage server interfaces after rollbacks 2018-11-26 11:01:10 -08:00
A.J. Beamon 8697194d8e Fix error name for code 2021 (no_commit_version) in documentation 2018-11-26 10:49:15 -08:00
John Brownlee bbf7a447c5 Ensures that we set the cluster file contents in a consistent way in the docker image for the two different networking options.
Fixes some inaccurate text in the docker image README.
2018-11-25 16:47:25 -08:00
Stephen Atherton 3d68d6b994 Bug fix, clarified a comment. 2018-11-24 18:41:39 -08:00
Stephen Atherton 0610a19e4d Rewrote backup container unit test to use randomness to cover a wider variety of data patterns and edge cases. 2018-11-24 17:24:54 -08:00
Stephen Atherton aa648daabf Compile fix for linux, can't make a move iterator from a const container reference. 2018-11-23 12:49:10 -08:00
Stephen Atherton ec9410492d Changed backup folder scheme to use a much smaller number of unique folders for kv range files, which will speed up list and expire operations. The old scheme is still readable but will no longer be written except in simulation in order to test backward compatibility. 2018-11-23 05:23:56 -08:00
Meng Xu 5cbff740ca TeamCollection: Add ASSERT
Remove sanity check code for performance benefit.
Replace TraceEvent(SevError) with ASSERT.

Signed-off-by: Meng Xu <meng_xu@apple.com>
2018-11-21 13:16:52 -08:00
Meng Xu 8de031f9a6 TeamCollection: clang-format
Format the changes with git clang-format.
No functional changes.

Signed-off-by: Meng Xu <meng_xu@apple.com>
2018-11-21 11:18:26 -08:00
Eric Ma f3205d0eb6 fix a typo in the document about fstab 2018-11-21 15:03:18 +08:00
Meng Xu 12c3bec968 TeamCollection: Misc changes to resolve review comments
No functional change.
Report error in TraceEvent when invariant is violated.

Signed-off-by: Meng Xu <meng_xu@apple.com>
2018-11-19 20:44:52 -08:00
Meng Xu 52c6a66601 TeamCollection: Fix a bug introduced in code review
When we GetTeam, the data distribution actor may have zero teams in
rare situation in the ConfigureTest.txt test.
We should return an empty team in this situation instead of triggering error.

Signed-off-by: Meng Xu <meng_xu@apple.com>
2018-11-16 16:34:38 -08:00