Commit Graph

10025 Commits

Author SHA1 Message Date
Jingyu Zhou 9606a9f114 Minor format fix 2020-04-22 14:40:23 -07:00
A.J. Beamon ed54913973
Merge pull request #2976 from atn34/atn34/thread-local
Prevent main thread from destroying flatbuffers globals
2020-04-22 14:36:51 -07:00
Evan Tschannen 68906bf3c3 fix compile errors 2020-04-22 14:36:41 -07:00
Alex Miller 22fc77480f Merge remote-tracking branch 'upstream/release-6.2' into tls-permission-errors 2020-04-22 14:33:33 -07:00
Jingyu Zhou 74d8a2358d Add design doc for the new backup system
The new backup system introduces partitioned logs for storing mutations.
2020-04-22 14:26:06 -07:00
Evan Tschannen dfb0593ae6 increases priority of status requests 2020-04-22 14:24:59 -07:00
Evan Tschannen d0cc2a1ee4 added logging for parallel peeks on TLogs 2020-04-22 14:24:45 -07:00
Andrew Noyes c77650c7f3
Remove references to the late Makefile 2020-04-22 13:18:39 -07:00
Andrew Noyes a4434de4e8 Depend on actorcompiler.exe
Fixes #2985

This was originally done in 0443cf89ea,
and removed in 75f692b931, but I'm
not sure why it was removed. I'm guessing it was a botched merge
2020-04-22 12:12:48 -07:00
Markus Pilman 3024162196 Don't create package directories in source dir
This fixes one part of #2973
2020-04-22 11:55:26 -07:00
Evan Tschannen 5bec535aed
Merge pull request #2995 from atn34/atn34/gen-dev-docker-fixes
Don't simulate a TTY if clangd is invoked by IDE
2020-04-22 10:42:03 -07:00
Evan Tschannen 7feb10e5da
Merge pull request #2965 from tclinken/add-advanceversion-command
Added advanceversion command to fdbcli
2020-04-22 10:40:47 -07:00
Evan Tschannen 1c04aa5f0c
Merge pull request #2958 from AlvinMooreSr/go-getter
Get Go Dependencies Before Installing
2020-04-22 10:38:02 -07:00
Balachandar Namasivayam d5bef6fc32
Update fdbserver/DataDistribution.actor.cpp 2020-04-22 09:45:56 -07:00
A.J. Beamon 58fbd0e3a1
Merge pull request #2980 from alexmiller-apple/tls-background-eio-thread
Stop background eio threads on Net2::stop()
2020-04-22 08:17:59 -07:00
Meng Xu 9b4a1ca78f
Merge pull request #2966 from jzhou77/backup-cmd
Write range files' begin & end keys to backup's manifest file
2020-04-21 21:50:16 -07:00
Alex Miller c6df20a179
Use nullptr instead of NULL 2020-04-21 20:39:45 -07:00
Alex Miller 8b004fe8e3 Move stop callbacks to be called after run() in sim2. 2020-04-21 20:22:16 -07:00
A.J. Beamon b6e22b4a63
Merge pull request #2998 from jleach4/2822
Fix #2822: ByteArrayUtil does not use the now standard Unsafe Approach for byte[] comparisons
2020-04-21 14:36:13 -07:00
Vishesh Yadav 500a265d20 FlowTransport: Refactor and clear FailureStatus on destroy 2020-04-21 14:11:19 -07:00
Jingyu Zhou 6909f0b8fc Remove decodeRangeFileBlock from parallel restore
Reuse the one from fileBackup namespace.
2020-04-21 13:42:24 -07:00
Jingyu Zhou 9bfc5bbea8 Check RestorableFileSet's key ranges in simulation
Ranges written in the manifest file should match with actual file content.
2020-04-21 12:55:40 -07:00
John Leach 7f75eab32b Fix #2822: ByteArrayUtil does not use the now standard Unsafe Approach for byte[] comparisons. 2020-04-21 12:20:12 -07:00
A.J. Beamon 251e0201a1
Merge pull request #2809 from jleach4/2808
2808: Add caching for jmethodID, jfieldID and jclass for JNI for Java Binding
2020-04-21 11:52:13 -07:00
A.J. Beamon 4fbcca2e18
Merge pull request #2997 from apple/revert-2823-2822
Revert "Fix #2822: ByteArrayUtil does not use the now standard Unsafe Approach for byte[] comparisons."
2020-04-21 10:56:03 -07:00
A.J. Beamon 71c0d52868
Revert "Fix #2822: ByteArrayUtil does not use the now standard Unsafe Approach for byte[] comparisons." 2020-04-21 10:50:33 -07:00
Steve Atherton 83ea772252 Change simulation storage server selection back to random. 2020-04-21 10:47:15 -07:00
Andrew Noyes 7eaf8edb1d Don't simulate a TTY if clangd is invoked by IDE
Without this, vscode complains that clangd just crashes.

Also make ~/bin/clangd executable
2020-04-21 17:38:55 +00:00
John Leach d41dca5a94 2808: Add caching for jmethodID, jfieldID and jclass for JNI for Java Binding 2020-04-21 10:29:23 -07:00
A.J. Beamon e144949876
Merge pull request #2823 from jleach4/2822
Fix #2822: ByteArrayUtil does not use the now standard Unsafe Approach for byte[] comparisons.
2020-04-21 10:28:10 -07:00
John Leach 3834d8ecec Fix #2822: ByteArrayUtil does not use the now standard Unsafe Approach for byte[] comparisons. 2020-04-21 10:13:52 -07:00
Steve Atherton c80d28ac7e Added several assertions and removed some checks for situations in commitSubtree() which should no longer be possible due to recent changes. This is mainly to test assumptions being made in the commitSubtree() refactor in progress. Set simulation to always choose Redwood, will revert for PR. 2020-04-21 04:12:39 -07:00
Vishesh Yadav 92c86a7799 Merge remote-tracking branch 'apple/master' into task/issue-1017-slow-machine-poisoning 2020-04-21 03:36:19 -07:00
Jingyu Zhou 0e54f1ed31 Fix a test failure
minRestorableVersion may be decided by snapshot version and is larger than
contiguousLogEnd version.
2020-04-20 22:26:42 -07:00
Jingyu Zhou 0938e45c6a Set continuous version to invalidVersion when snapshot version is the target version 2020-04-20 22:26:42 -07:00
Jingyu Zhou 930b175c4c Add range files' key ranges to RestorableFileSet
Also add continuous logs' begin and end version in RestorableFileSet.
2020-04-20 22:26:42 -07:00
Jingyu Zhou a2b867c6f9 Fix a unit test failure 2020-04-20 22:26:42 -07:00
Jingyu Zhou 3063611355 Write range files' begin & end keys to manifest file
This information can be very useful in knowing the content in these files,
especially for restores.
2020-04-20 22:26:42 -07:00
Alex Miller a51746b307 Match 6.2.15's behavior in how invalid/unreadable/non-existent certs are handled.
Which is to proceed past Net2 creation, and allow certificate refresh to
try and eventually load valid certs.  Additionally, fix certificate
refeshing dieing if the certificate is not readable when first called.

In testing, I also found and fixed an issue where if a cert went from
unreadable to readable, we wouldn't reload the TLS context, due to not
considering it as a file change.
2020-04-20 21:38:04 -07:00
Alex Miller aec51a1d9c
Merge pull request #2968 from atn34/atn34/cmake-rpm
Prevent server and clients rpm's from conflicting
2020-04-20 21:22:05 -07:00
Alex Miller 8f08405df3
Merge pull request #2969 from atn34/atn34/write-to-clangd
Actually redirect to $HOME/bin/clangd
2020-04-20 21:21:25 -07:00
Alex Miller 20fe068863 Merge branch 'tls-background-eio-thread' into tls-permission-errors 2020-04-20 20:51:05 -07:00
Jingyu Zhou 0ae0a81edf Ensure mutation logs save complete version's data
I.e., do not allow the same version's mutations saved in different files.
Otherwise, we may have a file only contain a version's partial data, causing
continuity analysis of mutation logs to fail. This could also cause restore
failures, if the target version's mutations are stored in two files.

In the above description, all mutation logs refer to the same tag's logs.
2020-04-20 20:41:30 -07:00
Jingyu Zhou 61f0f44ab3 Fix comments on startVersion in BackupWorker 2020-04-20 17:07:50 -07:00
Xin Dong 49c6bb90ef
Merge pull request #2982 from alexmiller-apple/tls-log-settings
Log Net2TLSConfig with paths and settings when using TLS.
2020-04-20 15:46:26 -07:00
Meng Xu fb6aa09128
Merge pull request #2964 from jzhou77/backup-fix
Fix backup progress calculation
2020-04-20 13:41:03 -07:00
Alex Miller 75a4f3b7c9 Remove comment about ignoring runOnMainThread errors.
If we got an exception, it wouldn't be of type `Error` anyway, so
it seems like things would crash regardless.
2020-04-20 13:19:42 -07:00
Alex Miller e51d0365cf Cleanup: Use the shutdown callback for destroying TLS state. 2020-04-20 13:16:16 -07:00
Alex Miller da8e47ea25 Merge remote-tracking branch 'upstream/release-6.2' into tls-background-eio-thread 2020-04-20 13:15:05 -07:00
Alex Miller 5c399bf725 Move the callbacks into ::run() right before it exits.
stopped=true doesn't cause the run loop to immediately exit.
2020-04-20 13:14:19 -07:00