Commit Graph

3635 Commits

Author SHA1 Message Date
Alex Miller 0d06c08350
Merge pull request #993 from szhou1234/deprecate_dmcs
Prefer MCS instead of DMCS which has been deprecated in Mono
2019-01-02 17:37:01 -06:00
Andrew Noyes bce5b03340 Fix whitespace 2019-01-02 15:24:11 -08:00
Alec Grieser d9584aeddf
Merge pull request #994 from ajbeamon/fix-add-paretheses-to-bitwise-ops
Add parentheses to bitwise ops (turned up by clang after recent change)
2019-01-02 15:11:24 -08:00
Alex Miller 665f33a194
Removing whitespace introduced by GitHub UI 2019-01-02 17:11:11 -06:00
Alex Miller df810d181f
Change required CMake version to 3.12 2019-01-02 17:09:21 -06:00
mpilman a31df1b0a6 Addressed comments from pull requests
- Moved some larger sections in CMakeLists.txt into separate files
- Fixed an include issue on OS X
- Fixed boost version
- Use PROJECT_VERSION by default instead of using versions.target
2019-01-02 13:32:26 -08:00
A.J. Beamon d8f33a2419 Add parentheses to bitwise ops (turned up by clang after recent change) 2019-01-02 10:15:59 -08:00
Simon Zhou f8657f5cde Prefer MCS instead of DMCS which has been deprecated in Mono 2019-01-01 18:53:54 -08:00
Alex Miller 73f53f9861
Merge pull request #991 from atn34/replace-ampersand-operator
Replace & operator with variadic function
2018-12-30 22:51:59 -06:00
Alex Miller f02426938d
Merge pull request #992 from szhou1234/fix_null
Avoid null check to get rid of build error on Mac
2018-12-30 22:19:35 -06:00
Simon Zhou 7edf221986 Avoid null check 2018-12-28 13:09:04 -08:00
anoyes 6a4d87802b Replace & operator with variadic function 2018-12-28 11:33:42 -08:00
Stephen Atherton 928876be81 Backup dumpFileList() can now take a version range. 2018-12-21 22:42:29 -08:00
Stephen Atherton f64d5321e9 Backup describe, expire, and delete will now clearly indicate when there is no backup at the given URL. 2018-12-20 18:05:23 -08:00
anoyes 1bca665b29 Document --trace_format flag 2018-12-20 16:22:41 -08:00
anoyes 03b48fb452 s/--trace-format/--trace_format/ 2018-12-20 15:58:26 -08:00
anoyes b8df5acc15 Add --trace_format flag to fdbserver 2018-12-20 15:02:01 -08:00
Steve Atherton 9881b1d074
Merge pull request #977 from alexmiller-apple/abspath
Use abspath when dealing with the simulator file-cache
2018-12-20 14:56:38 -08:00
Xin Dong 6d278e466b
Merge pull request #985 from dongxinEric/docs/clarifications-for-tls-docs
Resolves issue #984: made some clarifications in TLS docs.
2018-12-20 14:33:06 -08:00
Alex Miller 464dc6c7b2
Apply suggestions from code review
Co-Authored-By: dongxinEric <jiangzian1987dx@gmail.com>
2018-12-20 14:31:11 -08:00
Xin Dong b00b07c5ed Resolves #984: made some clarifications in TLS docs. 2018-12-20 14:09:56 -08:00
anoyes 33a4aac249 Fix build 2018-12-20 11:55:59 -08:00
anoyes 4b31d209da Emit valid json for unprintable characters 2018-12-20 11:43:18 -08:00
Stephen Atherton 567a7bd58a Print a final deleted object count at the end of backup deletion. 2018-12-20 01:24:31 -08:00
Stephen Atherton 354abebf64 Added progress reporting to backup expiration. Simplified backup delete progress. 2018-12-20 00:23:26 -08:00
Stephen Atherton fcb34a8768 In backup describe, when not using the original cluster to resolve versions to date/time strings the versions will be converted to approximate day deltas from maxLogEndVersion (if available) using core_versionspersecond. 2018-12-19 16:53:39 -08:00
Stephen Atherton 00568f4011 Error code was misleading, added comment. 2018-12-19 13:14:48 -08:00
Stephen Atherton fd4a62fbfd Backup expire will fail earlier if force option is needed but not specified. 2018-12-19 10:36:25 -08:00
Stephen Atherton 172c3f2021 Bug fix in backup describe, do not update log begin/end metadata in backup if describe was given a start version override as it can result in incorrect metadata. 2018-12-19 10:35:06 -08:00
Stephen Atherton afa243bc97 Added fdbbackup expire options to calculate approximate version boundaries based on a number of days prior to the latest log file found in the backup container. This enables expiration operations based on time (with reasonable precision) without accessing the source cluster. 2018-12-18 18:55:44 -08:00
Stephen Atherton 69d847dbbd Backup describe can now analyze a backup assuming log data starts at a given version. This is used by expire both as an optimization and because doing so enables expire to repair a bad metadata state that can result from a cancelled or failed expire operation from fdbbackup <= 6.0.17. ListLogFiles() and ListRangeFiles() no longer sort results as in most cases the sort is not required and the result set can be very large. Describe will now update minLogBegin metadata to the beginning of the log range known to be present when possible. Several serial log and range list pairings are now done in parallel. 2018-12-18 04:33:37 -08:00
Alex Miller f88d5f56ff Fix copyright header and use c++11 for now. 2018-12-17 23:50:33 -08:00
Stephen Atherton 779a4b1e3b Static de-initialization order isn't well thought out so use flushAndExit() instead of returning from main after runNetwork() has been called. 2018-12-17 18:39:14 -08:00
Alex Miller bfab7c150a Require PageHeader to be 36 bytes, and don't use magic numbers. 2018-12-17 13:37:44 -08:00
Stephen Atherton 9ef9041fba Bug fix, metadata read futures were moved to a vector but then not waited on. 2018-12-17 13:13:35 -08:00
Stephen Atherton dac1827d23 Backup describe's "deep scan" mode should only ignore log begin/end versions, not expire and unreliable end versions. 2018-12-16 00:41:38 -08:00
Stephen Atherton 5951e9d577 Added backup URL and exceptions to trace events where applicable. 2018-12-16 00:33:30 -08:00
Stephen Atherton 223b19f5ba Rewrote backup metadata scheme to fix several design flaws involving cancelled or concurrent operations. Most importantly, before an expire deletes any data it marks the end of the range being deleted as 'unreliable' so further reads of the backup will treat versions before that point as having data holes. 2018-12-16 00:18:13 -08:00
Alex Miller b0f9aab1de
Merge pull request #979 from xumengpanda/mengxu/teamcollection-release-osx-build-fix
TeamCollection: Fix build in osX
2018-12-14 15:12:46 -08:00
Alex Miller b4b7f382a7 Fix issues that a newer compiler warned about. 2018-12-14 14:43:50 -08:00
Meng Xu 486a7b04fa TeamCollection: Fix build in osX
In osX, we cannot adding unsigned long to a string to append to the string.
2018-12-14 13:44:11 -08:00
Adam Kocoloski 0a6d423569 Improve three_data_hall / three_dc descriptions
This patch includes descriptions of the transaction log configurations
for these redundancy modes, and corrects what I believe is an incorrect
statement about the minimum number of machines required to make
progress. It also clarifies that commits require synchronous
replication across datacenters.
2018-12-14 16:31:23 -05:00
Adam Kocoloski e18713450f Remove outdated information on multi-dc config
The only published datacenter-aware mode is three_datacenter, which
replicates data 6x (not in triplicate) and does replicate each piece of
data to all three datacenters.
2018-12-14 16:04:44 -05:00
Markus Pilman cdc7e83993
Update flow/Trace.cpp
Co-Authored-By: alexmiller-apple <35046903+alexmiller-apple@users.noreply.github.com>
2018-12-14 11:30:40 -08:00
Markus Pilman 4ae701d8a9 minor bugfix to look up correct filename in cache
(manually cherry-picked from flat-buffers branch)
2018-12-13 22:21:25 -08:00
Markus Pilman 0207831fd6 Use abspath when dealing with the simulator file-cache
The simulator uses a hash table to cache all open files to make sure
that several simulated processes don't open the file more than once.
This currently doesn't work properly and deleted files are often kept
open forever. As a result, we often ran out of file descriptors.

The problem is luckily quite simple: files are often opened with an
absolute path but later a relativ path is passed for deletion. This
is not working because the map that is used to store the file
descriptors is not aware of paths - so deleted files are often not
removed from this map. The fix that works for us is to just always
work with absolute paths when adding and removing files from this map.
2018-12-13 22:21:06 -08:00
Alex Miller a5401b834b Integrate JsonTraceLogFormatter into build system + more.
Where more is:
* Changed the default format to xml, so that all traces don't suddenly
  change as of this commit.  Someone is going to need to start passing a
  flag to all their servers, but let's worry about that later.
* Changed the copyright headers to be the correct filename.
* Include paths should be specified from the root.
2018-12-13 22:07:16 -08:00
Markus Pilman 2389cf65f3 fixed escaping bug 2018-12-13 21:50:01 -08:00
Markus Pilman aa1eff8346 formatted json log formatter 2018-12-13 21:49:46 -08:00
Markus Pilman 40890e9dbe Implemented a json log formatter 2018-12-13 21:46:02 -08:00