Alex Miller
0d06c08350
Merge pull request #993 from szhou1234/deprecate_dmcs
...
Prefer MCS instead of DMCS which has been deprecated in Mono
2019-01-02 17:37:01 -06:00
Andrew Noyes
bce5b03340
Fix whitespace
2019-01-02 15:24:11 -08:00
Alec Grieser
d9584aeddf
Merge pull request #994 from ajbeamon/fix-add-paretheses-to-bitwise-ops
...
Add parentheses to bitwise ops (turned up by clang after recent change)
2019-01-02 15:11:24 -08:00
Alex Miller
665f33a194
Removing whitespace introduced by GitHub UI
2019-01-02 17:11:11 -06:00
Alex Miller
df810d181f
Change required CMake version to 3.12
2019-01-02 17:09:21 -06:00
mpilman
a31df1b0a6
Addressed comments from pull requests
...
- Moved some larger sections in CMakeLists.txt into separate files
- Fixed an include issue on OS X
- Fixed boost version
- Use PROJECT_VERSION by default instead of using versions.target
2019-01-02 13:32:26 -08:00
A.J. Beamon
d8f33a2419
Add parentheses to bitwise ops (turned up by clang after recent change)
2019-01-02 10:15:59 -08:00
Simon Zhou
f8657f5cde
Prefer MCS instead of DMCS which has been deprecated in Mono
2019-01-01 18:53:54 -08:00
Alex Miller
73f53f9861
Merge pull request #991 from atn34/replace-ampersand-operator
...
Replace & operator with variadic function
2018-12-30 22:51:59 -06:00
Alex Miller
f02426938d
Merge pull request #992 from szhou1234/fix_null
...
Avoid null check to get rid of build error on Mac
2018-12-30 22:19:35 -06:00
Simon Zhou
7edf221986
Avoid null check
2018-12-28 13:09:04 -08:00
anoyes
6a4d87802b
Replace & operator with variadic function
2018-12-28 11:33:42 -08:00
Stephen Atherton
928876be81
Backup dumpFileList() can now take a version range.
2018-12-21 22:42:29 -08:00
Stephen Atherton
f64d5321e9
Backup describe, expire, and delete will now clearly indicate when there is no backup at the given URL.
2018-12-20 18:05:23 -08:00
anoyes
1bca665b29
Document --trace_format flag
2018-12-20 16:22:41 -08:00
anoyes
03b48fb452
s/--trace-format/--trace_format/
2018-12-20 15:58:26 -08:00
anoyes
b8df5acc15
Add --trace_format flag to fdbserver
2018-12-20 15:02:01 -08:00
Steve Atherton
9881b1d074
Merge pull request #977 from alexmiller-apple/abspath
...
Use abspath when dealing with the simulator file-cache
2018-12-20 14:56:38 -08:00
Xin Dong
6d278e466b
Merge pull request #985 from dongxinEric/docs/clarifications-for-tls-docs
...
Resolves issue #984 : made some clarifications in TLS docs.
2018-12-20 14:33:06 -08:00
Alex Miller
464dc6c7b2
Apply suggestions from code review
...
Co-Authored-By: dongxinEric <jiangzian1987dx@gmail.com>
2018-12-20 14:31:11 -08:00
Xin Dong
b00b07c5ed
Resolves #984 : made some clarifications in TLS docs.
2018-12-20 14:09:56 -08:00
anoyes
33a4aac249
Fix build
2018-12-20 11:55:59 -08:00
anoyes
4b31d209da
Emit valid json for unprintable characters
2018-12-20 11:43:18 -08:00
Stephen Atherton
567a7bd58a
Print a final deleted object count at the end of backup deletion.
2018-12-20 01:24:31 -08:00
Stephen Atherton
354abebf64
Added progress reporting to backup expiration. Simplified backup delete progress.
2018-12-20 00:23:26 -08:00
Stephen Atherton
fcb34a8768
In backup describe, when not using the original cluster to resolve versions to date/time strings the versions will be converted to approximate day deltas from maxLogEndVersion (if available) using core_versionspersecond.
2018-12-19 16:53:39 -08:00
Stephen Atherton
00568f4011
Error code was misleading, added comment.
2018-12-19 13:14:48 -08:00
Stephen Atherton
fd4a62fbfd
Backup expire will fail earlier if force option is needed but not specified.
2018-12-19 10:36:25 -08:00
Stephen Atherton
172c3f2021
Bug fix in backup describe, do not update log begin/end metadata in backup if describe was given a start version override as it can result in incorrect metadata.
2018-12-19 10:35:06 -08:00
Stephen Atherton
afa243bc97
Added fdbbackup expire options to calculate approximate version boundaries based on a number of days prior to the latest log file found in the backup container. This enables expiration operations based on time (with reasonable precision) without accessing the source cluster.
2018-12-18 18:55:44 -08:00
Stephen Atherton
69d847dbbd
Backup describe can now analyze a backup assuming log data starts at a given version. This is used by expire both as an optimization and because doing so enables expire to repair a bad metadata state that can result from a cancelled or failed expire operation from fdbbackup <= 6.0.17. ListLogFiles() and ListRangeFiles() no longer sort results as in most cases the sort is not required and the result set can be very large. Describe will now update minLogBegin metadata to the beginning of the log range known to be present when possible. Several serial log and range list pairings are now done in parallel.
2018-12-18 04:33:37 -08:00
Alex Miller
f88d5f56ff
Fix copyright header and use c++11 for now.
2018-12-17 23:50:33 -08:00
Stephen Atherton
779a4b1e3b
Static de-initialization order isn't well thought out so use flushAndExit() instead of returning from main after runNetwork() has been called.
2018-12-17 18:39:14 -08:00
Alex Miller
bfab7c150a
Require PageHeader to be 36 bytes, and don't use magic numbers.
2018-12-17 13:37:44 -08:00
Stephen Atherton
9ef9041fba
Bug fix, metadata read futures were moved to a vector but then not waited on.
2018-12-17 13:13:35 -08:00
Stephen Atherton
dac1827d23
Backup describe's "deep scan" mode should only ignore log begin/end versions, not expire and unreliable end versions.
2018-12-16 00:41:38 -08:00
Stephen Atherton
5951e9d577
Added backup URL and exceptions to trace events where applicable.
2018-12-16 00:33:30 -08:00
Stephen Atherton
223b19f5ba
Rewrote backup metadata scheme to fix several design flaws involving cancelled or concurrent operations. Most importantly, before an expire deletes any data it marks the end of the range being deleted as 'unreliable' so further reads of the backup will treat versions before that point as having data holes.
2018-12-16 00:18:13 -08:00
Alex Miller
b0f9aab1de
Merge pull request #979 from xumengpanda/mengxu/teamcollection-release-osx-build-fix
...
TeamCollection: Fix build in osX
2018-12-14 15:12:46 -08:00
Alex Miller
b4b7f382a7
Fix issues that a newer compiler warned about.
2018-12-14 14:43:50 -08:00
Meng Xu
486a7b04fa
TeamCollection: Fix build in osX
...
In osX, we cannot adding unsigned long to a string to append to the string.
2018-12-14 13:44:11 -08:00
Adam Kocoloski
0a6d423569
Improve three_data_hall / three_dc descriptions
...
This patch includes descriptions of the transaction log configurations
for these redundancy modes, and corrects what I believe is an incorrect
statement about the minimum number of machines required to make
progress. It also clarifies that commits require synchronous
replication across datacenters.
2018-12-14 16:31:23 -05:00
Adam Kocoloski
e18713450f
Remove outdated information on multi-dc config
...
The only published datacenter-aware mode is three_datacenter, which
replicates data 6x (not in triplicate) and does replicate each piece of
data to all three datacenters.
2018-12-14 16:04:44 -05:00
Markus Pilman
cdc7e83993
Update flow/Trace.cpp
...
Co-Authored-By: alexmiller-apple <35046903+alexmiller-apple@users.noreply.github.com>
2018-12-14 11:30:40 -08:00
Markus Pilman
4ae701d8a9
minor bugfix to look up correct filename in cache
...
(manually cherry-picked from flat-buffers branch)
2018-12-13 22:21:25 -08:00
Markus Pilman
0207831fd6
Use abspath when dealing with the simulator file-cache
...
The simulator uses a hash table to cache all open files to make sure
that several simulated processes don't open the file more than once.
This currently doesn't work properly and deleted files are often kept
open forever. As a result, we often ran out of file descriptors.
The problem is luckily quite simple: files are often opened with an
absolute path but later a relativ path is passed for deletion. This
is not working because the map that is used to store the file
descriptors is not aware of paths - so deleted files are often not
removed from this map. The fix that works for us is to just always
work with absolute paths when adding and removing files from this map.
2018-12-13 22:21:06 -08:00
Alex Miller
a5401b834b
Integrate JsonTraceLogFormatter into build system + more.
...
Where more is:
* Changed the default format to xml, so that all traces don't suddenly
change as of this commit. Someone is going to need to start passing a
flag to all their servers, but let's worry about that later.
* Changed the copyright headers to be the correct filename.
* Include paths should be specified from the root.
2018-12-13 22:07:16 -08:00
Markus Pilman
2389cf65f3
fixed escaping bug
2018-12-13 21:50:01 -08:00
Markus Pilman
aa1eff8346
formatted json log formatter
2018-12-13 21:49:46 -08:00
Markus Pilman
40890e9dbe
Implemented a json log formatter
2018-12-13 21:46:02 -08:00