A.J. Beamon
7498c2308c
Merge branch 'release-6.0' into track-server-request-latencies
2019-01-16 13:39:01 -08:00
Evan Tschannen
a7b3ad53bb
Merge pull request #1023 from etschannen/post-release-cleanup-6.0.18
...
Post release cleanup 6.0.18
2019-01-09 15:32:37 -08:00
Evan Tschannen
36cf8addd5
update installer WIX GUID following release
2019-01-09 15:32:00 -08:00
Evan Tschannen
0cd4f3a2fc
update versions target to 6.0.19
2019-01-09 15:31:59 -08:00
Evan Tschannen
48d84faa3e
Merge pull request #1022 from etschannen/prepare-release-6.0.18
...
update installer WIX GUID following release
2019-01-09 14:28:32 -08:00
Evan Tschannen
c23c8fba3e
update installer WIX GUID following release
2019-01-09 14:27:56 -08:00
Evan Tschannen
5d2b11cba9
Merge pull request #1019 from satherton/http-request-id
...
Backup usability and sanity check improvements
2019-01-09 13:29:37 -08:00
Stephen Atherton
f116678f0d
Bug fix, restore start dry run would not open a trace file.
2019-01-09 03:54:13 -08:00
Stephen Atherton
e7f800b019
Restore start with dry run option no longer requires or uses a database. Removed duplicate and unnecessary code. Dry run execution is more clear, it does not pretend to have actually restored data. Fixed typo in help text.
2019-01-08 19:00:58 -08:00
Stephen Atherton
604ad062d5
Updated backup correctness test to new behavior. WaitBackup() can now return the UID and BackupContainer atomically with the status code for a backup tag.
2019-01-08 18:12:15 -08:00
Stephen Atherton
bb2de3479b
Updated unit test to new backup container behavior.
2019-01-08 16:29:00 -08:00
Stephen Atherton
2951369006
When starting a restore, if range files are missing their names will be logged before an error is thrown. The error thrown is now restore_missing_data instead of restore_corrupted_data.
2019-01-08 16:28:40 -08:00
Evan Tschannen
5c64b549ce
Merge pull request #1011 from ajbeamon/fix-client-mem-leak
...
Fix: fast allocator would not cleanup memory for a thread if...
2019-01-08 14:53:57 -08:00
Stephen Atherton
d005594bdd
Added optional support for sending a unique id per request in a header for logging/tracking purposes.
2019-01-08 14:48:47 -08:00
A.J. Beamon
b95d37def2
Add PR to release notes.
2019-01-08 14:37:23 -08:00
A.J. Beamon
d265517156
Fix: fast allocator would not cleanup memory for a thread if that thread never called getMagazine. This could happen if the first thing the thread did was to release memory.
...
Added a new metric for the number of threads that hold memory for each size and improve some existing metrics.
Fix: a failed ASSERT would crash if done early in the program lifetime.
2019-01-08 14:36:01 -08:00
Evan Tschannen
3247f052ab
Merge pull request #1009 from etschannen/release-6.0
...
Updated documentation for 6.0.18
2019-01-07 18:25:16 -08:00
Evan Tschannen
b4a8dea183
fixed a typo
2019-01-07 18:24:16 -08:00
Evan Tschannen
962ff501c1
updated release notes
2019-01-07 18:23:05 -08:00
Evan Tschannen
5a6576c85a
updated documentation for 6.0.18
2019-01-07 18:15:36 -08:00
Stephen Atherton
0ec216a1fa
Added X-Request-ID header to HTTP requests and verification of matching ID in response, if present.
2019-01-07 17:56:38 -08:00
Alex Miller
6feac8a6c4
Merge pull request #1001 from etschannen/release-6.0
...
byte sample recovery did not use limits for its range reads, leading to slow tasks
2019-01-07 16:38:25 -08:00
Evan Tschannen
900a81d3d2
Merge pull request #1007 from satherton/fix-backup-expire-bugs
...
Backup fixes and improvements
2019-01-07 12:42:01 -08:00
Stephen Atherton
339e15563e
Bug fix in blobstore request loop where zero-content requests (i.e. not uploads) could cause mismatches between requests and responses. Added HTTPRequest debug event.
2019-01-04 18:34:16 -08:00
Evan Tschannen
57293a2db0
byte sample recovery did not use limits for its range reads, leading to slow tasks
2019-01-04 10:32:31 -08:00
Stephen Atherton
f05bb0eb9b
Stop escaping dot in HTTP resource string normalization.
2019-01-04 00:35:58 -08:00
Stephen Atherton
8d4d8ccba6
Stopped escaping some printable characters in urlEscape() method for normalizing HTTP resource strings.
2019-01-04 00:17:02 -08:00
Stephen Atherton
276ca82af4
Added --loggroup option to all fdbbackup modes.
2019-01-04 00:15:51 -08:00
Stephen Atherton
19c0ccd4c0
Added fdbbackup dump option to list files and sizes in a backup for a given version range.
2019-01-03 02:35:31 -08:00
Stephen Atherton
928876be81
Backup dumpFileList() can now take a version range.
2018-12-21 22:42:29 -08:00
Stephen Atherton
f64d5321e9
Backup describe, expire, and delete will now clearly indicate when there is no backup at the given URL.
2018-12-20 18:05:23 -08:00
Stephen Atherton
567a7bd58a
Print a final deleted object count at the end of backup deletion.
2018-12-20 01:24:31 -08:00
Stephen Atherton
354abebf64
Added progress reporting to backup expiration. Simplified backup delete progress.
2018-12-20 00:23:26 -08:00
Stephen Atherton
fcb34a8768
In backup describe, when not using the original cluster to resolve versions to date/time strings the versions will be converted to approximate day deltas from maxLogEndVersion (if available) using core_versionspersecond.
2018-12-19 16:53:39 -08:00
Stephen Atherton
00568f4011
Error code was misleading, added comment.
2018-12-19 13:14:48 -08:00
Stephen Atherton
fd4a62fbfd
Backup expire will fail earlier if force option is needed but not specified.
2018-12-19 10:36:25 -08:00
Stephen Atherton
172c3f2021
Bug fix in backup describe, do not update log begin/end metadata in backup if describe was given a start version override as it can result in incorrect metadata.
2018-12-19 10:35:06 -08:00
Stephen Atherton
afa243bc97
Added fdbbackup expire options to calculate approximate version boundaries based on a number of days prior to the latest log file found in the backup container. This enables expiration operations based on time (with reasonable precision) without accessing the source cluster.
2018-12-18 18:55:44 -08:00
Stephen Atherton
69d847dbbd
Backup describe can now analyze a backup assuming log data starts at a given version. This is used by expire both as an optimization and because doing so enables expire to repair a bad metadata state that can result from a cancelled or failed expire operation from fdbbackup <= 6.0.17. ListLogFiles() and ListRangeFiles() no longer sort results as in most cases the sort is not required and the result set can be very large. Describe will now update minLogBegin metadata to the beginning of the log range known to be present when possible. Several serial log and range list pairings are now done in parallel.
2018-12-18 04:33:37 -08:00
Stephen Atherton
779a4b1e3b
Static de-initialization order isn't well thought out so use flushAndExit() instead of returning from main after runNetwork() has been called.
2018-12-17 18:39:14 -08:00
Stephen Atherton
9ef9041fba
Bug fix, metadata read futures were moved to a vector but then not waited on.
2018-12-17 13:13:35 -08:00
Stephen Atherton
dac1827d23
Backup describe's "deep scan" mode should only ignore log begin/end versions, not expire and unreliable end versions.
2018-12-16 00:41:38 -08:00
Stephen Atherton
5951e9d577
Added backup URL and exceptions to trace events where applicable.
2018-12-16 00:33:30 -08:00
Stephen Atherton
223b19f5ba
Rewrote backup metadata scheme to fix several design flaws involving cancelled or concurrent operations. Most importantly, before an expire deletes any data it marks the end of the range being deleted as 'unreliable' so further reads of the backup will treat versions before that point as having data holes.
2018-12-16 00:18:13 -08:00
Evan Tschannen
f78a5a4d1a
Merge pull request #968 from etschannen/post-release-cleanup-6.0.17
...
Post release cleanup 6.0.17
2018-12-03 18:22:10 -08:00
Evan Tschannen
f6c9cf89bf
update installer WIX GUID following release
2018-12-03 18:21:35 -08:00
Evan Tschannen
decfe23408
update versions target to 6.0.18
2018-12-03 18:21:35 -08:00
Evan Tschannen
8e0db56449
Merge pull request #967 from etschannen/prepare-release-6.0.17
...
update installer WIX GUID following release
2018-12-03 16:33:12 -08:00
Evan Tschannen
c41ccb687d
update installer WIX GUID following release
2018-12-03 16:32:42 -08:00
Evan Tschannen
37991d40cb
Merge pull request #966 from etschannen/release-6.0
...
updated documentation for 6.0.17
2018-12-03 16:31:13 -08:00