Commit Graph

3131 Commits

Author SHA1 Message Date
A.J. Beamon 7498c2308c Merge branch 'release-6.0' into track-server-request-latencies 2019-01-16 13:39:01 -08:00
Evan Tschannen a7b3ad53bb
Merge pull request #1023 from etschannen/post-release-cleanup-6.0.18
Post release cleanup 6.0.18
2019-01-09 15:32:37 -08:00
Evan Tschannen 36cf8addd5 update installer WIX GUID following release 2019-01-09 15:32:00 -08:00
Evan Tschannen 0cd4f3a2fc update versions target to 6.0.19 2019-01-09 15:31:59 -08:00
Evan Tschannen 48d84faa3e
Merge pull request #1022 from etschannen/prepare-release-6.0.18
update installer WIX GUID following release
2019-01-09 14:28:32 -08:00
Evan Tschannen c23c8fba3e update installer WIX GUID following release 2019-01-09 14:27:56 -08:00
Evan Tschannen 5d2b11cba9
Merge pull request #1019 from satherton/http-request-id
Backup usability and sanity check improvements
2019-01-09 13:29:37 -08:00
Stephen Atherton f116678f0d Bug fix, restore start dry run would not open a trace file. 2019-01-09 03:54:13 -08:00
Stephen Atherton e7f800b019 Restore start with dry run option no longer requires or uses a database. Removed duplicate and unnecessary code. Dry run execution is more clear, it does not pretend to have actually restored data. Fixed typo in help text. 2019-01-08 19:00:58 -08:00
Stephen Atherton 604ad062d5 Updated backup correctness test to new behavior. WaitBackup() can now return the UID and BackupContainer atomically with the status code for a backup tag. 2019-01-08 18:12:15 -08:00
Stephen Atherton bb2de3479b Updated unit test to new backup container behavior. 2019-01-08 16:29:00 -08:00
Stephen Atherton 2951369006 When starting a restore, if range files are missing their names will be logged before an error is thrown. The error thrown is now restore_missing_data instead of restore_corrupted_data. 2019-01-08 16:28:40 -08:00
Evan Tschannen 5c64b549ce
Merge pull request #1011 from ajbeamon/fix-client-mem-leak
Fix: fast allocator would not cleanup memory for a thread if...
2019-01-08 14:53:57 -08:00
Stephen Atherton d005594bdd Added optional support for sending a unique id per request in a header for logging/tracking purposes. 2019-01-08 14:48:47 -08:00
A.J. Beamon b95d37def2 Add PR to release notes. 2019-01-08 14:37:23 -08:00
A.J. Beamon d265517156 Fix: fast allocator would not cleanup memory for a thread if that thread never called getMagazine. This could happen if the first thing the thread did was to release memory.
Added a new metric for the number of threads that hold memory for each size and improve some existing metrics.
Fix: a failed ASSERT would crash if done early in the program lifetime.
2019-01-08 14:36:01 -08:00
Evan Tschannen 3247f052ab
Merge pull request #1009 from etschannen/release-6.0
Updated documentation for 6.0.18
2019-01-07 18:25:16 -08:00
Evan Tschannen b4a8dea183 fixed a typo 2019-01-07 18:24:16 -08:00
Evan Tschannen 962ff501c1 updated release notes 2019-01-07 18:23:05 -08:00
Evan Tschannen 5a6576c85a updated documentation for 6.0.18 2019-01-07 18:15:36 -08:00
Stephen Atherton 0ec216a1fa Added X-Request-ID header to HTTP requests and verification of matching ID in response, if present. 2019-01-07 17:56:38 -08:00
Alex Miller 6feac8a6c4
Merge pull request #1001 from etschannen/release-6.0
byte sample recovery did not use limits for its range reads, leading to slow tasks
2019-01-07 16:38:25 -08:00
Evan Tschannen 900a81d3d2
Merge pull request #1007 from satherton/fix-backup-expire-bugs
Backup fixes and improvements
2019-01-07 12:42:01 -08:00
Stephen Atherton 339e15563e Bug fix in blobstore request loop where zero-content requests (i.e. not uploads) could cause mismatches between requests and responses. Added HTTPRequest debug event. 2019-01-04 18:34:16 -08:00
Evan Tschannen 57293a2db0 byte sample recovery did not use limits for its range reads, leading to slow tasks 2019-01-04 10:32:31 -08:00
Stephen Atherton f05bb0eb9b Stop escaping dot in HTTP resource string normalization. 2019-01-04 00:35:58 -08:00
Stephen Atherton 8d4d8ccba6 Stopped escaping some printable characters in urlEscape() method for normalizing HTTP resource strings. 2019-01-04 00:17:02 -08:00
Stephen Atherton 276ca82af4 Added --loggroup option to all fdbbackup modes. 2019-01-04 00:15:51 -08:00
Stephen Atherton 19c0ccd4c0 Added fdbbackup dump option to list files and sizes in a backup for a given version range. 2019-01-03 02:35:31 -08:00
Stephen Atherton 928876be81 Backup dumpFileList() can now take a version range. 2018-12-21 22:42:29 -08:00
Stephen Atherton f64d5321e9 Backup describe, expire, and delete will now clearly indicate when there is no backup at the given URL. 2018-12-20 18:05:23 -08:00
Stephen Atherton 567a7bd58a Print a final deleted object count at the end of backup deletion. 2018-12-20 01:24:31 -08:00
Stephen Atherton 354abebf64 Added progress reporting to backup expiration. Simplified backup delete progress. 2018-12-20 00:23:26 -08:00
Stephen Atherton fcb34a8768 In backup describe, when not using the original cluster to resolve versions to date/time strings the versions will be converted to approximate day deltas from maxLogEndVersion (if available) using core_versionspersecond. 2018-12-19 16:53:39 -08:00
Stephen Atherton 00568f4011 Error code was misleading, added comment. 2018-12-19 13:14:48 -08:00
Stephen Atherton fd4a62fbfd Backup expire will fail earlier if force option is needed but not specified. 2018-12-19 10:36:25 -08:00
Stephen Atherton 172c3f2021 Bug fix in backup describe, do not update log begin/end metadata in backup if describe was given a start version override as it can result in incorrect metadata. 2018-12-19 10:35:06 -08:00
Stephen Atherton afa243bc97 Added fdbbackup expire options to calculate approximate version boundaries based on a number of days prior to the latest log file found in the backup container. This enables expiration operations based on time (with reasonable precision) without accessing the source cluster. 2018-12-18 18:55:44 -08:00
Stephen Atherton 69d847dbbd Backup describe can now analyze a backup assuming log data starts at a given version. This is used by expire both as an optimization and because doing so enables expire to repair a bad metadata state that can result from a cancelled or failed expire operation from fdbbackup <= 6.0.17. ListLogFiles() and ListRangeFiles() no longer sort results as in most cases the sort is not required and the result set can be very large. Describe will now update minLogBegin metadata to the beginning of the log range known to be present when possible. Several serial log and range list pairings are now done in parallel. 2018-12-18 04:33:37 -08:00
Stephen Atherton 779a4b1e3b Static de-initialization order isn't well thought out so use flushAndExit() instead of returning from main after runNetwork() has been called. 2018-12-17 18:39:14 -08:00
Stephen Atherton 9ef9041fba Bug fix, metadata read futures were moved to a vector but then not waited on. 2018-12-17 13:13:35 -08:00
Stephen Atherton dac1827d23 Backup describe's "deep scan" mode should only ignore log begin/end versions, not expire and unreliable end versions. 2018-12-16 00:41:38 -08:00
Stephen Atherton 5951e9d577 Added backup URL and exceptions to trace events where applicable. 2018-12-16 00:33:30 -08:00
Stephen Atherton 223b19f5ba Rewrote backup metadata scheme to fix several design flaws involving cancelled or concurrent operations. Most importantly, before an expire deletes any data it marks the end of the range being deleted as 'unreliable' so further reads of the backup will treat versions before that point as having data holes. 2018-12-16 00:18:13 -08:00
Evan Tschannen f78a5a4d1a
Merge pull request #968 from etschannen/post-release-cleanup-6.0.17
Post release cleanup 6.0.17
2018-12-03 18:22:10 -08:00
Evan Tschannen f6c9cf89bf update installer WIX GUID following release 2018-12-03 18:21:35 -08:00
Evan Tschannen decfe23408 update versions target to 6.0.18 2018-12-03 18:21:35 -08:00
Evan Tschannen 8e0db56449
Merge pull request #967 from etschannen/prepare-release-6.0.17
update installer WIX GUID following release
2018-12-03 16:33:12 -08:00
Evan Tschannen c41ccb687d update installer WIX GUID following release 2018-12-03 16:32:42 -08:00
Evan Tschannen 37991d40cb
Merge pull request #966 from etschannen/release-6.0
updated documentation for 6.0.17
2018-12-03 16:31:13 -08:00