Evan Tschannen
|
c51de3bb88
|
fixed windows compile issues
|
2017-12-20 13:48:31 -08:00 |
|
Stephen Atherton
|
c1958b335a
|
Compile fix on windows, can't access protected parent class member from static function, apparently.
|
2017-12-20 12:13:25 -08:00 |
|
Evan Tschannen
|
0ab0cf51a3
|
fix: snapshotDispatch signaled completion after the first snapshot finished
|
2017-12-20 12:07:35 -08:00 |
|
Evan Tschannen
|
50bc25d3c7
|
Merge pull request #225 from cie/continuous-backup
Continuous backup
|
2017-12-20 11:13:36 -08:00 |
|
Stephen Atherton
|
b77276d2f0
|
First snapshot of a backup should go as fast as possible instead of using the configured snapshot interval.
|
2017-12-20 01:07:03 -08:00 |
|
Stephen Atherton
|
7caa012fbf
|
Added snapshot interval option to "fdbbackup start" which defaults to a new knob's value. Added snapshot info to backup status text. Improvements to fdbbackup help.
|
2017-12-20 00:49:08 -08:00 |
|
Stephen Atherton
|
d87aa521e9
|
Merge branch 'backup-container-refactor' into continuous-backup
|
2017-12-19 23:39:00 -08:00 |
|
Stephen Atherton
|
193c216f52
|
Merge pull request #224 from cie/add-fdbbackup-interface
Add fdbbackup interface
|
2017-12-19 23:33:17 -08:00 |
|
Stephen Atherton
|
e0d9cea008
|
Merge branch 'master' into continuous-backup
# Conflicts:
# fdbclient/FileBackupAgent.actor.cpp
# fdbrpc/BlobStore.actor.cpp
|
2017-12-19 23:02:14 -08:00 |
|
Stephen Atherton
|
2cd1ff6aae
|
Bug fix, in restore dispatch the apply lag was being retrieved before updating the apply end version which would make it look like mutations were finished applying early.
|
2017-12-19 18:11:40 -08:00 |
|
Stephen Atherton
|
61a043ebfa
|
Added tr->reset() to prevent initial transaction loop attempts from having a higher chance of expiring.
|
2017-12-19 17:33:45 -08:00 |
|
Stephen Atherton
|
aa5169bd3c
|
Removed unnecessary trace event.
|
2017-12-19 15:29:22 -08:00 |
|
Stephen Atherton
|
e28641886d
|
TraceEvent improvements. Minor bug fix, restore log writing tasks didn't have the log file endVersion but it's only for logging purposes.
|
2017-12-19 15:27:04 -08:00 |
|
Stephen Atherton
|
a276985baf
|
Bug fix, if there are range files in a restore which begin at exactly the restore version they will be repeatedly dispatched forever.
|
2017-12-18 17:48:18 -08:00 |
|
Stephen Atherton
|
005a4a0706
|
Restore status bug fix, during restore the apply lag would appear as a large negative number until the first restore batch is completed. Test improvement, snapshot dispatch now chooses a random number of tasks to dispatch per commit.
|
2017-12-18 15:56:57 -08:00 |
|
Evan Tschannen
|
a5601877b3
|
fix: valgrind issue with destruction ordering
|
2017-12-18 15:31:59 -08:00 |
|
Stephen Atherton
|
937fa75bec
|
Bug fix, if target snapshot end version is at or before the begin version then no progress would be made.
|
2017-12-18 00:13:25 -08:00 |
|
Stephen Atherton
|
d32a770648
|
Bug fix, backup never went to differential mode once it was restorable which caused waitBackup to only return once the backup was discontinued.
|
2017-12-17 23:22:18 -08:00 |
|
Stephen Atherton
|
2b92815e8c
|
Bug fix. The snapshot dispatch add task retry loop was incorrectly deciding that the second and further transaction of an execution was already committed and therefore skipping it, resulting in missing ranges in the snapshot.
|
2017-12-17 21:01:31 -08:00 |
|
Stephen Atherton
|
afd2603576
|
Refactored backup task flow and config to support ongoing snapshots and allow stopping the backup cleanly between snapshots. The previously separate tasks for initial and differential mode log dispatching have been merged into BackupLogsDispatchTask.
|
2017-12-17 14:29:57 -08:00 |
|
Evan Tschannen
|
1dc9eceb6d
|
optimize GetKeyLocationRequests on the proxy so they only require a single map lookup, instead of doing 3 + (3* [number of ranges]) lookups
|
2017-12-15 20:13:44 -08:00 |
|
Alec Grieser
|
f2221cd16e
|
updated documentation to reflect startNetwork starting a thread
|
2017-12-15 15:59:51 -08:00 |
|
A.J. Beamon
|
11dba3e8ef
|
Update a bunch of tests and some documentation to use dispose.
|
2017-12-15 15:19:23 -08:00 |
|
Alec Grieser
|
34bdd8de28
|
Merge branch 'master' of github.com:apple/foundationdb
|
2017-12-15 12:23:08 -08:00 |
|
Alec Grieser
|
916105cd35
|
java now names the network thread "fdb-network-thread"
|
2017-12-15 12:23:01 -08:00 |
|
Stephen Atherton
|
a3820b8b33
|
Merge pull request #196 from cie/updated-fdbmonitor-logging
Updates to fdbmonitor logging for better Splunk support
|
2017-12-15 12:22:30 -08:00 |
|
A.J. Beamon
|
83b21cc57b
|
Set the thread name for threads created by our default executor in the Java bindings.
|
2017-12-15 11:00:29 -08:00 |
|
A.J. Beamon
|
33558e2757
|
Fix links to general FDB documentation. De-double-pluralize Transaction.
|
2017-12-15 09:19:01 -08:00 |
|
A.J. Beamon
|
8b84d5e7d9
|
Testing the removal of some pre/post build events in our fdb_java vcxproj file. These built the Java bindings jar, but only for the old bindings that no longer exist.
|
2017-12-15 08:28:29 -08:00 |
|
A.J. Beamon
|
e8c902f57a
|
Add -f to rm command in javadoc_clean makefile target
|
2017-12-15 08:01:25 -08:00 |
|
Stephen Atherton
|
18305ab326
|
Bug fixes. Added snapshotBatchSize to backupConfig to enable detecting if a transaction for adding a group of tasks to a batch had already completed. Changed KeyRangeMap usage so that each range value to be dispatched has a unique integer value, enabling more efficient range coalescing and avoiding some iterator invalidation bugs.
|
2017-12-15 01:39:50 -08:00 |
|
A.J. Beamon
|
59dece655a
|
Merge pull request #221 from cie/java-remove-old-bindings
Java remove old bindings
|
2017-12-14 15:55:51 -08:00 |
|
Alex Miller
|
9a0df6d76d
|
Deallocate aligned_alloc with aligned_free.
This probably fixes a windows-only crash, as only windows cares about this distinction.
|
2017-12-14 15:12:05 -08:00 |
|
A.J. Beamon
|
76ddf38880
|
Normalize whitespace
|
2017-12-14 14:53:07 -08:00 |
|
Alec Grieser
|
e98b6f4813
|
fixed indentation in java makefile so that targets get built and so on and so forth
"plus ça change, plus c'est la même chose"
|
2017-12-14 14:47:53 -08:00 |
|
Yichi Chiang
|
50c154fed4
|
Add fdbbackup interface
|
2017-12-14 13:54:01 -08:00 |
|
A.J. Beamon
|
6cef57d695
|
Merge commit '786c229240cdcdd194212ed8c06f60581f437c84' into java-remove-old-bindings
# Conflicts:
# bindings/java/src-completable/junit/com/apple/foundationdb/tuple/ArrayUtilTests.java
# bindings/java/src-completable/main/com/apple/foundationdb/Cluster.java
# bindings/java/src-completable/main/com/apple/foundationdb/Database.java
# bindings/java/src-completable/main/com/apple/foundationdb/FDB.java
# bindings/java/src-completable/main/com/apple/foundationdb/FDBDatabase.java
# bindings/java/src-completable/main/com/apple/foundationdb/FDBTransaction.java
# bindings/java/src-completable/main/com/apple/foundationdb/JNIUtil.java
# bindings/java/src-completable/main/com/apple/foundationdb/KeySelector.java
# bindings/java/src-completable/main/com/apple/foundationdb/LocalityUtil.java
# bindings/java/src-completable/main/com/apple/foundationdb/NativeFuture.java
# bindings/java/src-completable/main/com/apple/foundationdb/OptionsSet.java
# bindings/java/src-completable/main/com/apple/foundationdb/Range.java
# bindings/java/src-completable/main/com/apple/foundationdb/RangeQuery.java
# bindings/java/src-completable/main/com/apple/foundationdb/ReadTransactionContext.java
# bindings/java/src-completable/main/com/apple/foundationdb/Transaction.java
# bindings/java/src-completable/main/com/apple/foundationdb/TransactionContext.java
# bindings/java/src-completable/main/com/apple/foundationdb/async/AsyncUtil.java
# bindings/java/src-completable/main/com/apple/foundationdb/async/Cancellable.java
# bindings/java/src-completable/main/com/apple/foundationdb/async/CloneableException.java
# bindings/java/src-completable/main/com/apple/foundationdb/directory/DirectoryLayer.java
# bindings/java/src-completable/main/com/apple/foundationdb/directory/DirectoryPartition.java
# bindings/java/src-completable/main/com/apple/foundationdb/directory/DirectorySubspace.java
# bindings/java/src-completable/main/com/apple/foundationdb/directory/DirectoryUtil.java
# bindings/java/src-completable/main/com/apple/foundationdb/directory/MismatchedLayerException.java
# bindings/java/src-completable/main/com/apple/foundationdb/directory/PathUtil.java
# bindings/java/src-completable/main/com/apple/foundationdb/subspace/Subspace.java
# bindings/java/src-completable/main/com/apple/foundationdb/tuple/ByteArrayUtil.java
# bindings/java/src-completable/main/com/apple/foundationdb/tuple/Tuple.java
# bindings/java/src-completable/main/com/apple/foundationdb/tuple/TupleUtil.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/AsyncDirectoryExtension.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/AsyncStackTester.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/BlockingBenchmark.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/ConcurrentGetSetGet.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/Context.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/ContinuousSample.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/DirectoryExtension.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/DirectoryTest.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/DirectoryUtil.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/Example.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/Instruction.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/IterableTest.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/LocalityTests.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/ParallelRandomScan.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/RangeTest.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/ReadWrite.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/SerialInsertion.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/SerialIteration.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/SerialTest.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/StackEntry.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/StackTester.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/StackUtils.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/TupleTest.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/VersionstampSmokeTest.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/WatchTest.java
# bindings/java/src-completable/test/com/apple/foundationdb/test/WhileTrueTest.java
# bindings/java/src/test/com/apple/foundationdb/test/AsyncPerformanceTester.java
|
2017-12-14 13:50:56 -08:00 |
|
Alec Grieser
|
24c6439456
|
Merge pull request #207 from cie/java-add-missing-dispose
Update the Java bindings to call add missing dispose calls.
|
2017-12-14 13:38:15 -08:00 |
|
A.J. Beamon
|
7102e4f97a
|
Merge pull request #223 from cie/java-future-cleanup
Java cleanup
|
2017-12-14 13:37:33 -08:00 |
|
Alec Grieser
|
fd10562b55
|
made tabulation consistent for two lines
|
2017-12-14 13:36:34 -08:00 |
|
Alec Grieser
|
c88b30b815
|
SPACES TO TABS I CAN'T EVEN RIGHT NOW
|
2017-12-14 11:49:47 -08:00 |
|
Alec Grieser
|
c7a730006c
|
I have had it with these monkey-fighting whitespaces changes in this Monday-to-Friday repo
|
2017-12-14 11:45:08 -08:00 |
|
Alec Grieser
|
311bb89258
|
for some reason, my IDE wants to insert spaces after a tab instead of a tab and I don't like it 🤬
|
2017-12-14 11:35:11 -08:00 |
|
Alec Grieser
|
87b769f446
|
rename methods on iterators to include "remaining" ; removed unused version of mapIterable
|
2017-12-14 11:33:17 -08:00 |
|
Alec Grieser
|
616e27e476
|
added redundant modifier check to style and then fixed errors it turned up
|
2017-12-14 11:07:19 -08:00 |
|
Alec Grieser
|
9b1bcea525
|
added javadocs for DONE, READY_TRUE, and READY_FALSE ; used it in some places instead of CompletableFuture.completedFuture
|
2017-12-14 10:10:11 -08:00 |
|
Alec Grieser
|
9934b2e09a
|
believe it or not, for once, it's a whitespace only change, spaces -> tabs 🤮
|
2017-12-14 09:57:24 -08:00 |
|
Stephen Atherton
|
33f9f1a95c
|
Added SnapshotDispatch task for writing snapshots in random order over a specified period of time and adapting speed to a growing or shrinking database. TaskBucket now supports scheduling tasks. TaskFuture now correctly recognizes multiple tasks in its callback space. TaskBucket extendTimeout() now supports specifying the new timeout version. Submitting a backup now requires a snapshot duration.
|
2017-12-14 01:44:38 -08:00 |
|
Alec Grieser
|
08127bd340
|
Merge remote-tracking branch 'origin/java-add-missing-dispose' into java-future-cleanup
|
2017-12-13 16:28:15 -08:00 |
|
Alec Grieser
|
33f8b2f7cf
|
added a style guide ; fixed errors found from the style guide ; updated tests to use java 8 closures
|
2017-12-13 16:16:31 -08:00 |