cf2ec3418c
Merge pull request #2317 from xumengpanda/mengxu/fastrestore-extend-atomicOpTest-PR
...
AtomicOps Test: Add more detailed debug information when test fails with opType = AddValue
2019-11-11 15:03:10 -08:00
43ec00b452
Merge pull request #2316 from fzhjon/fix-failed-server-workload
...
Fixed bug in maintaining kill set size in RemoveServersSafely workload
2019-11-08 15:35:55 -08:00
04e66fa0ec
AtomicOp:Trace when txn reads exceeds limit and add upper bound sum
2019-11-08 14:35:37 -08:00
fe79742881
Merge pull request #2333 from apple/release-6.2
...
Merge release 6.2 to master
2019-11-08 11:01:07 -08:00
d76070e37d
Merge pull request #2331 from satherton/feature-redwood
...
Update redwood
2019-11-08 10:38:16 -08:00
3de7ae5b0c
Added size assertion in test workload
2019-11-08 09:39:25 -08:00
2aa672cb59
When bulk building pages, make most of them full.
2019-11-07 15:52:23 -08:00
5d00d93665
Fixed errors found by valgrind involving incorrect page memory lifetimes for IO operations plus some false positives for partially used pages.
2019-11-07 13:57:09 -08:00
afc9713005
Merge branch 'release-6.2'
...
# Conflicts:
# CMakeLists.txt
# documentation/sphinx/source/release-notes.rst
# fdbclient/FDBTypes.h
# fdbserver/LogSystem.h
# fdbserver/LogSystemPeekCursor.actor.cpp
# fdbserver/OldTLogServer_6_0.actor.cpp
# fdbserver/TLogServer.actor.cpp
# versions.target
2019-11-06 13:45:37 -08:00
880cc29ce0
Merge pull request #2320 from xumengpanda/mengxu/trace-event-level-PR
...
Raise MIN_TRACE_SEVERITY from 0 to 1 to allow customized tunable trace severity
2019-11-06 13:18:49 -08:00
5fbe399baf
AtomicOp: Resolve review comments; no functional change.
...
1) Trace Txn commit_unknown_results in workload;
2) Add SevError trace events when txn reads hit limits since we
do not handle this situation in dumping the debug info.
2019-11-06 12:13:27 -08:00
a11db961cd
Merge pull request #2323 from etschannen/feature-efficient-buffered-cursor
...
remote logs use bufferedCursor when peeking from log routers
2019-11-05 20:45:15 -08:00
0ccded1929
AtomicOps:Resolve review comments
2019-11-05 19:27:49 -08:00
dbc5a2393c
combineMessages still did not serialize tags correctly
2019-11-05 18:44:30 -08:00
1c873591be
fixed a compiler error
2019-11-05 18:32:15 -08:00
86560fe727
fix: tempTags was not used correctly
2019-11-05 18:22:25 -08:00
a8ca47beff
optimized memory allocations by using VectorRef<Tag> instead of std::vector<Tag>
2019-11-05 18:07:30 -08:00
4a597fdcce
increase the task priority of popping
2019-11-05 15:03:41 -08:00
f0c816e452
Merge pull request #2319 from apple/release-6.2
...
Release 6.2 merge to master
2019-11-05 13:58:53 -08:00
f7b3686fc7
fixed bug in maintaining kill set size
2019-11-05 11:27:10 -08:00
e7210fe842
Trace:Resolve review comments and add SevVerbose level
2019-11-05 09:42:29 -08:00
ea428b72f5
Bug fix, DWALPager must flush its page ID queues in order to get an accurate user page count.
2019-11-05 01:11:34 -08:00
daac8a2c22
Knobified a few variables
2019-11-04 20:21:38 -08:00
457896b80d
remote logs use bufferedCursor when peeking from log routers to improve performance
...
bufferedCursor performance has been improved
2019-11-04 19:47:45 -08:00
c4d1e6e1a9
Trace:Severity:Include SevNoInfo to mute trace
...
Define SevFRMutationInfo to trace mutations in restore.
2019-11-04 16:18:40 -08:00
3728ef996e
Merge pull request #2318 from satherton/feature-redwood
...
Redwood update
2019-11-04 15:14:17 -08:00
96989e0fb6
AtomicOps test:Add sanity check for log and ops keys
...
Provide more information about which opsKey is missing when
log and ops results are inconsistent for Add operation.
2019-11-04 14:28:40 -08:00
0c95fef8aa
Bug fix in tree clear and size check where sometimes there could still be old versions of pages in use because not enough commits have passed for them to be rolled off and freed.
2019-11-04 12:59:57 -08:00
e345c9061f
FastRestore:Refine debug messages
2019-11-04 11:47:38 -08:00
4e9c3164a8
COWPager can now internally remap page IDs by version and has been renamed to DWALPager. This causes the B+Tree to no longer have to rewrite all ancestors of an updated page. FIFOQueue now has a read-only cursor and a peekAll() method to read an entire queue without popping it. Fixed some valgrind false positives, made some debug logging improvements. Fixed bug in pager shutdown where it could wait on an ActorCollection containing canceled futures.
2019-11-04 03:04:03 -08:00
8f84fbc4b9
Only print 'waiting for DD to end...' if test actually waits
2019-11-03 16:13:32 -08:00
4de60fc437
Merge branch 'release-6.2'
...
# Conflicts:
# documentation/sphinx/source/release-notes.rst
# fdbserver/TLogServer.actor.cpp
2019-11-01 15:48:04 -07:00
8a3521f945
Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-enable-parallel-peek
2019-11-01 14:04:22 -07:00
85c315f684
Fix: parallelPeekMore was not enabled when peeking from log routers
2019-11-01 14:02:44 -07:00
1dc5985062
Merge pull request #2305 from etschannen/release-6.2
...
merges crossing systemKeys.begin did not decrement systemSizeEstimate
2019-11-01 09:12:01 -07:00
8f0348d5e0
fix: merges which cross over systemKeys.begin did not properly decrement the systemSizeEstimate
2019-10-31 16:38:33 -07:00
58b984b846
Merge pull request #2047 from tclinken/lock-aware-db-ping
...
Use lock aware transaction for pingDatabase
2019-10-31 10:24:20 -07:00
71dfaa3f95
Merge pull request #2275 from dongxinEric/bugfix/2273/fix-read-key-sampling
...
Resolves #2273 : Use a large value for read sampling size threshold. Also at sampling …
2019-10-31 10:21:58 -07:00
199a34b827
Defined a minimum read cost (a penalty) for empty read or read size smaller than it. Fixed several review comments.
2019-10-30 10:04:19 -07:00
547616d5f1
Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-redwood
2019-10-29 16:33:22 -07:00
9c0d671d07
Two bug fixes in Redwood related to split KV pairs and one was masking the other. The first bug resulted in an incomplete erasure of fragments for a split KV pair and the second bug would generate an unnecessary explicit null record for the same key which would cause reads to correctly see the key as missing. Redwood correctness test now clears the tree and verifies expected resulting pager footprint, which succeeds due to the bug fixes.
2019-10-29 01:31:59 -07:00
40d53e23f5
Optimization, only the first btree mutation boundary for a subtree needs to be compared to the subtree's lower bound. Also removed a check for a condition which is no longer possible due to other changes.
2019-10-28 16:05:11 -07:00
0d993522d3
CommitSubtree() will now return an empty page set even for the tree root because commit_impl() handles this correctly. Improved commitSubtree() debug output related to which mutations are relevant to a subtree. Added random setting of range clear boundaries after clear() in Redwood correctness to make sure mutation buffer logic handles this correctly. B+Tree's dbEnd mutation is represented as a clear to prevent unnecessary rightmost subtree traversal during commit.
2019-10-28 04:00:37 -07:00
b7b5d2ead3
Remove several nonsensical const uses
...
These seem to be all the ones that clang's -Wignored-qualifiers
complains about
2019-10-26 14:30:34 -07:00
5cf0045bc0
Merge pull request #2294 from satherton/feature-redwood
...
Bug fixes in Redwood
2019-10-25 14:56:01 -07:00
2ee1782c19
Bug fixes in Redwood. BTree height was not being reset when a new empty root is written. IKeyValueStore wrapper was not obeying the row limit in a reverse range query. Added yields to and delays to break up tasks and set IO priorities.
2019-10-25 14:52:06 -07:00
1827e77f2e
Update fdbserver/FDBExecHelper.actor.cpp
...
Co-Authored-By: Jingyu Zhou <jingyuzhou@gmail.com>
2019-10-25 10:42:22 -07:00
a3d9e549ee
Remove rule from vcxproj
2019-10-25 10:42:22 -07:00
de8921b660
Move RestoreWorkerInterface to fdbclient
2019-10-25 10:42:22 -07:00
3f62d2b506
Fix actual build
2019-10-25 10:42:22 -07:00
A.J. Beamon