Evan Tschannen
9313e490aa
change the first part of the UID to make comparisons cheaper
2020-05-19 16:48:20 -07:00
Evan Tschannen
ead17d6a7f
another attempt at changing serialization
2020-05-19 16:28:01 -07:00
A.J. Beamon
d39378de7a
Merge pull request #3198 from ajbeamon/release-6.2
...
Merge release-6.1 into release-6.2
2020-05-19 16:23:20 -07:00
Balachandar Namasivayam
16990aeb6f
Add dcId to client transaction events.
2020-05-19 16:07:54 -07:00
Evan Tschannen
7dd226d264
readded a missing line
2020-05-19 15:35:57 -07:00
A.J. Beamon
666fc12930
Merge branch 'release-6.1' into release-6.2
...
# Conflicts:
# CMakeLists.txt
# documentation/sphinx/source/downloads.rst
# packaging/msi/FDBInstaller.wxs
2020-05-19 15:26:47 -07:00
Jingyu Zhou
4315af25e7
Fix unfinished restore tests
...
Because backup worker is disabled before performing the restore, we can't allow
a new backup of the new type running.
2020-05-19 15:18:45 -07:00
Jingyu Zhou
9e9591a07a
Fix an infinite loop
2020-05-19 15:15:39 -07:00
Balachandar Namasivayam
aad4028f7d
Merge pull request #3191 from ajbeamon/minor-transaction-tagging-tweaks
...
Add back an std::move that was accidentally removed
2020-05-19 14:22:57 -07:00
Chaoguang Lin
93ca130602
Delete the unnecessay endKey field in DDMetricsRef, since each begin key is the previous end key
2020-05-19 13:32:42 -07:00
A.J. Beamon
b784ff2839
Merge pull request #3195 from ajbeamon/merge-release6.3-into-master
...
Merge release-6.3 into master
2020-05-19 13:28:20 -07:00
A.J. Beamon
d636194d0d
Remove deprecated fields in status: worst_version_lag_storage_server and limiting_version_lag_storage_server
2020-05-19 13:12:10 -07:00
A.J. Beamon
7a09d016a6
Merge branch 'release-6.3' into merge-release6.3-into-master
2020-05-19 12:52:44 -07:00
Steve Atherton
8c3cddc792
Metrics bug fix, page build count was being updated in an incorrect place.
2020-05-19 12:45:32 -07:00
Evan Tschannen
99e1fbdd47
another attempt at speeding up serialization
2020-05-19 12:36:11 -07:00
Bhaskar Muppana
1786469e3c
Merge pull request #2881 from ajbeamon/transaction-profiling-analyzer-perf-improvements
...
Performance improvements to the transaction profiling analyzer
2020-05-19 10:49:46 -07:00
A.J. Beamon
0da199b201
Move wait_for_shard_addresses into ShardFinder. Remove unneeded transactional decorator.
2020-05-19 08:28:16 -07:00
Steve Atherton
53c4500694
Applied clang-format.
2020-05-19 04:11:39 -07:00
Steve Atherton
0d6f226938
Renamed some metrics to be clearer. Instead of "write" and "update" the terms are now "build" and "modify" which are less confusing and better represent what they mean in terms of DeltaTree operations.
2020-05-19 03:31:03 -07:00
Steve Atherton
4a827c9304
Merge branch 'release-6.3' of github.com:apple/foundationdb into feature-redwood
2020-05-19 03:08:26 -07:00
Steve Atherton
7765168346
Redwood metrics now includes average item count, fill percentage, and record stored percentage for pages written or modified during the metrics interval.
2020-05-19 03:04:39 -07:00
tclinken
9a64ec9343
Use std::copy in Deque copy ctor
2020-05-18 20:41:41 -07:00
Evan Tschannen
b7126f0acb
experimentally revert serialization of storage server interface
2020-05-18 19:54:09 -07:00
Evan Tschannen
5013bc9106
fixed client compile issues; reduced the size of storage server interface
2020-05-18 17:20:15 -07:00
Andrew Noyes
e97517f5eb
Add blurb about memory usage
2020-05-18 22:25:59 +00:00
Jingyu Zhou
084afbd22d
True-up backup progress may go back multiple epochs
...
Because the previous epoch may not save some tags, true-up backup progress may
need to go back more than one epoch.
2020-05-18 15:22:44 -07:00
Chaoguang Lin
5c4614f8be
delete unnecessary comments
2020-05-18 15:05:55 -07:00
Chaoguang Lin
00dce3ca1d
clang-format
2020-05-18 14:23:17 -07:00
Chaoguang Lin
e3921504d7
Delete comments
2020-05-18 14:21:38 -07:00
A.J. Beamon
fcca49f4d5
Add back an std::move that was accidentally removed. Some other small tweaks to avoid map lookups when tags aren't used.
2020-05-18 13:45:51 -07:00
Andrew Noyes
72a0db1902
Simplify by not mentioning boost
...
CMake will either try to find it on the system or download it if it
can't
2020-05-18 20:36:35 +00:00
Chaoguang Lin
6e684dda35
Using dd-stats zerobytes const in the workload
2020-05-18 11:53:26 -07:00
Chaoguang Lin
117ed14321
Add dd-stats zerobytes const to systemData
2020-05-18 11:52:36 -07:00
Chaoguang Lin
4bb90cb038
fix serilizer issue
2020-05-18 10:56:10 -07:00
Chaoguang Lin
bf62ef7c3e
Add dd-stats into special-key-space
2020-05-18 10:38:23 -07:00
Chaoguang Lin
f515e2c9d0
Add systemdata for dd-stats
2020-05-18 10:36:34 -07:00
Andrew Noyes
f951bc0bbf
Remove stale references in readme
...
E.g. Makefile, LibreSSL, boost 1.67
Also make a few things more concise and consistent in style.
2020-05-18 17:13:20 +00:00
Andrew Noyes
55f0b13fe9
Require c11 atomics
...
set(CMAKE_C_STANDARD 11)
set(CMAKE_C_STANDARD_REQUIRED ON)
apparently is not enough, and gcc 4.8.5 e.g. passes whatever checks are
done for the above but doesn't support c11 atomics. Let's just check for
them explicitly.
2020-05-18 16:30:12 +00:00
Andrew Noyes
747243e9cb
Set CMAKE_{C,CXX}_STANDARD_REQUIRED ON
2020-05-18 16:14:43 +00:00
Steve Atherton
f502236c31
Bug fix: BTree page header kvByte count was not being updated when pages are modified without rebuild.
2020-05-18 01:34:57 -07:00
Chaoguang Lin
6ce574f5ad
Merge remote-tracking branch 'upstream/release-6.3' into add-data-distribution-metrics
2020-05-17 23:36:52 -07:00
Evan Tschannen
be2246c0ee
Merge branch 'release-6.3' of github.com:apple/foundationdb into release-6.3
2020-05-17 15:29:12 -07:00
Steve Atherton
ca8464881f
Applied clang-format.
2020-05-17 00:16:35 -07:00
Steve Atherton
d11fd75105
Bug fixes: No-hit page reads would count the access as a hit but would still move the page to the back of the eviction order. Page writes to uncached pages are no longer considered cache misses.
2020-05-17 00:16:10 -07:00
Steve Atherton
6347f76192
More Redwood metrics work. Reworked metrics standard output for unit tests.
2020-05-16 22:21:55 -07:00
tclinken
5632af3b4d
Removed inaccurate warning
2020-05-16 20:20:11 -07:00
Jingyu Zhou
9fbbec1033
Fix duplicated counting of memory usage
...
For each message from LogPeekCursor, check it's using different arena from the
previous one. Otherwise, the arena's memory could be counted twice.
2020-05-16 18:50:09 -07:00
Jingyu Zhou
a2e5050492
Fix duplicated mutation
...
This seems to be related to how actor compiler generates code. The message can
be inserted twice with original code ordering.
2020-05-16 10:52:11 -07:00
Steve Atherton
e8626724f9
More refactor of Redwood metrics. Added per-level BTree stats. Added Pager total physical disk reads/writes, and uncacheable read hit/miss counts. Added logging to TraceEvents.
2020-05-16 02:51:57 -07:00
Jingyu Zhou
caca31d05a
Filter out mutations before the true-up version
...
When a mutation log's begin version is true-uped, we must filter out mutations
less than such a version.
2020-05-15 20:06:47 -07:00