Commit Graph

10762 Commits

Author SHA1 Message Date
Evan Tschannen 9313e490aa change the first part of the UID to make comparisons cheaper 2020-05-19 16:48:20 -07:00
Evan Tschannen ead17d6a7f another attempt at changing serialization 2020-05-19 16:28:01 -07:00
A.J. Beamon d39378de7a
Merge pull request #3198 from ajbeamon/release-6.2
Merge release-6.1 into release-6.2
2020-05-19 16:23:20 -07:00
Balachandar Namasivayam 16990aeb6f Add dcId to client transaction events. 2020-05-19 16:07:54 -07:00
Evan Tschannen 7dd226d264 readded a missing line 2020-05-19 15:35:57 -07:00
A.J. Beamon 666fc12930 Merge branch 'release-6.1' into release-6.2
# Conflicts:
#	CMakeLists.txt
#	documentation/sphinx/source/downloads.rst
#	packaging/msi/FDBInstaller.wxs
2020-05-19 15:26:47 -07:00
Jingyu Zhou 4315af25e7 Fix unfinished restore tests
Because backup worker is disabled before performing the restore, we can't allow
a new backup of the new type running.
2020-05-19 15:18:45 -07:00
Jingyu Zhou 9e9591a07a Fix an infinite loop 2020-05-19 15:15:39 -07:00
Balachandar Namasivayam aad4028f7d
Merge pull request #3191 from ajbeamon/minor-transaction-tagging-tweaks
Add back an std::move that was accidentally removed
2020-05-19 14:22:57 -07:00
Chaoguang Lin 93ca130602 Delete the unnecessay endKey field in DDMetricsRef, since each begin key is the previous end key 2020-05-19 13:32:42 -07:00
A.J. Beamon b784ff2839
Merge pull request #3195 from ajbeamon/merge-release6.3-into-master
Merge release-6.3 into master
2020-05-19 13:28:20 -07:00
A.J. Beamon d636194d0d Remove deprecated fields in status: worst_version_lag_storage_server and limiting_version_lag_storage_server 2020-05-19 13:12:10 -07:00
A.J. Beamon 7a09d016a6 Merge branch 'release-6.3' into merge-release6.3-into-master 2020-05-19 12:52:44 -07:00
Steve Atherton 8c3cddc792 Metrics bug fix, page build count was being updated in an incorrect place. 2020-05-19 12:45:32 -07:00
Evan Tschannen 99e1fbdd47 another attempt at speeding up serialization 2020-05-19 12:36:11 -07:00
Bhaskar Muppana 1786469e3c
Merge pull request #2881 from ajbeamon/transaction-profiling-analyzer-perf-improvements
Performance improvements to the transaction profiling analyzer
2020-05-19 10:49:46 -07:00
A.J. Beamon 0da199b201 Move wait_for_shard_addresses into ShardFinder. Remove unneeded transactional decorator. 2020-05-19 08:28:16 -07:00
Steve Atherton 53c4500694 Applied clang-format. 2020-05-19 04:11:39 -07:00
Steve Atherton 0d6f226938 Renamed some metrics to be clearer. Instead of "write" and "update" the terms are now "build" and "modify" which are less confusing and better represent what they mean in terms of DeltaTree operations. 2020-05-19 03:31:03 -07:00
Steve Atherton 4a827c9304 Merge branch 'release-6.3' of github.com:apple/foundationdb into feature-redwood 2020-05-19 03:08:26 -07:00
Steve Atherton 7765168346 Redwood metrics now includes average item count, fill percentage, and record stored percentage for pages written or modified during the metrics interval. 2020-05-19 03:04:39 -07:00
tclinken 9a64ec9343 Use std::copy in Deque copy ctor 2020-05-18 20:41:41 -07:00
Evan Tschannen b7126f0acb experimentally revert serialization of storage server interface 2020-05-18 19:54:09 -07:00
Evan Tschannen 5013bc9106 fixed client compile issues; reduced the size of storage server interface 2020-05-18 17:20:15 -07:00
Andrew Noyes e97517f5eb Add blurb about memory usage 2020-05-18 22:25:59 +00:00
Jingyu Zhou 084afbd22d True-up backup progress may go back multiple epochs
Because the previous epoch may not save some tags, true-up backup progress may
need to go back more than one epoch.
2020-05-18 15:22:44 -07:00
Chaoguang Lin 5c4614f8be delete unnecessary comments 2020-05-18 15:05:55 -07:00
Chaoguang Lin 00dce3ca1d clang-format 2020-05-18 14:23:17 -07:00
Chaoguang Lin e3921504d7 Delete comments 2020-05-18 14:21:38 -07:00
A.J. Beamon fcca49f4d5 Add back an std::move that was accidentally removed. Some other small tweaks to avoid map lookups when tags aren't used. 2020-05-18 13:45:51 -07:00
Andrew Noyes 72a0db1902 Simplify by not mentioning boost
CMake will either try to find it on the system or download it if it
can't
2020-05-18 20:36:35 +00:00
Chaoguang Lin 6e684dda35 Using dd-stats zerobytes const in the workload 2020-05-18 11:53:26 -07:00
Chaoguang Lin 117ed14321 Add dd-stats zerobytes const to systemData 2020-05-18 11:52:36 -07:00
Chaoguang Lin 4bb90cb038 fix serilizer issue 2020-05-18 10:56:10 -07:00
Chaoguang Lin bf62ef7c3e Add dd-stats into special-key-space 2020-05-18 10:38:23 -07:00
Chaoguang Lin f515e2c9d0 Add systemdata for dd-stats 2020-05-18 10:36:34 -07:00
Andrew Noyes f951bc0bbf Remove stale references in readme
E.g. Makefile, LibreSSL, boost 1.67

Also make a few things more concise and consistent in style.
2020-05-18 17:13:20 +00:00
Andrew Noyes 55f0b13fe9 Require c11 atomics
set(CMAKE_C_STANDARD 11)
set(CMAKE_C_STANDARD_REQUIRED ON)

apparently is not enough, and gcc 4.8.5 e.g. passes whatever checks are
done for the above but doesn't support c11 atomics. Let's just check for
them explicitly.
2020-05-18 16:30:12 +00:00
Andrew Noyes 747243e9cb Set CMAKE_{C,CXX}_STANDARD_REQUIRED ON 2020-05-18 16:14:43 +00:00
Steve Atherton f502236c31 Bug fix: BTree page header kvByte count was not being updated when pages are modified without rebuild. 2020-05-18 01:34:57 -07:00
Chaoguang Lin 6ce574f5ad Merge remote-tracking branch 'upstream/release-6.3' into add-data-distribution-metrics 2020-05-17 23:36:52 -07:00
Evan Tschannen be2246c0ee Merge branch 'release-6.3' of github.com:apple/foundationdb into release-6.3 2020-05-17 15:29:12 -07:00
Steve Atherton ca8464881f Applied clang-format. 2020-05-17 00:16:35 -07:00
Steve Atherton d11fd75105 Bug fixes: No-hit page reads would count the access as a hit but would still move the page to the back of the eviction order. Page writes to uncached pages are no longer considered cache misses. 2020-05-17 00:16:10 -07:00
Steve Atherton 6347f76192 More Redwood metrics work. Reworked metrics standard output for unit tests. 2020-05-16 22:21:55 -07:00
tclinken 5632af3b4d Removed inaccurate warning 2020-05-16 20:20:11 -07:00
Jingyu Zhou 9fbbec1033 Fix duplicated counting of memory usage
For each message from LogPeekCursor, check it's using different arena from the
previous one. Otherwise, the arena's memory could be counted twice.
2020-05-16 18:50:09 -07:00
Jingyu Zhou a2e5050492 Fix duplicated mutation
This seems to be related to how actor compiler generates code. The message can
be inserted twice with original code ordering.
2020-05-16 10:52:11 -07:00
Steve Atherton e8626724f9 More refactor of Redwood metrics. Added per-level BTree stats. Added Pager total physical disk reads/writes, and uncacheable read hit/miss counts. Added logging to TraceEvents. 2020-05-16 02:51:57 -07:00
Jingyu Zhou caca31d05a Filter out mutations before the true-up version
When a mutation log's begin version is true-uped, we must filter out mutations
less than such a version.
2020-05-15 20:06:47 -07:00