Commit Graph

15245 Commits

Author SHA1 Message Date
Jon Fu a107604d3a Move patch notes to the appropriate section, and add new 6.3.14 notes 2021-05-24 15:53:21 -04:00
Jon Fu eaad5798dd update release notes to match the ones on release-6.3 2021-05-24 15:10:58 -04:00
A.J. Beamon 6ba62e120c
Merge pull request #4856 from sbodagala/master
Expose "bounce impact" and Storage Server "version catch-up rate" metrics
2021-05-24 12:01:50 -07:00
Sreenath Bodagala 19b9a35c58 Expose "bounce impact" and Storage Server "version catch-up rate" metrics
Update the Status section of release-notes-630.rst with info about
the new status fields introduced by PR
https://github.com/apple/foundationdb/pull/4770 .
2021-05-24 18:37:48 +00:00
A.J. Beamon 4133e79c1f
Merge pull request #4770 from sbodagala/master
Expose "bounce impact" and Storage Server "version catch-up rate" metrics
2021-05-21 08:34:18 -07:00
Evan Tschannen ee3e569055
Merge pull request #4843 from sfc-gh-mpilman/features/configure-simulator
allow simulation properties to be overwritten
2021-05-20 16:41:38 -07:00
Markus Pilman 64608fe86b allow simulation properties to be overwritten 2021-05-20 13:48:41 -06:00
Evan Tschannen a15c1f482a
Merge pull request #4836 from sfc-gh-etschannen/feature-fix-missing-final-commit
fixed a rare simulation bug where missingFinalCommit could be skipped by two successive logSystem changes
2021-05-20 09:05:38 -07:00
A.J. Beamon c5d3ff395a
Merge pull request #4834 from sfc-gh-jslocum/trace_parsing_fix
Not swallowing exceptions on malformed XML
2021-05-19 15:23:05 -07:00
Sreenath Bodagala 43e0d362df Address a review comment 2021-05-19 22:12:34 +00:00
Sreenath Bodagala 2fa80e7912 Address review comments 2021-05-19 22:04:43 +00:00
Evan Tschannen 907248dcd4 fixed a rare simulation bug where missingFinalCommit could be skipped by two successive logSystem changes 2021-05-19 13:26:01 -07:00
Josh Slocum d067ca507b Surfacing non-fatal parse errors in Test Harness output 2021-05-19 20:04:12 +00:00
Sreenath Bodagala 622f43474a Expose "bounce impact" and Storage Server "version catch-up rate" metrics
Changes:

Schemas.cpp: Extend the JSON schema to report the new metrics that have
been added.

mr-status-json-schemas.rst.inc: Update the schema to reflect the changes
made to the JSON schema.

release-notes-700.rst: Add a note about the new metrics in "Status"
section.
2021-05-19 19:54:49 +00:00
Sreenath Bodagala 3066e856c9 Expose "bounce impact" and Storage Server "version catch-up rate" metrics
Changes:

storageserver.actor.cpp: Use counters to capture (a) how fast a storage
server is catching up in versions and (b) the version fetch frequency.

Status.actor.cpp: Report the captured counter metrics as part of storage
metrics.
2021-05-19 16:08:32 +00:00
Josh Slocum 0752fb693e
Merge pull request #4780 from sfc-gh-satherton/arena-page
Zero-copy reads in Redwood via Arena-based pages and ability to allocate 4k-aligned memory in Arenas
2021-05-18 16:31:34 -07:00
Renxuan Wang c68bc03a59
Merge pull request #4819 from RenxuanW/tlog-fix
Bring #4518 (Logging more detailed information during Tlog recruitment) back.
2021-05-18 14:20:47 -07:00
RenxuanW 319e77eef1 Add severity in logWorkerUnavailable(). Also, only log when fitness is GoodFit or BestFit. 2021-05-18 12:57:39 -07:00
Steve Atherton f30793fd85 Implement getValuePrefix() using getValue() rather than the other way around to avoid the common getValue()'s actor state increasing from 128 to 256 bytes since it is a very hot code path. 2021-05-17 19:37:03 -07:00
Steve Atherton 60504e12ac Address review comments. 2021-05-17 18:02:09 -07:00
Steve Atherton e40538729e
Update fdbserver/IPager.h
Co-authored-by: Andrew Noyes <andrew.noyes@snowflake.com>
2021-05-17 14:46:06 -07:00
Jingyu Zhou 676f946c47
Merge pull request #4823 from technmsg/patch-1
updated copyright year on web site
2021-05-17 13:19:52 -07:00
Steve Atherton f88596bfd0 Applied clang-format after conflict resolution. 2021-05-16 05:24:19 -07:00
Steve Atherton 390b026f08
Merge branch 'master' into arena-page 2021-05-16 05:06:50 -07:00
Steve Atherton a31e4f622f Changed ArenaBlockRef to use 32 bit aligned4kBuffer size. 2021-05-16 03:58:05 -07:00
Steve Atherton bd0c4a4892 Avoid callers of getValue() and getValuePrefix() from being able to add arena dependencies to the source page arena. 2021-05-16 03:03:55 -07:00
Steve Atherton b4e766bd13 Bug fix, returned value wasn't pointing into the correct arena. 2021-05-16 02:00:43 -07:00
Steve Atherton cfeff9aa4b Clarity improvement, loop was reusing variable name from enclosing scope. 2021-05-16 01:41:40 -07:00
Steve Atherton 6a5bf120f8 Bug fix: It is possible for the pager to be shut down while a cursor operation is acquiring its mutex, specifically after the permit is available but before the delay(0) inside take() is ready, causing the cursor to operate on an invalid pager. 2021-05-15 23:00:21 -07:00
Steve Atherton 2298567c2b Use of aligned_alloc() for 4k pages causes too much wasted virtual memory. Added new 4k-aligned fast allocator, and changed Arena::allocatedAlignedBuffer() to be 4k-specific, now called Arena::allocate4kAlignedBuffer(). 2021-05-14 23:12:00 -07:00
Evan Tschannen 11ca0531ba
Merge pull request #4824 from sfc-gh-ajbeamon/fix-priority-tracking
Fix accounting for time spent in run loop after breaking due to yield
2021-05-14 13:00:56 -07:00
A.J. Beamon d55b94fc06 Add release note 2021-05-14 12:38:26 -07:00
A.J. Beamon a162682d6d Fix accounting for time spent in run loop after breaking due to yield 2021-05-14 11:12:47 -07:00
Alex Moundalexis 70e53605cf
updated copyright year on web site 2021-05-14 10:50:46 -04:00
Andrew Noyes 25f89421cb
Merge pull request #4822 from sfc-gh-anoyes/anoyes/aarch64-fat-jar
Put aarch64 libfdb_java in the right place for fat jar
2021-05-13 17:38:01 -07:00
Andrew Noyes e892ca00e4 Use proper string equality 2021-05-14 00:03:03 +00:00
Renxuan Wang dad265b1c6
Merge pull request #4811 from RenxuanW/worker-fix
Only log timeout when CC is unknown for a worker.
2021-05-13 16:31:49 -07:00
Andrew Noyes 4163270c02 Put aarch64 libfdb_java in the right place for fat jar 2021-05-13 23:13:14 +00:00
Sreenath Bodagala 6275adc5a0 Address build failure
LogSystemPeekCursor.actor.cpp:
Check if "interf" is set before referencing it.
2021-05-13 21:38:07 +00:00
Sreenath Bodagala bdb5517f1e Provide a better explanation of the new metrics in the release notes. 2021-05-13 19:38:05 +00:00
RenxuanW 8a15d7d14b Bring #4518 (Logging more detailed information during Tlog recruitment) back. 2021-05-13 12:20:31 -07:00
Sreenath Bodagala 99f6032239 Report bounce impact info as part of cluster JSON object. 2021-05-13 16:47:05 +00:00
Sreenath Bodagala d8cad8efca Report bounce impact info as part of cluster JSON object. 2021-05-13 16:36:57 +00:00
Sreenath Bodagala 160293bd54 Report bounce impact in fdbcli status
Changes:

Schemas.cpp: Extend the JSON schema to report whether the cluster is
bounceable and if not, report the reason for why it is not bounceable.

Status.actor.cpp: Extend recoveryStateStatusFetcher() to populate the
bounce related field(s).

mr-status-json-schemas.rst.inc: Update the schema to reflect the change
made in Schemas.cpp.

release-notes-700.rst: Add a note about the new status fields in "Status"
section.
2021-05-13 14:28:06 +00:00
RenxuanW cc6497ddfb Only log timeout when CC is unknown for a worker. 2021-05-12 16:24:13 -07:00
Andrew Noyes 061afda2ec
Fix several package issues (#4801)
* Make the structure of the server pkg match 6.2.28

* Fix OSX lib path

* Fix install destinations in client

Previously, backup_agent would map to fdbmonitor installation dir -
which is incorrect in the sense that it disagrees with where the default
foundationdb.conf expects to find backup_agent. Add a new backupagent
installation dir and install there, matching foundationdb.conf's
expectations.

Also fix an issue where several of the versions of fdbbackup weren't
being installed

* Update packaging/osx/buildpkg.sh for cmake

* Update README instructions for pkg file

* Remove osx cpack config

* Remove pm install destinations

* Fix weird syntax

* Remove cpack reference to PM

* Address review comments
2021-05-12 11:41:26 -05:00
Sreenath Bodagala 78ef6822f6 Capture how fast an SS is catching up to its tLog-SS lag
Changes:

storagegroupserver.actor.cpp:

- Report "fetchedVersions" and "duration" as part of StorageMetrics
trace event.

- Report "sourceTLogID" as a separte trace event (and report this
only when it changes)..
2021-05-12 16:40:33 +00:00
Russell Sears 947eace82d
Merge pull request #4807 from Daniel-B-Smith/patch-1
Set connectionFile instead of creating a shadow
2021-05-12 08:58:57 -07:00
Daniel Smith 4361dcca2e
Set connectionFile instead of creating a shadow 2021-05-12 11:54:55 -04:00
Lukas Joswiak 6499fa178e
Merge pull request #4802 from sfc-gh-ljoswiak/revert/actor-lineage
Revert "Merge pull request #4136 from sfc-gh-mpilman/features/actor-l…
2021-05-11 18:50:42 -07:00