Commit Graph

747 Commits

Author SHA1 Message Date
Meng Xu 222da17558 Merge branch 'release-6.2' into mengxu/ha-code-read 2020-11-12 13:39:27 -08:00
Meng Xu c2dd7d1d38 Remove unresolved questions 2020-11-11 22:39:11 -08:00
Jingyu Zhou 32a089dde1
Merge pull request #4030 from vishesh/task/issue-connection-logging-count
FlowTransport: Sample connect latencies
2020-11-10 20:00:58 -08:00
Vishesh Yadav 1976f2c371 FlowTransport: Sample connect latencies 2020-11-10 12:12:01 -08:00
Xin Dong 4086e3a275
Merge pull request #3999 from dongxinEric/misc/attach-primary-peek-location-to-logRouterMetrics
Add a way to decorate the trace event created by `traceCounters` with more details.
2020-11-05 09:54:39 -08:00
Jingyu Zhou c69c1064cf
Merge pull request #4006 from vishesh/task/issue-connection-logging-count
FlowTransport: Count number of incoming/outgoing/failed connections in logs
2020-11-03 20:07:37 -08:00
Vishesh Yadav 7bdcb01bdf FlowTransport: Count number of incoming/outgoing/failed connections with logging 2020-11-02 18:51:48 -08:00
Russell Sears 32c87bbb33 Lightweight, power of two spaced histogram implementation + automatic reporting 2020-11-02 11:13:16 -08:00
Meng Xu 1664e2ff7f Add more comments and questions to LR tLog and loadbalance 2020-11-01 21:22:23 -08:00
Xin Dong af7e65110f Allow the caller to decorate role metrics trace event with more details. 2020-10-30 16:20:08 -07:00
Meng Xu 89469921bb
Merge pull request #3891 from etschannen/feature-reset-proxy-connections
Reset a proxy's network connection with the master or resolvers if it is too far behind
2020-10-12 11:21:24 -07:00
Evan Tschannen 52828f9e03 Added bytesSent to the PingLatency logging; increasing the logging interval from 1 second to 3 seconds 2020-10-11 23:05:21 -07:00
Meng Xu 011754fd7e
Merge pull request #3834 from sfc-gh-tclinkenbeard/avoid-ddtracker-slow-task
Avoid slow task in ~DataDistributionTracker
2020-10-08 11:00:19 -07:00
Evan Tschannen e82bd2a6ff added a suppressFor just in case a warning is spammy 2020-10-06 18:27:19 -07:00
Evan Tschannen 29d4d87b56 added a knob for the number of samples 2020-10-06 17:38:09 -07:00
Evan Tschannen d59ee9cc30 add a sample when a ping times out 2020-10-06 17:22:33 -07:00
Evan Tschannen 1eccabc285 added logging for a scenario that should not happen 2020-10-06 17:19:02 -07:00
Evan Tschannen eddf8530d8 fix compile errors 2020-10-06 17:09:14 -07:00
Evan Tschannen 12d2f3a8f3 fixed includes 2020-10-06 17:01:13 -07:00
Evan Tschannen 2c97a7e160 added missing include 2020-10-06 16:56:52 -07:00
Evan Tschannen 822312b31d only track latencies to public network addresses; use a continousSample to get median and p90 latencies 2020-10-06 16:55:35 -07:00
Evan Tschannen 2166f9a3dd added logging about bytes received 2020-10-06 16:07:35 -07:00
Evan Tschannen 9efda1fec5 added logging for the ping latencies for all network connections 2020-10-06 13:58:05 -07:00
sfc-gh-tclinkenbeard 91a8367acb Avoid slow task in ~DataDistributionTracker 2020-10-01 11:44:55 -07:00
Evan Tschannen b4a1c269b8 lastConnectTime was not being set for incomingConnections 2020-08-31 09:10:30 -07:00
Evan Tschannen c9ff450a36 do not reject a connection as redundant if our existing connection is more than 15 seconds old 2020-08-30 18:49:49 -07:00
Evan Tschannen dd10dbe7c7 Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-ha-fixes 2020-07-09 23:09:14 -07:00
Evan Tschannen f6163d0a79 fix compile errors 2020-07-09 22:53:02 -07:00
Evan Tschannen 717242a0ee reset WAN network connections every 5 minutes is responses take more than 500ms 2020-07-09 22:50:47 -07:00
A.J. Beamon 693595f4e5 Fix make build, fix GRV schema 2020-07-09 16:50:08 -07:00
A.J. Beamon 04d1217941 Track statistics about server-side request latency on each process, to include min, max, mean, and various percentiles. 2020-07-09 16:39:15 -07:00
Evan Tschannen 0e557e0832 fixed compiler error 2020-05-29 09:09:09 -07:00
Evan Tschannen 92b10accd3 randomize which tlogs are recruited by the cluster controller 2020-05-29 09:03:42 -07:00
Evan Tschannen 76d4570d5d
Merge pull request #3008 from etschannen/release-6.2
Added logging for parallel peeks from TLogs
2020-04-23 10:27:49 -07:00
Evan Tschannen a835123680 exit fdbserver after a ReceiverError, because a packet which should be delivered will never be received 2020-04-22 23:38:46 -07:00
Evan Tschannen 810bba2067 cleanup calls to FlowTransport::isClient() 2020-04-22 23:36:40 -07:00
Alex Miller 8b004fe8e3 Move stop callbacks to be called after run() in sim2. 2020-04-21 20:22:16 -07:00
Alex Miller 2ce539ef6d Respect flow<->fdbrpc module boundaries.
Which fixes a compilation error due to a circular dependency between
flow.a and fdbrpc.a.  However, this is now done at the cost of newNet2
users have to remember to add Net2FileSystem::stop() as a callback.
2020-04-20 02:53:07 -07:00
Alex Miller 1398e9a82e Stop background eio threads on Net2::stop().
This will stop eio threads for both the client (`fdb_stop_network()`)
and the server.  This change is being done more for the former, but I
don't see any harm in doing the latter as well.
2020-04-18 19:40:55 -07:00
Evan Tschannen c197520fa7
Merge pull request #2810 from alexmiller-apple/fdbcli-tlsinfo
Add a `tlsinfo` command to fdbcli that prints the certificate chain.
2020-03-16 15:47:32 -07:00
Evan Tschannen 243c268d9d Limit the amount of requests the proxy can queue up in memory 2020-03-13 10:17:49 -07:00
Alex Miller 0c558efcfe Add a `tlsinfo` command to fdbcli that prints the certificate chain.
This requires the certificate chain to load successfully, otherwise
fdbcli will error out at an earlier point due to Net2 not being able to
configure TLS.
2020-03-13 00:11:53 -07:00
Evan Tschannen dbfc0cbcc0
Merge pull request #2781 from alexmiller-apple/certificate-refresh
Refresh certificates used for handshaking when they change on disk
2020-03-06 11:12:04 -08:00
A.J. Beamon effb6d2d49 Add ResolverMetrics trace event 2020-03-05 10:49:21 -08:00
Alex Miller 595dd77ed1 Merge remote-tracking branch 'upstream/release-6.2' into certificate-refresh 2020-03-04 20:25:42 -08:00
Alex Miller 9b5ef3416e Refactor TLSParams into TLSConfig + LoadedTLSConfig
The idea being that we keep around a TLSConfig that the configuration
that the user has provided, and then when we want to intialize an SSL
context, we ask the TLSConfig to load all certificates and return us a
LoadedTLSConfig that is a concrete set of certificate bytes in memory.

initTLS now just takes the in-memory bytes and applies them to the ssl
context.

This is a large refactor to lead up into certificate refeshing, where we
will periodically check for changes to the certificates, and then
re-load them and apply them to a new SSL context.
2020-03-04 20:14:47 -08:00
Evan Tschannen 976c2fc7a8
Update fdbrpc/FlowTransport.actor.cpp
Co-Authored-By: Alex Miller <35046903+alexmiller-apple@users.noreply.github.com>
2020-03-04 16:13:59 -08:00
Evan Tschannen 820957025f accept connections in batches of 20 to improve performance 2020-03-04 14:24:57 -08:00
Evan Tschannen 2586bade68 re-added support for configuration TLS options with environment variables 2020-02-26 15:33:48 -08:00
Evan Tschannen d60268123b updated comment 2020-02-25 16:00:46 -08:00