Commit Graph

1294 Commits

Author SHA1 Message Date
Evan Tschannen b9a4c7418a fixed typo 2021-01-27 14:10:06 -08:00
Evan Tschannen 3ee5831287 fault injection can now cause a disk to stop responding 2021-01-27 13:57:54 -08:00
Steve Atherton 989fee908a More bug fixes in SQLite file handle lifetimes after storage server restart (including simulated process reboot) when a write rate limit is used. Added several debug trace events, renamed some VFSAsync* events to be more consistent. 2021-01-27 00:01:33 -08:00
Markus Pilman d3a85b555a CoroFlow and remove libcoro 2021-01-26 17:23:17 -07:00
Steve Atherton d718e7baf3
Merge pull request #4179 from sfc-gh-tclinkenbeard/run-minio-joshua
Support Testing S3BlobStore backup in simulation
2021-01-26 14:39:57 -08:00
sfc-gh-tclinkenbeard 27314b111c Fix Windows build issues 2021-01-26 13:41:37 -08:00
Andrew Noyes 3560003c50 Fix missing override in fdbrpc/FlowTests.actor.cpp 2021-01-26 17:29:54 +00:00
sfc-gh-tclinkenbeard bb1dd21c22 Define BOOST_DATE_TIME_NO_LIB in sim2.actor.cpp 2021-01-25 18:06:55 -08:00
Andrew Noyes 4ee97c0784 Use clang-tidy to automatically fix missing overrides
Use `clang-tidy -p . $file -checks='-*,modernize-use-override' -header-filter='.*' -fix`
to fix missing overrides, and then use git clang-format to reformat just
those changes. This went pretty well for most files.

Formatting the following files went off the rails, so I'm going to
follow up with a commit that's just clang-tidy and no clang-format.

- fdbclient/DatabaseBackupAgent.actor.cpp
- fdbclient/FileBackupAgent.actor.cpp
- fdbserver/OldTLogServer_4_6.actor.cpp
- fdbmonitor/SimpleIni.h
- fdbserver/workloads/ClientTransactionProfileCorrectness.actor.cpp
2021-01-26 02:04:12 +00:00
sfc-gh-tclinkenbeard 88cc2f752a Define BOOST_DATE_TIME_NO_LIB in SimExternalConnection.actor.cpp 2021-01-25 16:23:36 -08:00
Jon Fu c3775ede37 add override keyword properly to squash compiler warnings 2021-01-25 13:24:15 -05:00
Steve Atherton 0d32bd0c44 Bug fixes involving use of AFCached rate control in simulation. 2021-01-24 01:50:09 -08:00
sfc-gh-tclinkenbeard 51cbc494f1 Merge remote-tracking branch 'origin/master' into run-minio-joshua 2021-01-23 11:31:19 -08:00
sfc-gh-tclinkenbeard 82a8f1c763 Fix -Wreturn-type warning 2021-01-22 12:13:29 -08:00
sfc-gh-tclinkenbeard fb9b4b7626 Merge remote-tracking branch 'origin/master' into misc-changes 2021-01-21 10:45:50 -08:00
Lukas Joswiak 3f7e19a182 Add tags to spans to provide additional metadata 2021-01-20 13:57:36 -08:00
Lukas Joswiak 98e6ba6962 Add POSIX send functionality 2021-01-20 13:57:36 -08:00
Lukas Joswiak d2143f184a Add fast UDP tracer 2021-01-20 13:57:36 -08:00
Markus Pilman fb64902d5c Assign roles 2021-01-19 16:04:09 -07:00
Steve Atherton 523a8c08db Merge branch 'add-throttling-on-AsyncfileCached' of github.com:sfc-gh-clin/foundationdb into afcache-write-limit
# Conflicts:
#	flow/Knobs.h
2021-01-17 05:30:55 -08:00
sfc-gh-tclinkenbeard 191f215b9d Remove chrono dependency 2021-01-13 21:54:22 -08:00
Markus Pilman 8e93573aad Merge branch 'master' of github.com:apple/foundationdb into features/actor-lineage 2021-01-05 10:24:45 -07:00
sfc-gh-tclinkenbeard 61a29ecfc8 Merge remote-tracking branch 'origin/master' into run-minio-joshua 2021-01-01 09:38:36 -04:00
sfc-gh-tclinkenbeard 86c7c1e946 Fix IAsyncFileSystem method signatures 2020-12-28 01:57:42 -04:00
sfc-gh-tclinkenbeard 5bfa6cea98 Merge remote-tracking branch 'origin/master' into misc-changes 2020-12-26 20:47:00 -04:00
sfc-gh-tclinkenbeard 913401aaee Move SendBufferIterator out of network.h
This class is only needed for implementation in Net2.actor.cpp and
SimExternalConnection.actor.cpp, so this class should not be included
everywhere network.h is included
2020-12-26 16:30:00 -04:00
sfc-gh-tclinkenbeard 0b45c969b9 Remove invalid assertion from SimExternalConnection::read 2020-12-24 21:20:04 -04:00
sfc-gh-tclinkenbeard a7202a5b42 Use connectExernal in INetworkConnections::connect 2020-12-24 21:20:04 -04:00
sfc-gh-tclinkenbeard 1dfa2acb93 Reduce sleep in SimExternalConnection::write 2020-12-24 21:20:04 -04:00
sfc-gh-tclinkenbeard d9b5309f4f Add random delays to SimExternalConnection 2020-12-24 21:20:04 -04:00
sfc-gh-tclinkenbeard 917da45c3f Miscellaneous improvements to SimExternalConnection unit test 2020-12-24 21:20:04 -04:00
sfc-gh-tclinkenbeard 555c3d95fc Added fdbrpc/SimExternalClient unit test 2020-12-24 21:20:03 -04:00
sfc-gh-tclinkenbeard 201857541d Remove unnecessary copies from INetworkConnections interface 2020-12-24 21:20:03 -04:00
sfc-gh-tclinkenbeard 94d7c17978 Implemented SimExternalConnection::onReadable 2020-12-24 21:20:03 -04:00
sfc-gh-tclinkenbeard 8cb029b777 Made SimExternalConnection reading and writing deterministic 2020-12-24 21:20:03 -04:00
sfc-gh-tclinkenbeard 16476ec9e1 Implemented SimExternalConnection::read 2020-12-24 21:20:03 -04:00
sfc-gh-tclinkenbeard 1e7ea8ece1 Implemented SimExternalConnection::write 2020-12-24 21:20:02 -04:00
sfc-gh-tclinkenbeard 87282eda47 Implemented SimExternalConnection::getPeerAddress 2020-12-24 21:20:02 -04:00
sfc-gh-tclinkenbeard 9f22ae7831 Implement SimExternalConnection::connect 2020-12-24 21:20:02 -04:00
sfc-gh-tclinkenbeard fed1a03950 Added SimExternalConnection (most methods not implemented yet) 2020-12-24 21:20:02 -04:00
Chaoguang Lin 315557f58f Not all flush will write to disk 2020-12-11 10:34:36 -08:00
Andrew Noyes 9601769b01
Merge pull request #3858 from sfc-gh-rchen/stable_interfaces
Stable interfaces
2020-12-11 09:34:27 -08:00
Richard Chen 5f57d72a59 remove print statements and format protocol version workload 2020-12-11 04:46:20 +00:00
Markus Pilman f8e1df6c4f Support for actor stack traces 2020-12-10 10:42:04 -07:00
Chaoguang Lin 265a88e2ac Fix signature 2020-12-09 22:30:18 -08:00
Markus Pilman 390a82b6a2
Fix old typo
Co-authored-by: Andrew Noyes <63815641+sfc-gh-anoyes@users.noreply.github.com>
2020-12-09 13:51:50 -07:00
Chaoguang Lin 5b55216252 Add rate control to AsyncFileCached 2020-12-09 12:03:32 -08:00
Markus Pilman 9344a5fd0a Fix Coro ucontext bug introduced in #4109 2020-12-09 12:25:31 -07:00
Markus Pilman 0d324cee80 Annotation framework and role lineage 2020-12-09 10:19:59 -07:00
Chaoguang Lin f8ed207ee4 Change timer() to now() to preserve determinism 2020-12-08 16:44:39 -08:00
Chaoguang Lin 87a26ac55c Remove unnecessay m_budget_max, and update the constructor 2020-12-08 16:26:09 -08:00
Lukas Joswiak 7ac5aa48ed Fix UDP simulation bug with duplicate ports
Occasionally, a second UDP socket would be created with a randomly generated
port equal to the randomly generated port of an earlier socket.
2020-12-08 17:38:32 +00:00
sfc-gh-tclinkenbeard c8786a65c3 Remove unnecessary uses of virtual 2020-12-08 09:09:33 -08:00
sfc-gh-tclinkenbeard cb97ab8356 Use unique pointers in LatencyBands 2020-12-08 09:09:32 -08:00
sfc-gh-tclinkenbeard d15441e85c Replace non-standard sealed with final 2020-12-08 09:09:30 -08:00
sfc-gh-tclinkenbeard f3c0d26806 Make ISimulator::BackupAgentType an enum class 2020-12-08 09:09:30 -08:00
sfc-gh-tclinkenbeard c914620c10 Fix signatures for ISimulator methods 2020-12-08 09:09:29 -08:00
sfc-gh-tclinkenbeard 9d395a926d Make ISimulator::ProcessInfo::getListener const 2020-12-08 09:09:29 -08:00
Richard Chen c77d9e4abe merge conflicts 2020-12-02 21:53:19 +00:00
Andrew Noyes 1f541f02be Merge branch 'anoyes/merge-6.2-to-6.3' into anoyes/release-6.3-merge
Merge, leaving conflict markers for now
2020-11-24 16:55:34 +00:00
David Youngworth d64cf8b9e3 Merge branch 6.3 into master 2020-11-17 11:22:45 -08:00
David Youngworth d0391db862 Merge branch 'release-6.2' into release-6.3 2020-11-16 10:15:23 -08:00
Markus Pilman 953bb98f02 attempt to fix windows build 2020-11-13 15:39:51 -07:00
Markus Pilman d3598bfaa4 address review comments 2020-11-13 15:37:03 -07:00
Meng Xu 222da17558 Merge branch 'release-6.2' into mengxu/ha-code-read 2020-11-12 13:39:27 -08:00
Markus Pilman 0f205620bf
Merge branch 'master' into features/udp 2020-11-12 13:51:17 -07:00
Markus Pilman d853892b41
Bugfix
Co-authored-by: Lukas Joswiak <lukas.joswiak@snowflake.com>
2020-11-12 13:48:23 -07:00
Meng Xu c2dd7d1d38 Remove unresolved questions 2020-11-11 22:39:11 -08:00
Jingyu Zhou 32a089dde1
Merge pull request #4030 from vishesh/task/issue-connection-logging-count
FlowTransport: Sample connect latencies
2020-11-10 20:00:58 -08:00
Markus Pilman bdd3dbfa7d remove duplicates 2020-11-10 14:01:07 -07:00
Vishesh Yadav 1976f2c371 FlowTransport: Sample connect latencies 2020-11-10 12:12:01 -08:00
sfc-gh-tclinkenbeard 4669f837fa Add uses of makeReference 2020-11-07 22:10:18 -08:00
Xin Dong 4086e3a275
Merge pull request #3999 from dongxinEric/misc/attach-primary-peek-location-to-logRouterMetrics
Add a way to decorate the trace event created by `traceCounters` with more details.
2020-11-05 09:54:39 -08:00
Andrew Noyes 1c05b70942 Add INetwork::timer_monotonic 2020-11-05 17:07:49 +00:00
Jingyu Zhou c69c1064cf
Merge pull request #4006 from vishesh/task/issue-connection-logging-count
FlowTransport: Count number of incoming/outgoing/failed connections in logs
2020-11-03 20:07:37 -08:00
Vishesh Yadav 7bdcb01bdf FlowTransport: Count number of incoming/outgoing/failed connections with logging 2020-11-02 18:51:48 -08:00
Russell Sears 32c87bbb33 Lightweight, power of two spaced histogram implementation + automatic reporting 2020-11-02 11:13:16 -08:00
Meng Xu 1664e2ff7f Add more comments and questions to LR tLog and loadbalance 2020-11-01 21:22:23 -08:00
Richard Chen 9c6c2704d0 Merge branch 'master' of https://github.com/apple/foundationdb into stable_interfaces 2020-10-30 23:59:32 +00:00
Xin Dong af7e65110f Allow the caller to decorate role metrics trace event with more details. 2020-10-30 16:20:08 -07:00
sfc-gh-tclinkenbeard 09350c760e Merge remote-tracking branch 'origin/master' into merge 2020-10-30 08:36:19 -07:00
Trevor Clinkenbeard 0faaecc780
Merge branch 'master' into merge 2020-10-29 22:27:40 -07:00
sfc-gh-tclinkenbeard cf4c8e375f Merge remote-tracking branch 'origin/release-6.3' into merge 2020-10-29 22:15:41 -07:00
sfc-gh-tclinkenbeard 55e86c1336 Disambiguate between S3BlobStore and other blob stores 2020-10-29 20:42:23 -07:00
Steve Atherton 96cc700440
Merge pull request #3961 from sfc-gh-tclinkenbeard/azure-backup
Add support for writing backup files directly to Azure blob storage
2020-10-29 00:30:40 -07:00
Andrew Noyes e82339f40e
Merge pull request #3906 from sfc-gh-anoyes/anoyes/use-gcov
Add USE_GCOV cmake option
2020-10-27 08:27:46 -07:00
Richard Chen 5b546c4854 change protocol version to hex encoded string in status json. Move constant from flow transport header to cpp 2020-10-26 19:35:38 +00:00
sfc-gh-tclinkenbeard 82b6daa16b First draft of Azure blob storage backup container 2020-10-24 16:47:51 -07:00
Richard Chen ce3f09699f revert checksum 2020-10-23 21:23:28 +00:00
Richard Chen 309e38dc06 add unit test and some cleanup 2020-10-23 19:34:18 +00:00
Richard Chen 055add9682 conflicts 2020-10-23 06:33:00 +00:00
Richard Chen 90caa24af1 add function to get correct checksum class. Remove IChecksum::checkSum function 2020-10-23 02:24:29 +00:00
Xin Dong ea5225c600
Merge pull request #3927 from ajbeamon/fix-roughness-elapsed
Fix roughness elapsed time
2020-10-21 09:52:28 -07:00
Young Liu 8cc3e4d3c6 Merge release-6.3 into master 2020-10-19 22:51:56 -07:00
Richard Chen c84a5f4014 change IChecksum interface and remove coordinator protocol version optional 2020-10-19 21:39:07 +00:00
A.J. Beamon 00912f5855 Don't use the end of a window in calculating the elapsed time for roughness 2020-10-19 13:40:16 -07:00
Richard Chen f2a8687c7c fix merge conflicts 2020-10-19 17:00:41 +00:00
Richard Chen a4ccf8c5b6 add checksum class to change checksum in the future. expose get server protocol api 2020-10-19 16:57:11 +00:00
Richard Chen 545ee4269d master conflicts 2020-10-19 01:03:54 +00:00
Richard Chen 1c533e7363 fix flowtransport conflicts 2020-10-19 01:00:03 +00:00
Jingyu Zhou d7420bb8c7 Fix merging 6.3 caused test failure 2020-10-16 21:11:01 -07:00
Jingyu Zhou 8f17a1a5d6 Merge branch 'release-6.2' into release-6.3 2020-10-16 15:25:39 -07:00
Andrew Noyes 7b6dae6314 prctl is not instrumented by msan 2020-10-15 17:08:41 +00:00
Andrew Noyes b2d9b93243
Merge pull request #3847 from sfc-gh-tclinkenbeard/refactor-workloads
Modernize TestWorkload overrides
2020-10-14 15:07:03 -07:00
Richard Chen 4eb20a1283 merge anoyes/stable-interface and add back in isCompatible 2020-10-12 20:39:37 +00:00
Richard Chen 2f5b0bef08 switch to test newer incompatible version. Fix PR comments. Modify schema 2020-10-12 18:29:16 +00:00
Richard Chen bbf5bdf6da fix stable interfaces test and corresponding changes in simulator 2020-10-12 18:25:12 +00:00
Richard Chen 5488ff1d81 draft diff protocol 2020-10-12 18:24:03 +00:00
Meng Xu 89469921bb
Merge pull request #3891 from etschannen/feature-reset-proxy-connections
Reset a proxy's network connection with the master or resolvers if it is too far behind
2020-10-12 11:21:24 -07:00
Richard Chen b233f44d2d remove some print statements and spin lock that was used for debugging 2020-10-12 18:20:37 +00:00
Richard Chen 41843f07e6 add simulator support for different process versions and ProtocolVersion test 2020-10-12 18:19:31 +00:00
Richard Chen 76d0027fa2 merge anoyes/stable-interface and add back in isCompatible 2020-10-12 18:18:30 +00:00
Evan Tschannen 52828f9e03 Added bytesSent to the PingLatency logging; increasing the logging interval from 1 second to 3 seconds 2020-10-11 23:05:21 -07:00
Richard Chen 8c96763ea9 switch to test newer incompatible version. Fix PR comments. Modify schema 2020-10-09 20:22:40 +00:00
sfc-gh-tclinkenbeard ccf2ca73f3 Fix Windows CMake build 2020-10-08 23:58:58 -07:00
Meng Xu 011754fd7e
Merge pull request #3834 from sfc-gh-tclinkenbeard/avoid-ddtracker-slow-task
Avoid slow task in ~DataDistributionTracker
2020-10-08 11:00:19 -07:00
sfc-gh-tclinkenbeard a9607bdcec Explicitly seal classes that inherit but aren't inherited from 2020-10-07 21:58:24 -07:00
sfc-gh-tclinkenbeard 71d0ef676c Use override where applicable in fdbrpc 2020-10-07 19:55:05 -07:00
Evan Tschannen f03a355c4e Merge branch 'release-6.2' into release-6.3
# Conflicts:
#	CMakeLists.txt
#	documentation/sphinx/source/downloads.rst
#	fdbrpc/FlowTransport.actor.cpp
#	fdbrpc/FlowTransport.h
#	flow/Arena.h
#	flow/Knobs.cpp
#	flow/Knobs.h
#	packaging/msi/FDBInstaller.wxs
2020-10-07 12:28:22 -07:00
Evan Tschannen e82bd2a6ff added a suppressFor just in case a warning is spammy 2020-10-06 18:27:19 -07:00
Evan Tschannen 29d4d87b56 added a knob for the number of samples 2020-10-06 17:38:09 -07:00
Evan Tschannen d59ee9cc30 add a sample when a ping times out 2020-10-06 17:22:33 -07:00
Evan Tschannen 1eccabc285 added logging for a scenario that should not happen 2020-10-06 17:19:02 -07:00
Evan Tschannen eddf8530d8 fix compile errors 2020-10-06 17:09:14 -07:00
Evan Tschannen 12d2f3a8f3 fixed includes 2020-10-06 17:01:13 -07:00
Evan Tschannen 2c97a7e160 added missing include 2020-10-06 16:56:52 -07:00
Evan Tschannen 822312b31d only track latencies to public network addresses; use a continousSample to get median and p90 latencies 2020-10-06 16:55:35 -07:00
Evan Tschannen 2166f9a3dd added logging about bytes received 2020-10-06 16:07:35 -07:00
Richard Chen 2a172ff05f fix stable interfaces test and corresponding changes in simulator 2020-10-06 22:20:47 +00:00
Evan Tschannen 9efda1fec5 added logging for the ping latencies for all network connections 2020-10-06 13:58:05 -07:00
Evan Tschannen 7ba06a4434 fix: min and max compute estimate logging on the proxy was always zero
added comments and fixed formatting
2020-10-05 12:35:10 -07:00
Richard Chen c32d99a908 draft diff protocol 2020-10-05 17:07:51 +00:00
sfc-gh-tclinkenbeard 7f0d14c8e4 Modernize/refactor workloads directory 2020-10-04 22:29:07 -07:00
Evan Tschannen 614c8bc895 Get read versions requests must be load balanced on the number of requests because ratekeeper gives out an equal budget to each proxy 2020-10-04 16:20:24 -07:00
sfc-gh-tclinkenbeard 91a8367acb Avoid slow task in ~DataDistributionTracker 2020-10-01 11:44:55 -07:00
Balachandar Namasivayam c7a55fe15f
Merge pull request #3829 from yliucode/process-class
Support specifying proxy as process class and converting it to commit proxy
2020-09-30 16:46:24 -07:00
Young Liu c34385ef7b Support proxy process class 2020-09-30 01:23:10 -07:00
Richard Chen ecf2000b24 remove some print statements and spin lock that was used for debugging 2020-09-28 18:44:49 +00:00
Richard Chen c4c5d74c49 add simulator support for different process versions and ProtocolVersion test 2020-09-28 18:15:40 +00:00
sfc-gh-tclinkenbeard 84cce687da Make IFailureMonitor const-correct 2020-09-27 15:27:51 -07:00
sfc-gh-tclinkenbeard 390c26b352 Replace NULL with nullptr in fdbrpc 2020-09-20 11:33:18 -07:00
Richard Chen b42ae238b9 merge anoyes/stable-interface and add back in isCompatible 2020-09-19 03:54:24 +00:00
Young Liu cc5bc16bd8 Rename more places from proxy to commit proxy 2020-09-15 22:29:49 -07:00
Young Liu 35bef73a1c Rename proxy to commit proxy 2020-09-10 17:44:15 -07:00
Young Liu 87693cae81 merge master branch and resolve conflicts 2020-09-02 13:44:33 -07:00
Evan Tschannen 12edadd059 Merge branch 'release-6.3'
# Conflicts:
#	CMakeLists.txt
#	fdbclient/Knobs.cpp
#	fdbclient/MasterProxyInterface.h
#	fdbrpc/simulator.h
#	fdbserver/MasterProxyServer.actor.cpp
#	tests/fast/CycleAndLock.txt
#	tests/fast/TxnStateStoreCycleTest.txt
#	tests/fast/VersionStamp.txt
#	tests/slow/ParallelRestoreOldBackupApiCorrectnessAtomicRestore.txt
#	tests/slow/ParallelRestoreOldBackupCorrectnessCycle.txt
#	versions.target
2020-08-31 19:33:34 -07:00
Evan Tschannen cbded48b70 Merge branch 'release-6.3' of github.com:apple/foundationdb into release-6.3 2020-08-31 11:06:13 -07:00
Evan Tschannen 1883f0d21f Merge branch 'release-6.2' into release-6.3 2020-08-31 10:40:52 -07:00
Evan Tschannen 5c97461d18
Merge pull request #3653 from etschannen/feature-proxy-busy-loadbalance
Changed proxy load balancing to balance on CPU usage
2020-08-31 10:39:08 -07:00
Young Liu 8994719e46 Merge branch 'master' into grv-proxy 2020-08-31 10:21:32 -07:00
Evan Tschannen b4a1c269b8 lastConnectTime was not being set for incomingConnections 2020-08-31 09:10:30 -07:00
Evan Tschannen 29eec30183 Merge branch 'release-6.2' into release-6.3
# Conflicts:
#	CMakeLists.txt
#	build/Dockerfile
#	build/Dockerfile.devel
#	documentation/sphinx/source/downloads.rst
#	fdbserver/Knobs.cpp
#	fdbserver/LogSystem.h
#	fdbserver/MasterProxyServer.actor.cpp
#	fdbserver/TagPartitionedLogSystem.actor.cpp
#	fdbserver/WaitFailure.actor.cpp
#	fdbserver/fdbserver.vcxproj
#	fdbserver/fdbserver.vcxproj.filters
#	packaging/msi/FDBInstaller.wxs
2020-08-31 01:10:29 -07:00
Evan Tschannen c9ff450a36 do not reject a connection as redundant if our existing connection is more than 15 seconds old 2020-08-30 18:49:49 -07:00
Evan Tschannen 939f59d989
Merge pull request #3672 from sfc-gh-tclinkenbeard/make-iasyncfile-const-correct
Make IAsyncFile const-correct
2020-08-27 11:22:46 -07:00
Young Liu e8e24a8ed6 Resolve comments 2020-08-26 21:04:35 -07:00
Meng Xu a2ab709a0c BackupContainer:Use processId as the process filename
instead of using a randomly generated string which change every time
when a file is open.

Having too many files will trigger TOO_MANY_FILES error
2020-08-26 15:54:34 -07:00
Young Liu 63b3612ad5 Merge master branch and resolve conflicts 2020-08-24 16:42:31 -07:00
Monsij Biswal 0239d612d1 Verbose printf cleanup 2020-08-23 13:35:00 +05:30
Stewart Henderson 6a8da71e80 Issue 1647 Resolution 2020-08-21 06:12:39 -05:00
sfc-gh-tclinkenbeard 6e0df3b9ac Fix AsyncFileWinASIO build 2020-08-19 21:05:56 -07:00
sfc-gh-tclinkenbeard c8b774a30a Explicitly mark IAsyncFile functions as overrided 2020-08-19 18:17:32 -07:00
sfc-gh-tclinkenbeard 157700e5b6 Make IAsyncFile const-correct 2020-08-19 17:34:56 -07:00
Evan Tschannen 9e2ee1ed4c fixed lastedZeroBusy; added a knob 2020-08-17 23:16:59 -07:00
Evan Tschannen 7c84e04028 fixed compiler errors 2020-08-12 17:22:37 -07:00
Evan Tschannen c72068d6b5 clients load balance across proxies based on process busyness instead of number of requests 2020-08-12 17:17:21 -07:00
Young Liu 8953cc5f98 Merge master again 2020-08-12 16:59:07 -07:00
Young Liu 79ce16650d merge master branch 2020-08-11 19:22:10 -07:00
Young Liu ba803a5ea3 Fixed formatting issues and removed GRV related code in MasterProxy 2020-08-11 18:54:54 -07:00
David Youngworth 3192984309 Remove unused zlib library 2020-08-11 17:15:07 -07:00
Markus Pilman a88d2f72e4 Simulation test now working 2020-08-11 15:34:59 -06:00
Young Liu 104bac3cbd Add trace to debug 2020-08-07 13:02:41 -07:00
Markus Pilman 6d84bcb568 Merge remote-tracking branch 'origin/master' into features/udp 2020-08-06 14:08:34 -06:00
Markus Pilman 8976694ba1 UDP implementation (untested) 2020-08-06 14:06:50 -06:00
Young Liu d6a23a4d6b Resolve comments to make GRV proxy a separate process class 2020-08-06 00:01:57 -07:00
Evan Tschannen 5c7b4c7acf Merge branch 'master' of github.com:apple/foundationdb 2020-07-31 15:58:13 -07:00
Meng Xu ea2837dd5e Remove bogus function that is never used 2020-07-30 09:24:08 -07:00
Evan Tschannen a49cb41de7 Merge branch 'release-6.3'
# Conflicts:
#	CMakeLists.txt
#	cmake/ConfigureCompiler.cmake
#	fdbserver/Knobs.cpp
#	fdbserver/StorageCache.actor.cpp
#	fdbserver/storageserver.actor.cpp
#	flow/ThreadHelper.actor.h
#	flow/serialize.h
#	tests/CMakeLists.txt
2020-07-29 00:31:55 -07:00
Meng Xu a2089b354a RemoveServersSafely:Safety check toKill1 to avoid cluster getting stuck
toKill1 and toKill2 are a random subset of all processes. If simply kill all processes in toKill1 or toKill2,
we may kill too many processes to make the cluster unavailable and stuck.

Similar as what toKill2 were modified if it can cause cluster unavailable,
we should do the same thing for toKill1
2020-07-28 21:07:31 -07:00
Young Liu 229ab0d5f1 Fix some conflicts and remote debugging trace events 2020-07-22 23:35:46 -07:00
Young Liu 525f10e30c Merge master branch 2020-07-22 16:08:49 -07:00
Young Liu 302cf5c45f Remove debug trace events 2020-07-22 12:20:22 -07:00
Russell Sears ab0d8b0626
Merge pull request #3509 from sfc-gh-anoyes/anoyes/remove-using-relops
Remove using namespace std::rel_ops
2020-07-22 11:58:25 -07:00
sfc-gh-tclinkenbeard abaae40453 Modified ComposedIdentifier to prevent file identifier conflicts at
compile-time
2020-07-20 18:52:44 -07:00
Steve Atherton 38cade1146 Merged tag release-6.3.3 into tls-background-handshake. 2020-07-17 23:39:57 -07:00
Young Liu 2703cedac5 Fixed known bugs 2020-07-17 22:24:52 -07:00
Steve Atherton d375ee7939 Rolled back the knob and logic for doing multiple write() calls in write loops before yielding, because they are not necessary. The testing that suggested otherwise was in error. 2020-07-16 22:54:14 -07:00
Steve Atherton c4f3553826 TLS handshake limit changed to regular flow lock, added new knob for simultaneous handshakes limit and removed old knobs. Added knob to control how much data the FlowTransport connectionWriter() can write using multiple write() calls before yielding to other tasks, and updated p2p network test to use the same logic. Changed knob defaults for send limit on single writes and TLS handshake thread count. 2020-07-16 02:31:17 -07:00
Young Liu 5b06d69d25 Pass watches test 2020-07-15 00:37:41 -07:00
Meng Xu 47ae66bd61 Merge branch 'master' into mengxu/tmp-minor-comment-PR
Resolve conflict at waitFailureClient
2020-07-13 16:17:50 -07:00
Meng Xu 8ae0d9b73d Resolve merge conflict 2020-07-13 10:21:53 -07:00
Meng Xu ef8c1060a2 Merge branch 'master' into mengxu/tmp-merge-6.3 2020-07-13 10:15:56 -07:00
Meng Xu 6f2e12be42 Minor improvement on comments 2020-07-12 18:32:47 -07:00
Jingyu Zhou a3245d5cc2 Address review comments 2020-07-10 19:04:35 -07:00
Andrew Noyes f470ba8316 Remove using namespace std::rel_ops
This causes the following to not compile anymore

\#include <utility>
\#include <vector>

using namespace std::rel_ops;

int main() {
    std::vector<int> xs;
    return xs.rbegin() != xs.rend();
}

See https://godbolt.org/z/s1977n
2020-07-10 22:58:15 +00:00
A.J. Beamon b09dddc07e Merge branch 'release-6.2' into merge-release-6.2-into-release-6.3
# Conflicts:
#	cmake/ConfigureCompiler.cmake
#	documentation/sphinx/source/downloads.rst
#	fdbrpc/FlowTransport.actor.cpp
#	fdbrpc/fdbrpc.vcxproj
#	fdbserver/DataDistributionQueue.actor.cpp
#	fdbserver/Knobs.cpp
#	fdbserver/Knobs.h
#	fdbserver/LogSystemPeekCursor.actor.cpp
#	fdbserver/MasterProxyServer.actor.cpp
#	fdbserver/Status.actor.cpp
#	fdbserver/storageserver.actor.cpp
#	flow/flow.vcxproj
2020-07-10 15:06:34 -07:00
Jingyu Zhou 2e5ae8eed5 Change iterator name to small case 2020-07-10 10:56:41 -07:00
Jingyu Zhou 1a57d88179 Add const iterator for RangeMap 2020-07-10 10:56:41 -07:00
Evan Tschannen dd10dbe7c7 Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-ha-fixes 2020-07-09 23:09:14 -07:00
Evan Tschannen f6163d0a79 fix compile errors 2020-07-09 22:53:02 -07:00
Evan Tschannen 717242a0ee reset WAN network connections every 5 minutes is responses take more than 500ms 2020-07-09 22:50:47 -07:00