Commit Graph

142 Commits

Author SHA1 Message Date
Evan Tschannen 2627bcd35e Merge branch 'master' into feature-metadata-version 2019-03-10 21:13:28 -07:00
Andrew Noyes 121ed4acf9 Trace the cmake SEED
This will be included in the repro instructions, so we need to trace it
to keep track of it.
2019-03-08 15:03:56 -08:00
Steve Atherton 21f55e1878
Merge pull request #1190 from bnamasivayam/restore-multiple-ranges
Add support for restoring multiple ranges.
2019-03-05 10:15:55 -08:00
Evan Tschannen 075fdef31a Merge branch 'master' into feature-metadata-version
# Conflicts:
#	fdbclient/DatabaseContext.h
2019-03-03 22:58:45 -08:00
Evan Tschannen 057ebe56e4 fix: unknownCommit handling relied on soleOwnership of the version stamp keys, so we need to use a second key to track the commit version for the metadataVersionKey
renamed a confusing option
2019-03-03 21:31:40 -08:00
Evan Tschannen 3da85f3acd implemented the \xff/metadataVersion key, which can be used by layers to help them cheaply cache metadata and know when their cache is invalid 2019-02-28 17:45:00 -08:00
Trevor Clinkenbeard d2bde4e55b Merge branch 'master' of https://github.com/apple/foundationdb into add-health-metrics 2019-02-27 16:30:25 -08:00
Evan Tschannen 8afb7fbb9d
Merge pull request #1160 from alexmiller-apple/tstlog-fork
Spill-By-Reference TLog Part 2: New and Old TLogServers co-exist harmoniously
2019-02-26 18:00:04 -08:00
Balachandar Namasivayam 7eba50b086 Add support for restoring multiple ranges. 2019-02-25 18:00:28 -08:00
Trevor Clinkenbeard abfe057805 Merge branch 'master' of https://github.com/apple/foundationdb into add-health-metrics 2019-02-25 13:47:16 -08:00
Evan Tschannen b8910ba7cd Merge branch 'master' into feature-fix-force-recovery
# Conflicts:
#	fdbclient/ManagementAPI.actor.h
#	fdbserver/DataDistribution.actor.cpp
#	fdbserver/storageserver.actor.cpp
#	fdbserver/workloads/KillRegion.actor.cpp
2019-02-22 14:38:13 -08:00
Alex Miller 6d23eb2d1a Implement log_version.
This mega-commit introduces a new configuration setting, `log_version`,
that controls the TLog implementations and features that are available
within FDB, so that users can opt in to new features if they're willing
to sacrifice backwards compatibility.
2019-02-22 12:15:23 -08:00
Trevor Clinkenbeard 2a20ea6ac5 Merge branch 'master' of https://github.com/apple/foundationdb into add-health-metrics 2019-02-22 09:41:47 -08:00
Andrew Noyes 1292f5c59a Add TEST_LOG_FORMAT to cmake 2019-02-21 14:36:01 -08:00
Trevor Clinkenbeard fa96b8dd33 Merge branch 'master' of https://github.com/apple/foundationdb into add-health-metrics 2019-02-20 16:56:16 -08:00
Trevor Clinkenbeard a20f5482bc Created StorageStats struct to combine health metrics for storage servers 2019-02-20 11:57:41 -08:00
mpilman a6627fa5ca be less clever for seed generation and seed>0
simulator doesn't accept a seed that is 0
2019-02-19 22:06:45 -08:00
mpilman e8af6512ec Generate distinct pseudo-random number for each test
Fixes #1161
2019-02-19 22:06:45 -08:00
Evan Tschannen 6b0ef8341c
Merge pull request #1157 from vishesh/task/tls-upgrade
Support live TLS migration #1050
2019-02-19 14:30:08 -08:00
Evan Tschannen 8ed89fd711 fixed review comments 2019-02-19 11:26:53 -08:00
mpilman a2e4dc042f Implement automatic package verification 2019-02-19 11:11:43 -08:00
Evan Tschannen 065a45e05f Merge branch 'master' into feature-fix-force-recovery
# Conflicts:
#	fdbclient/ManagementAPI.actor.cpp
#	fdbserver/ClusterController.actor.cpp
#	fdbserver/workloads/KillRegion.actor.cpp
2019-02-18 17:09:06 -08:00
Evan Tschannen 6cf4b416f7 move the KillRegionCycle workload into the fast directory 2019-02-18 15:43:01 -08:00
Vishesh Yadav 907446d0ce Merge remote-tracking branch 'apple/master' into task/tls-upgrade 2019-02-14 11:37:38 -08:00
Alex Miller 2d7f5f505c Pass a bytestring to xml.sax.parseString
This fixes the ctest prb.

CI was broken because TestRunner errored at:

    Traceback (most recent call last):
      File "/foundationdb/tests/TestRunner/TestRunner.py", line 373, in <module>
        res = run_simulation_test(basedir, args)
      File "/foundationdb/tests/TestRunner/TestRunner.py", line 313, in run_simulation_test
        options.log_format, return_codes)
      File "/foundationdb/tests/TestRunner/TestRunner.py", line 261, in process_traces
        parser.processTraces()
      File "/foundationdb/tests/TestRunner/TestRunner.py", line 112, in processTraces
        obj = self.processLine(line, linenr)
      File "/foundationdb/tests/TestRunner/TestRunner.py", line 222, in processLine
        xml.sax.parseString(line, handler, errorHandler=errorHandler)
      File "/usr/lib/python3.4/xml/sax/__init__.py", line 45, in parseString
        inpsrc.setByteStream(BytesIO(string))
    TypeError: 'str' does not support the buffer interface

Which means you can't parse a string to parseString.  This was fixed by
3.7, but our CI runs 3.4, so we need to .encode() `line` before passing
it, so that it ends up as a `bytes`.
2019-02-11 17:59:52 -08:00
Trevor Clinkenbeard a09afe5906 Added Throttling workload to test native health metrics API 2019-02-04 13:04:25 -08:00
Evan Tschannen 1d7fec3074 Merge commit '048bfc5c368063d9e009513078dab88be0cbd5b0' into task/tls-upgrade-2
# Conflicts:
#	.gitignore
2019-01-24 17:43:06 -08:00
Alex Miller f5e5f02a7f
Update tests/CMakeLists.txt
Co-Authored-By: mpilman <markus@pilman.ch>
2019-01-24 13:16:06 -08:00
Alex Miller 83a9d5790f
Update tests/CMakeLists.txt
Co-Authored-By: mpilman <markus@pilman.ch>
2019-01-24 13:15:59 -08:00
Alex Miller 5b8c98fd22
Update tests/CMakeLists.txt
Co-Authored-By: mpilman <markus@pilman.ch>
2019-01-24 13:15:42 -08:00
Alex Miller a50f2d953a
Update tests/CMakeLists.txt
set buggify to on by default

Co-Authored-By: mpilman <markus@pilman.ch>
2019-01-24 13:15:14 -08:00
mpilman 58964af7e1 ctest improvements - #1058
- A set of CMake variables controls whether to keep
  the simfdb directory and the traces and whether we
  want to aggregate the traces into a single file
- Test labels now contain the directory they are in
  so that one can now run `ctest -R fast/`
- A different binary can be used for restart tests. CMake
  will automatically look for an installed fdb and use that
  by default. If none is found, it will use the built one
  but it will also print a warning
- CMake will throw an error if there are any text files in
  the tests directory that are not associated with a test.
- Moved testing from fdbserver/CMakeLists.txt to
  tests/CMakeLists.txt
- Moved fdb testing functions to its own cmake module
2019-01-22 14:34:51 -08:00
Alex Miller 6d1f4bda75 Move traces.xml into the testdir so it doesn't grow infinitely. 2019-01-14 20:58:19 -08:00
Alex Miller c0bf8cd7e7 Remove the test result directory if the test passed. 2019-01-14 20:31:02 -08:00
Alex Miller 248ae311bf Type=TestFailure events shouldn't fail tests.
This sounds kind of broken, but is needed for now.
2019-01-14 19:16:03 -08:00
Alex Miller 23697f06f7 Fix broken method call. 2019-01-14 19:14:25 -08:00
mpilman 414fb0b6c8 made TestRunner work with XML traces 2019-01-14 19:14:25 -08:00
Markus Pilman 5ba5499b69 fail tests properly 2019-01-14 19:14:25 -08:00
Markus Pilman b17d2234c9 added missing files 2019-01-14 19:14:25 -08:00
Vishesh Yadav 31c4ac07ac WIP: FailureMonitoring use endpointAddressList (create individual endpoints for each address) WIP: g_currentDeliveryPeerAddress WIP: FlowTransport endpoint map WIP: Add peerReference to addressToEndpointMap 2019-01-09 07:46:01 -08:00
Hu Sheng b402bd5bcc
Update RandomReadWrite.txt 2018-10-31 09:34:34 +08:00
TommyLike 0d1a8c3f2f Update comment for alpha parameter 2018-10-30 15:50:45 +08:00
Evan Tschannen db71b60d72
Merge pull request #819 from satherton/feature-redwood
Redwood storage engine, initial/experimental version
2018-10-18 18:38:11 -07:00
Evan Tschannen ecddeab2ae fixed review comments; demote killRegionCycle test for now 2018-10-08 10:39:39 -07:00
Stephen Atherton 22f8a4efa9 Normalized all unit test names to begin with "/" if they should be included in random unit testing. 2018-10-05 22:09:58 -07:00
Stephen Atherton 3ea9193fa7 Renamed redwood to redwood-experimental. UnitTest names can now be hidden using # as the first character so that random correctness tests will not run them. Excluded redwood tests from correctness testing. Reverted default storage engine to ssd. 2018-10-05 14:43:54 -07:00
Stephen Atherton 7c1dc305cb Merge commit 'a72c8f5cb2e79a673abc0ed3d27ef1c51028fb13' into feature-redwood 2018-10-05 10:15:10 -07:00
Stephen Atherton 2fc86c5ff3 Merge branch 'master' of github.com:apple/foundationdb into feature-redwood
# Conflicts:
#	fdbrpc/AsyncFileCached.actor.h
#	fdbserver/IKeyValueStore.h
#	fdbserver/KeyValueStoreMemory.actor.cpp
#	fdbserver/workloads/StatusWorkload.actor.cpp
#	tests/fast/SidebandWithStatus.txt
#	tests/rare/LargeApiCorrectnessStatus.txt
#	tests/slow/DDBalanceAndRemoveStatus.txt
2018-09-20 03:39:55 -07:00
Evan Tschannen 200e65fe61 added a workload which tests killing an entire region, and recovering from the failure with data loss.
fix: we cannot pop the txs tag from remote logs until they have a full copy of the txnStateStore
fix: we have to modify all of history, we cannot stop after finding a local remote
2018-09-17 18:32:39 -07:00
Stephen Atherton 26c9666f95 Changed default specific unit test. 2018-09-08 19:26:39 -07:00