cc5bc16bd8
Rename more places from proxy to commit proxy
2020-09-15 22:29:49 -07:00
37d77ecb64
WIP of adding tests
2020-09-15 13:31:06 -04:00
35bef73a1c
Rename proxy to commit proxy
2020-09-10 17:44:15 -07:00
732a457ba4
Merge pull request #3720 from sfc-gh-xwang/mako
...
update mako and WriteTagThrottling workload so as to trigger tag throttling event
2020-09-10 15:21:00 -07:00
0eb7092faa
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-incremental-backup-only
2020-09-08 12:53:29 -04:00
4bab3f56df
Disable readhot detection workload for now.
2020-09-04 10:01:58 -07:00
87693cae81
merge master branch and resolve conflicts
2020-09-02 13:44:33 -07:00
f930f9bbb6
update toml test spec
2020-09-02 05:25:40 +00:00
b9baa996e3
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-incremental-backup-only
2020-09-01 14:38:02 -04:00
7eeaf55f2b
fixed conflicts with tests
2020-08-31 21:18:49 -07:00
12edadd059
Merge branch 'release-6.3'
...
# Conflicts:
# CMakeLists.txt
# fdbclient/Knobs.cpp
# fdbclient/MasterProxyInterface.h
# fdbrpc/simulator.h
# fdbserver/MasterProxyServer.actor.cpp
# tests/fast/CycleAndLock.txt
# tests/fast/TxnStateStoreCycleTest.txt
# tests/fast/VersionStamp.txt
# tests/slow/ParallelRestoreOldBackupApiCorrectnessAtomicRestore.txt
# tests/slow/ParallelRestoreOldBackupCorrectnessCycle.txt
# versions.target
2020-08-31 19:33:34 -07:00
29eec30183
Merge branch 'release-6.2' into release-6.3
...
# Conflicts:
# CMakeLists.txt
# build/Dockerfile
# build/Dockerfile.devel
# documentation/sphinx/source/downloads.rst
# fdbserver/Knobs.cpp
# fdbserver/LogSystem.h
# fdbserver/MasterProxyServer.actor.cpp
# fdbserver/TagPartitionedLogSystem.actor.cpp
# fdbserver/WaitFailure.actor.cpp
# fdbserver/fdbserver.vcxproj
# fdbserver/fdbserver.vcxproj.filters
# packaging/msi/FDBInstaller.wxs
2020-08-31 01:10:29 -07:00
4831f11e2a
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-incremental-backup-only
2020-08-28 12:47:19 -04:00
0270ee13c8
change targetversion from maxlogend to contiguouslogend. also adjusted test workload and specs
2020-08-28 12:46:34 -04:00
ca486fdcd4
FastRestoreOldBackupTest:Revert workload time to 30s
2020-08-27 09:31:57 -07:00
3d2b18b663
FastRestore:AtomicRestore:Add resetDBTimeout option
2020-08-26 10:21:17 -07:00
a8bd628216
FastRestoreAtomicRestoreTest:Increase timeout from 2100 to 36000
2020-08-26 09:48:52 -07:00
1b7a0d9b1d
FastRestoreTest:Increase cycle test duration from 40 to 60s
2020-08-25 22:47:39 -07:00
57584f41a0
FastRestoreOldBackup:Change backup latency from 60 to 40s
2020-08-25 10:42:28 -07:00
23c8d0154b
FastRestoreOldBackupTest:Increase test duragion
...
Add comment on Rollback test as well
2020-08-25 09:14:37 -07:00
63b3612ad5
Merge master branch and resolve conflicts
2020-08-24 16:42:31 -07:00
e1b7dd0c7d
Merge remote-tracking branch 'upstream/release-6.3' into dyoungworth/fixMerge1
2020-08-22 12:25:19 -07:00
3737b8dd7b
Add LockDatabaseFrequently to TxnStateStoreCycleTest
2020-08-20 18:45:42 +00:00
bc5da1f6d7
Add LockDatabaseFrequently to VersionStamp test
2020-08-20 02:33:06 +00:00
fbc97a12b8
Add LockDatabaseFrequently workload
2020-08-19 23:17:38 +00:00
ae999aa118
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-incremental-backup-only
2020-08-19 16:36:47 -04:00
35aa1034cd
added new test spec and workload to verify correctness of incremental backup and restore
2020-08-19 13:45:51 -04:00
2295bb223a
Bump to 5.0.0 as 4.6.4 is using version larger than hasMultiGenerationTLog()
2020-08-16 09:29:14 -07:00
1a59926d75
Limit Storefront and Cycle restart tests to 4.6.0 and up
...
The assertion in DBCoreState.h insists on hasMultiGenerationTLog(), which is
only available on 4.6.0 and up versions.
2020-08-16 09:29:06 -07:00
79ce16650d
merge master branch
2020-08-11 19:22:10 -07:00
acb151864b
minor bug fixes
2020-08-06 16:56:38 -06:00
d6a23a4d6b
Resolve comments to make GRV proxy a separate process class
2020-08-06 00:01:57 -07:00
0674dba085
Merge pull request #3574 from etschannen/master
...
Merge 6.3 into Master
2020-07-31 20:06:15 -07:00
66f6b89ef7
Bump to 5.0.0 as 4.6.4 is using version larger than hasMultiGenerationTLog()
2020-07-31 14:53:16 -07:00
4254413cc0
Limit Storefront and Cycle restart tests to 4.6.0 and up
...
The assertion in DBCoreState.h insists on hasMultiGenerationTLog(), which is
only available on 4.6.0 and up versions.
2020-07-31 14:33:57 -07:00
86148f1277
Merge branch 'master' into grv-proxy
2020-07-29 11:14:51 -07:00
f7b76a92af
pass joshua
2020-07-29 07:26:55 -07:00
3623b28df5
fixed merge conflict
2020-07-29 00:36:12 -07:00
a49cb41de7
Merge branch 'release-6.3'
...
# Conflicts:
# CMakeLists.txt
# cmake/ConfigureCompiler.cmake
# fdbserver/Knobs.cpp
# fdbserver/StorageCache.actor.cpp
# fdbserver/storageserver.actor.cpp
# flow/ThreadHelper.actor.h
# flow/serialize.h
# tests/CMakeLists.txt
2020-07-29 00:31:55 -07:00
2b8aa296bb
Merge pull request #3482 from sfc-gh-tclinkenbeard/support-downgrades
...
Support and test downgrades
2020-07-28 17:00:54 -07:00
b2df089f58
make storefront test pass for now
2020-07-26 10:23:29 -07:00
272ef87933
toml file
2020-07-22 06:08:47 +00:00
a1d3496d7d
Update downgrade tests to use 6.3.5 instead of 6.3.3
2020-07-20 18:47:43 -07:00
893898818c
merge master
2020-07-20 23:38:05 +00:00
bce0c2758e
add fastSuccess
2020-07-20 23:27:20 +00:00
878254497a
Merge remote-tracking branch 'upstream/master' into toml-testspec
2020-07-19 22:18:31 -07:00
f3ee60b10b
slight change
2020-07-20 03:17:46 +00:00
1c483d3423
rewrite Throttling.actor.cpp; fix '/' bug in HealthMetricsApi
2020-07-20 01:20:14 +00:00
dd85a1ec04
Fix LowLatencyWithFailures.txt
...
connectionFailuresDisableDuration and minimumReplication global variable should come before testName
2020-07-15 14:17:55 -07:00
8ae0d9b73d
Resolve merge conflict
2020-07-13 10:21:53 -07:00
ef8c1060a2
Merge branch 'master' into mengxu/tmp-merge-6.3
2020-07-13 10:15:56 -07:00
d0189ad0d4
Relax commit latency requirement for LowLatency workload
2020-07-12 20:01:57 -07:00
2841efe938
Rewrite most .txt tests into (pretty) .toml files.
...
This includes build/txt-to-toml.py which did the rewrites, and
can be used to rewrite other no-in-tree test spec files to toml.
I didn't touch status or restarting tests yet. Restarting will be handled
later. It turns out that I don't understand how status tests work.
2020-07-12 14:47:40 -07:00
7bbdfeca05
Merge pull request #3474 from jzhou77/master
...
Use KeyRangeMap for splitMutation
2020-07-09 21:52:12 -07:00
10a4b8e321
Make Downgrade test rare
2020-07-09 17:52:41 -07:00
8a5fb5ec15
Move to_6.3.0 restarting test to to_6.3.3
2020-07-09 17:24:43 -07:00
949a17359a
Added to_6.3.0 downgrade test to test harness
2020-07-09 14:29:43 -07:00
373b5ffb4f
Added forward compatibility and Downgrade workload
2020-07-09 14:28:35 -07:00
2a848edb41
Merge remote-tracking branch 'upstream/master'
2020-07-09 18:10:38 +00:00
c40c4693b4
better correctness criteria
2020-07-09 18:10:12 +00:00
1dead7c199
Merge pull request #3440 from sfc-gh-xwang/master
...
add HealthMetricsWorkload and WriteTagThrottlingWorkload
2020-07-09 10:04:46 -07:00
a5af214861
Use KeyRangeMap for splitMutation
...
This simplifies code by reuse KeyRangeMap class.
2020-07-09 09:59:37 -07:00
d61206e126
Merge pull request #3453 from thisismiller/restrict-testspec
...
Make testspec more restrictive and correctly "scoped"
2020-07-08 11:43:37 -07:00
e78cc9ee4b
Use KeyRangeMap for splitMutation
...
This simplifies code by reuse KeyRangeMap class.
2020-07-08 09:53:34 -07:00
627075e0ef
1. add test parameters; 2. change ContinuousSample initialization 3. add&change metrics
2020-07-06 18:18:15 +00:00
17570b5b10
Make the testspec more restrictive in terms of what can be set where.
...
Testspec is currently very permissive in very misleading ways. In particular,
the tester parser itself will swallow K=V settings and apply them at the test
level, which breaks how a person would expect the scoping to work. Other
settings apply to the entire simulation run globally, but appear to be workload
specific. Even further, others affect simulation cluster creation or test
harness behavior, but can again be set anywhere in a testspec.
This changes testspec parsing to error if a setting that applies globally is
anywhere but the top of the file, or if a setting that applies test-wide is
applied to a workload instead of a test.
2020-07-06 02:03:30 -07:00
121465b051
change metrics
...
fix latency sum bug
2020-07-03 21:49:44 +00:00
98b3ef69aa
1.change metrics; 2.change the way to generate key (avoid to much confict)
2020-07-03 00:20:39 +00:00
c1face27f1
fix dangling pointer bugs
2020-07-02 18:35:39 +00:00
c76e0cfe04
Add a ReadAfterWrite workload, to measure TLog->SS propagation delay.
2020-07-01 02:17:43 -07:00
6ebd3c8083
1. add range clear operation to workload
...
2. add tag logic to WriteTagThrottling
2020-07-01 06:35:14 +00:00
ad6904413c
Merge branch 'master' of https://github.com/apple/foundationdb
2020-07-01 04:58:02 +00:00
dc568cad21
add HealthMetricsWorkload and WriteTagThrottlingWorkload to prepare for new throttling feature
2020-07-01 04:56:21 +00:00
22f7f804b8
Merge branch 'release-6.3' into mengxu/merge-6.3-PR
2020-06-28 11:19:39 -07:00
90861ead6a
Reenable all tests in BackupAndParallelRestoreWithAtomicOp
2020-06-23 08:29:31 -07:00
b122575dda
BackupAndParallelRestoreWithAtomicOp:Turn on debug options
2020-06-22 16:53:43 -07:00
6e18b6454a
Remove obsolete file
2020-06-16 10:13:57 -07:00
96206a8032
Merge pull request #3368 from apple/release-6.3
...
Merge Release 6.3 to master
2020-06-15 20:15:22 -07:00
39c50798b8
Merge pull request #3341 from sfc-gh-clin/fix-rpc-calls-in-special-key-space
...
Fix fetchShardMetricsList_impl and add read cache in special key space
2020-06-15 16:12:38 -07:00
acbfe2e4c9
Revert "Revert "Initial RocksDB""
2020-06-15 12:45:36 -04:00
980bee1d13
Fix fetchShardMetricsList_impl and add read cache in special key space
2020-06-12 10:12:44 -07:00
9cd1614c82
Revert "Initial RocksDB"
2020-06-11 15:29:46 -07:00
a4dbb5dd01
Merge branch 'trace-batch-thread-hostile' into rocksdb-6.3
2020-06-11 15:53:57 +00:00
693d9e8b89
Merge branch 'master' into fdb_cache_wo_allocator
2020-06-09 15:09:58 -07:00
cf1ae52751
Merge pull request #3281 from apple/release-6.3
...
Merge Release 6.3 into master
2020-06-03 10:55:37 -07:00
cf13e00a8f
Merge remote-tracking branch 'origin/release-6.3' into fdb_cache_wo_allocator
2020-06-01 17:38:31 -07:00
d128252e90
Merge release-6.3 into master
2020-05-22 09:25:32 -07:00
5d361fe532
Copy/paste rebase onto 6.3
2020-05-22 15:02:51 +00:00
56e14a25fe
Normal correctness package can be built when USE_VALGRIND is on. Correctness and valgrind now stage their files in separate directories. Add CMakeCache.txt to testing packages.
2020-05-21 13:35:54 -07:00
6ce574f5ad
Merge remote-tracking branch 'upstream/release-6.3' into add-data-distribution-metrics
2020-05-17 23:36:52 -07:00
5632af3b4d
Removed inaccurate warning
2020-05-16 20:20:11 -07:00
25390f0968
Remove SimpleExternalTest.txt from fdb_test_files even if UBSAN is enabled
2020-05-13 22:46:07 -07:00
02307ba7b6
Merge branch 'master' into transaction-tagging
...
# Conflicts:
# fdbclient/DatabaseContext.h
2020-05-09 07:50:29 -07:00
ef724bf939
Merge remote-tracking branch 'upstream/master' into add-data-distribution-metrics
2020-05-08 18:39:28 -07:00
749fcd13b0
Merge branch 'master' into fdb_cache_wo_allocator
2020-05-08 16:23:29 -07:00
13ff1b3b20
Revert "Exclude Snap related tests from correctness test temporily"
...
This reverts commit f95bbc0ffa
2020-05-07 14:39:13 -07:00
b1055a8501
Merge branch 'master' into transaction-tagging
2020-05-05 16:03:39 -07:00
f329164fb4
Merge pull request #2532 from dongxinEric/feature/hot-read-key-detection-part-2
...
Feature/hot read key detection part 2
2020-05-05 14:33:34 -07:00
378951360d
Merge pull request #3086 from alexmiller-apple/ctest-use-crash
...
Make ctest use --crash when running simulation tests.
2020-05-05 12:49:21 -07:00
f040694bf0
Make ctest use --crash when running simulation tests.
...
So that tests with ASSERTion failures don't cause CI to run slow and
produce massive logs. There's also rarely a reason to continue through
assertion failures.
2020-05-05 03:11:09 -07:00
dd033736ed
Merge branch 'master' into fdb_cache_subfeature2
2020-05-04 17:29:43 -07:00
80a235aa80
Add some correctness tests
2020-05-04 10:15:18 -07:00
1927f15898
Now the ReadHotDetection tests can be run reliably. Added it to nightly bundle.
2020-04-28 13:26:02 -07:00
50ad4a33fe
Added possibility to include and exclude tests
...
Description
Testing
2020-04-28 16:19:04 +00:00
7dd7406c59
Merge branch 'master' into feature/hot-read-key-detection-part-2
2020-04-16 14:54:05 -07:00
b85dc16c6d
Merge branch 'master' into fdb_cache_subfeature2
2020-04-14 17:07:41 -07:00
65620b00f3
Merge remote-tracking branch 'upstream/master' into private-keyspace-framework
2020-04-13 14:21:07 -07:00
f95bbc0ffa
Exclude Snap related tests from correctness test temporily
...
Those tests fail with high chance in nightly test.
2020-04-10 10:01:07 -07:00
2a856b23d3
Added test files and updated vsproj files
2020-04-06 09:53:18 -07:00
a0c8946f31
Merge branch 'master' into fdb_cache_subfeature2
2020-04-02 12:27:04 -07:00
38d7f16de0
FastRestore:Add new tests to ctests
2020-04-01 21:34:26 -07:00
16898408ae
FastRestore:Rename tests for new backup by adding NewBackup keyword
2020-04-01 21:31:54 -07:00
1eea388278
Add unit test for splitMutation test file
...
Comment out debug trace as well.
2020-04-01 21:27:18 -07:00
321b1b6ee7
Add RunRestoreWorkerWorkload into Parallel Restore WriteDuringReadAtomicRestore tests
2020-03-31 18:48:29 -07:00
a1d2779f04
Add ParallelRestoreWriteDuringReadAtomicRestore.txt
...
Test for fast restore with new backup.
2020-03-31 18:25:17 -07:00
0fa3bfa6f3
Increase timeout threshold for ParallelRestoreOldBackupWriteDuringReadAtomicRestore.txt
2020-03-31 18:21:36 -07:00
8471cb5351
Disable ParallelRestoreApiCorrectnessAtomicRestore.txt temporarily.
2020-03-31 15:52:07 -07:00
ccbbdc4ba4
Unit test:Verify splitMutation by comparing with intersectingRanges result
2020-03-31 12:13:02 -07:00
a63f8b839c
Merge remote-tracking branch 'upstream/master' into private-keyspace-framework
2020-03-31 12:05:42 -07:00
37ca0bf7e2
add code to handle the three flags in RangeResultRef
2020-03-30 23:27:09 -07:00
faab8a0d19
Add ParallelRestoreOldBackupApiCorrectnessAtomicRestore.txt
...
Add tests/ParallelRestoreApiCorrectnessAtomicRestore.txt back which
was mistakenly deleted in the previous commit.
2020-03-30 21:59:47 -07:00
73345a7ebd
Add new tests for parallel restore
...
Add two tests for parallel restore with old backup data
ParallelRestoreApiCorrectnessAtomicRestore.txt
ParallelRestoreOldBackupWriteDuringReadAtomicRestore.txt
2020-03-30 21:53:26 -07:00
60f6edc3b5
Merge pull request #2860 from zjuLcg/report-conflicting-key-roll-forward
...
Report conflicting key roll forward
2020-03-30 17:33:56 -07:00
cf7404a771
Merge pull request #2871 from xumengpanda/mengxu/parallel-range-log-file-loading-PR
...
Performant restore [24/xx]: Process range and log files in parallel for old backup format
2020-03-28 17:33:50 -07:00
92998d3df9
Add restore with old backup tests into CMakeLists
2020-03-28 16:08:22 -07:00
6e60c62d7b
Add ParallelRestoreCorrectnessAtomicOp.txt
2020-03-28 16:00:51 -07:00
137ea71203
Merge pull request #2865 from mpilman/features/build-test-harness
...
Build all joshua packages with cmake
2020-03-27 13:11:39 -07:00
f7233bade7
Rename ParallelRestoreCorrectnessAtomicOpTinyData.txt by removing TinyData
2020-03-27 13:08:59 -07:00
5c6752fb24
Add tests for new restore with old backup
2020-03-27 13:07:38 -07:00
97f8e46388
Sanity check subversion for log mutations
2020-03-27 13:07:08 -07:00
96a7b4b459
Disable ParallelRestoreApiCorrectnessAtomicRestore test
2020-03-26 14:59:50 -07:00
acaf91ac47
Merge branch 'master' into fdb_cache_subfeature2
2020-03-26 13:33:08 -07:00
cffcac92ad
Disable partitioned log for atomic restore workload
...
This will be reenabled after fixing test failures related to it.
2020-03-26 13:07:40 -07:00
7e2938b290
Merge branch 'master' of github.com:apple/foundationdb into features/build-test-harness
2020-03-26 12:47:55 -07:00
ce6c4cb8d8
Build and package TestHarness
2020-03-25 17:36:47 -07:00
f240d393f2
Add ParallelRestoreApiCorrectnessAtomicRestore.txt into ctests
2020-03-25 11:23:19 -07:00
6a8d6ddb8e
Introduce ParallelRestoreApiCorrectnessAtomicRestore.txt test
...
This covers ApiCorrectnessTest as workload for parallel restore.
2020-03-24 22:30:51 -07:00
289487559d
Revert "Revert "Merge pull request #2257 from zjuLcg/report-conflicting-key""
...
This reverts commit 804fe1b22e
2020-03-24 18:11:15 -07:00
d185359422
ApiCorrectnessAtomicRestore test: Increase timeout value
2020-03-24 17:36:17 -07:00
6df92a8b8d
A work version of strict workload test
2020-03-23 23:55:56 -07:00
247ab84323
Merge branch 'master' of https://github.com/apple/foundationdb into add-data-distribution-metrics
2020-03-23 17:01:17 -07:00
d7cf562ec4
Enable rollback workload for multi cycle restore test
2020-03-23 16:33:11 -07:00
85a9f6ab96
Merge branch 'master' into mengxu/fr-enable-rollback-and-abort-test-PR
2020-03-23 16:32:00 -07:00
14c641ce2b
Enable rollback workload
2020-03-23 16:29:01 -07:00
4756447b74
Enable abortAndRestartAfter option for restore cycle test
2020-03-23 15:15:14 -07:00
f936adedb0
Change tab to space for test workload file
2020-03-23 15:10:35 -07:00
d0bce1a105
Add ParallelRestoreCorrectnessCycle test into CMakeList
2020-03-23 13:56:33 -07:00
9c2c3b26d3
Merge branch 'master' into mengxu/fr-multi-cycle-test-PR
2020-03-23 13:54:20 -07:00
00ada7e086
Enable attrition workload for restore multi cycle tests
2020-03-23 13:50:05 -07:00
ace19eefe4
Introduce multi cycle tests for fast restore
2020-03-23 12:59:43 -07:00
Young Liu