877997632d
Merge branch 'release-6.3' into anoyes/merge-release-6.3-master
...
Include conflict markers for review purposes
2020-12-04 01:38:07 +00:00
c77d9e4abe
merge conflicts
2020-12-02 21:53:19 +00:00
231a7a10d0
Merge pull request #4075 from sfc-gh-tclinkenbeard/sqlite-xxhash3-checksum
...
Sqlite xxhash3 checksum
2020-11-23 10:43:35 -08:00
b1e3478267
Simplified global knobs
2020-11-21 13:27:48 -08:00
7cabe39aae
Merge pull request #4044 from sfc-gh-tclinkenbeard/fix-slow-sim-recovery
...
Lower DELAY_CC_WORST_FIT_CANDIDACY_SECONDS for LowLatencyWorkload
2020-11-18 10:28:53 -08:00
bcda617b80
Benchmark hashing algorithms in flowbench
2020-11-17 23:14:55 -08:00
d64cf8b9e3
Merge branch 6.3 into master
2020-11-17 11:22:45 -08:00
fdf41110e5
Merge branch 'release-6.3' into dyoungworth/merge_6_2_to_6_3
2020-11-16 14:49:51 -08:00
d0391db862
Merge branch 'release-6.2' into release-6.3
2020-11-16 10:15:23 -08:00
82a50ea157
Improve type safety of ClientLogEvents
2020-11-14 19:22:19 -08:00
45c9a0abc7
Revert "Revert "Add limiting health metrics""
...
This reverts commit 209ebcc595
2020-11-13 17:24:57 -08:00
209ebcc595
Revert "Add limiting health metrics"
2020-11-13 17:08:46 -08:00
8c0b4dbe4c
Merge pull request #4067 from sfc-gh-tclinkenbeard/add-limiting-health-metrics
...
Add limiting health metrics
2020-11-13 16:04:44 -08:00
9bb93dadf1
Reenabled Throttling.toml test (as a rare test)
2020-11-13 11:34:32 -08:00
6c4493166f
Add limiting storage queue and durability lag to health metrics
2020-11-12 20:14:41 -08:00
cc13ef08bd
Sort the failed sets before modifying them in attempts to make changes consistent
2020-11-12 16:26:34 -05:00
0f205620bf
Merge branch 'master' into features/udp
2020-11-12 13:51:17 -07:00
7cb8d504ad
Make description method const
...
Co-authored-by: Lukas Joswiak <lukas.joswiak@snowflake.com>
2020-11-12 13:48:10 -07:00
1343f40117
don't allow empty coments
2020-11-11 14:07:54 -07:00
bdd3dbfa7d
remove duplicates
2020-11-10 14:01:07 -07:00
aa4652d965
Lower DELAY_CC_WORST_FIT_CANDIDACY_SECONDS for LowLatencyWorkload
2020-11-09 19:15:51 -08:00
4669f837fa
Add uses of makeReference
2020-11-07 22:10:18 -08:00
b90ad11483
add some more trace and comments
2020-11-05 14:23:08 -05:00
df18f20efd
clang format
2020-11-05 10:27:41 -08:00
c50e997f60
Make status tests deterministic
...
This change seems to be incorrect since afaict INetwork::timer isn't
guaranteed to be monotonic. Maybe we can make that guarantee or add an
INetwork::timer_monotonic symbol?
2020-11-05 17:05:34 +00:00
9d9018b893
take out unnecessary includes
2020-11-04 21:09:53 +00:00
ac0e4c1705
unpause backup as soon as possible when waiting for version
2020-11-04 15:13:02 -05:00
3ae611d668
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-pause-backup-snapshot
2020-11-04 14:26:49 -05:00
bda72d9a3d
first draft at changing snapshot backup behaviour
2020-11-02 17:12:30 -05:00
32c87bbb33
Lightweight, power of two spaced histogram implementation + automatic reporting
2020-11-02 11:13:16 -08:00
9c6c2704d0
Merge branch 'master' of https://github.com/apple/foundationdb into stable_interfaces
2020-10-30 23:59:32 +00:00
0faaecc780
Merge branch 'master' into merge
2020-10-29 22:27:40 -07:00
cf4c8e375f
Merge remote-tracking branch 'origin/release-6.3' into merge
2020-10-29 22:15:41 -07:00
96cc700440
Merge pull request #3961 from sfc-gh-tclinkenbeard/azure-backup
...
Add support for writing backup files directly to Azure blob storage
2020-10-29 00:30:40 -07:00
25ded032c5
Merge pull request #3989 from sfc-gh-tclinkenbeard/fix-writeduringreadclean-failure
...
Decrease maximumTotalData in WriteDuringRead workload
2020-10-28 23:42:14 -07:00
d543082f33
Decrease maximumTotalData in WriteDuringRead workload
2020-10-28 22:49:24 -07:00
82339c1ea3
Merge pull request #3941 from sfc-gh-tclinkenbeard/fix-upgrade-and-backup-test
...
Fix UpgradeAndBackupTest failures
2020-10-28 19:08:22 -07:00
4c110c5e80
Ignore backup_unneeded errors when discontinuing in RestoreBackup
2020-10-28 16:42:21 -07:00
bf7bf470d9
Merge branch 'master' of https://github.com/apple/foundationdb into stable_interfaces
2020-10-26 19:36:19 +00:00
0f42f0c486
Start backup agent earlier in RestoreBackup workload
2020-10-26 12:26:31 -07:00
a15bc32b14
Merge pull request #3945 from sfc-gh-clin/add-consistencycheck-to-special-keys
...
Add consistencycheck command to special keys
2020-10-26 10:59:17 -07:00
dd55eeeaca
Start backup agent in RestoreBackup workload
2020-10-24 22:28:46 -07:00
8c7515914e
Update description override in Blob backup/restore workloads
2020-10-24 16:48:00 -07:00
82b6daa16b
First draft of Azure blob storage backup container
2020-10-24 16:47:51 -07:00
309e38dc06
add unit test and some cleanup
2020-10-23 19:34:18 +00:00
055add9682
conflicts
2020-10-23 06:33:00 +00:00
0060eeb6f8
Merge pull request #3930 from sfc-gh-clin/fix-FuzzApiCorrectness
...
Fix FuzzApiCorrectness test failures
2020-10-22 16:24:37 -07:00
461288aac3
update comments, remove redudant code that throws actor_cancelled error
2020-10-22 16:03:37 -07:00
b9c64f5ba6
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-snapshot-backup-agent
2020-10-22 16:12:59 -04:00
b53dbcf761
Update related correctness test
2020-10-22 12:05:29 -07:00
b728fe473e
Add consistencycheck command to special keys
2020-10-22 11:08:54 -07:00
e0b1f95740
Merge remote-tracking branch 'origin/master' into remove-global-ddenabled-flag
2020-10-21 18:22:08 -07:00
c4dc2f0cfb
update comment for disabling checkWritesEnable in FuzzApiCorrectness
2020-10-21 16:34:36 -07:00
8d670f3617
fix comments
2020-10-21 15:39:11 -07:00
8d937a56f2
Throw operation_failed() if dd not found when calling ddMetricsRequestServer
...
Remove time_out error in DDMetricsList rpc
Add retry logic for dd special key when dd not found
Update FuzzApiCorrectness test
2020-10-21 15:28:03 -07:00
602335ed97
remove buggify off + reorder container listing + temp mute failing workload
2020-10-21 17:10:41 -04:00
896c4ccc62
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-snapshot-backup-agent
2020-10-21 13:33:28 -04:00
e183a10c8c
Add "waitForDestUID" flag for abortBackup
2020-10-20 22:55:31 -07:00
34c42bed9b
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-snapshot-backup-agent
2020-10-20 17:27:05 -04:00
d82dccd2ad
revert systemkey clear in recovery tx and backupagent on restart, moved to workload specifically
2020-10-20 17:26:16 -04:00
8cc3e4d3c6
Merge release-6.3 into master
2020-10-19 22:51:56 -07:00
a4ccf8c5b6
add checksum class to change checksum in the future. expose get server protocol api
2020-10-19 16:57:11 +00:00
bfd3328448
Fix a race between submit and abort backup
...
After submit a backup, immediately abort the backup may cause a rare race
condition, which results in BackupCorrectnessLeftoverVersionKey error.
Specifically, in the StartFullBackupTaskFunc:
1st Txn sets the destUid at the source database and the 2nd Txn writes the dest
DB.
An abort can come after the 1st Txn succeeds, and clears the config rage so
that the 2nd Txn above would fail. Because 2nd Txn didn't write destUid, the
3rd Txn of abort can't read the correct source DB for latestVersionKey, which
contains the destUid value.
The fix is to let the 1st Txn of abort to wait until destUid becomes valid.
2020-10-18 23:11:15 -07:00
545ee4269d
master conflicts
2020-10-19 01:03:54 +00:00
73f7888c21
Fix description override for SubmitBackup and RestoreBackup workloads
2020-10-17 12:24:00 -07:00
c1d88b39ab
Merge remote-tracking branch 'origin/master' into add-upgrade-and-backup-restore-test
2020-10-17 11:35:12 -07:00
652d753daf
Remove global ddEnabled flag
2020-10-17 11:23:52 -07:00
15dbfc0bc4
Merge pull request #3908 from sfc-gh-clin/fix-issue-3905
...
Fix issue #3905
2020-10-15 14:46:32 -07:00
3109aa7221
(Previous commit did not catch the change)Increase the probability to generate keys after \xff\xff to test special key framework code
2020-10-15 14:11:04 -07:00
c145dd5824
Increase the probability to generate keys after \xff\xff to test special key framework code
2020-10-15 14:09:27 -07:00
7d8f0dfc9e
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-snapshot-backup-agent
2020-10-15 12:44:41 -04:00
b644969788
Add error checking for a getReadVersion call in a test.
2020-10-15 09:17:16 -07:00
24ea35e56f
Merge pull request #3748 from sfc-gh-ljoswiak/visibility-2
...
Add TLogVersion::V6
2020-10-14 17:35:32 -07:00
bf00369576
getRange only enters special key space codepath when both begin key and end key are in (\xff\xff, \xff\xff\xff)
2020-10-14 16:57:38 -07:00
e47e0108a7
Add new TLogVersion
2020-10-14 15:41:10 -07:00
b2d9b93243
Merge pull request #3847 from sfc-gh-tclinkenbeard/refactor-workloads
...
Modernize TestWorkload overrides
2020-10-14 15:07:03 -07:00
700f76eff2
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-snapshot-backup-agent
2020-10-14 17:37:31 -04:00
28686b14f7
default retries to infinite
2020-10-14 17:35:30 -04:00
2857a3df9d
add retry limit to version gate
2020-10-14 14:31:51 -04:00
ae0bc4c85e
Replace virtual with override in SimpleAtomicAddWorkload
2020-10-14 09:56:13 -07:00
c7694e7b50
Merge remote-tracking branch 'origin/master' into refactor-workloads
2020-10-14 09:21:47 -07:00
7ef8ceffcc
Merge remote-tracking branch 'origin/master' into add-incremental-backup-retry
2020-10-14 09:02:34 -07:00
e096297bc1
add traces
2020-10-13 16:07:09 -04:00
bd9ff04af2
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-snapshot-backup-agent
2020-10-13 13:14:09 -04:00
bbc6d2aa03
Merge pull request #3872 from sfc-gh-clin:add-lock-unlock-to-special-keys
...
Add lock/unlock to special keys
2020-10-13 09:09:49 -07:00
48b9846a6a
adjust test spec and manual g_simulator setting
2020-10-12 17:12:20 -04:00
4f7f16068a
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-snapshot-backup-agent
2020-10-12 17:10:28 -04:00
53d7d8ba63
add try-catch block that ignores backup_unneeded
2020-10-12 15:31:22 -04:00
2f5b0bef08
switch to test newer incompatible version. Fix PR comments. Modify schema
2020-10-12 18:29:16 +00:00
bbf5bdf6da
fix stable interfaces test and corresponding changes in simulator
2020-10-12 18:25:12 +00:00
5488ff1d81
draft diff protocol
2020-10-12 18:24:03 +00:00
41843f07e6
add simulator support for different process versions and ProtocolVersion test
2020-10-12 18:19:31 +00:00
40281372e5
remove g_simulator manual setting
2020-10-12 13:09:14 -04:00
a94821e5e3
first attempt at fixing issue with workload
2020-10-10 02:18:18 -04:00
e8e9e8064c
Add handling logic when buggify throws commit_unknown_result when commit lock
2020-10-09 14:26:56 -07:00
8bed7ba9a2
Add a loop to make sure we unlock the database in the end
2020-10-09 12:32:37 -07:00
be1ca196ee
turn off consistency check until after restore (where we remove the backup agent)
2020-10-09 13:30:01 -04:00
eefaa30fa4
Added retry loop for getReadVersion in IncrementalBackupWorkload
2020-10-09 07:43:21 -07:00
0b09833f21
add wait statement
2020-10-09 01:57:44 -04:00
9dd67bedaa
Add test for lock and unlock special keys
2020-10-08 18:28:47 -07:00
Andrew Noyes