Commit Graph

13065 Commits

Author SHA1 Message Date
Steve Atherton 125776491b
Merge pull request #3995 from sfc-gh-tclinkenbeard/rename-blobstore-s3blobstore
Rename BlobStore to S3BlobStore
2020-10-29 23:08:17 -07:00
sfc-gh-tclinkenbeard 55e86c1336 Disambiguate between S3BlobStore and other blob stores 2020-10-29 20:42:23 -07:00
Trevor Clinkenbeard 731073bd52
Merge pull request #3991 from sfc-gh-almiller/fdb3-in-joshua
Ignore old binaries before 4.x when running restarting tests
2020-10-29 12:41:48 -07:00
Alex Miller 362bd757c6 Make FDB >=4.x ignore old binaries before FDB 4.x
The motivation for this is so that Snowflake can add use TestHarness to run
FDB3 in Joshua, and be able to load FDB3 binaries into the image for restarting
tests.
2020-10-29 02:23:51 -07:00
Alex Miller 89a1559910 Handle versions being >1 digits. 2020-10-29 02:23:39 -07:00
Alex Miller f2de49332c TestHarness should check --version before choosing an old binary.
This allows joshua to run on binaries older than the most recent version,
because restarting/upgrade tests won't start with a newer version than what is
under test.
2020-10-29 02:23:34 -07:00
Steve Atherton 96cc700440
Merge pull request #3961 from sfc-gh-tclinkenbeard/azure-backup
Add support for writing backup files directly to Azure blob storage
2020-10-29 00:30:40 -07:00
Xin Dong 25ded032c5
Merge pull request #3989 from sfc-gh-tclinkenbeard/fix-writeduringreadclean-failure
Decrease maximumTotalData in WriteDuringRead workload
2020-10-28 23:42:14 -07:00
sfc-gh-tclinkenbeard d543082f33 Decrease maximumTotalData in WriteDuringRead workload 2020-10-28 22:49:24 -07:00
Trevor Clinkenbeard 82339c1ea3
Merge pull request #3941 from sfc-gh-tclinkenbeard/fix-upgrade-and-backup-test
Fix UpgradeAndBackupTest failures
2020-10-28 19:08:22 -07:00
sfc-gh-tclinkenbeard 4c110c5e80 Ignore backup_unneeded errors when discontinuing in RestoreBackup 2020-10-28 16:42:21 -07:00
sfc-gh-tclinkenbeard 95e5130903 Don't rewrite BeforeRestart prefix in UpgradeAndBackupRestore-2 2020-10-28 14:06:40 -07:00
Meng Xu 8f432406f0
Merge pull request #3937 from sfc-gh-mpilman/features/Dockerfile.centos7
New CentoOS7 based image
2020-10-28 10:30:08 -07:00
Andrew Noyes e82339f40e
Merge pull request #3906 from sfc-gh-anoyes/anoyes/use-gcov
Add USE_GCOV cmake option
2020-10-27 08:27:46 -07:00
A.J. Beamon 8e512f3109
Merge pull request #3943 from sfc-gh-anoyes/anoyes/valgrind-precise
Increase valgrind precision if env var FDB_VALGRIND_PRECISE is set
2020-10-26 14:01:58 -07:00
sfc-gh-tclinkenbeard 0f42f0c486 Start backup agent earlier in RestoreBackup workload 2020-10-26 12:26:31 -07:00
Andrew Noyes a15bc32b14
Merge pull request #3945 from sfc-gh-clin/add-consistencycheck-to-special-keys
Add consistencycheck command to special keys
2020-10-26 10:59:17 -07:00
Markus Pilman 6fa9acb567 renamed docker file 2020-10-26 11:34:06 -06:00
Markus Pilman 72839af1c0 install python36 with the first install 2020-10-26 09:51:30 -06:00
Xiaoge Su 1fe775d393
Merge pull request #3962 from sfc-gh-tclinkenbeard/add-optional-get-overload
Support rvalue reference overload for Optional::get
2020-10-24 23:17:14 -07:00
Trevor Clinkenbeard e963c3bc61
Merge pull request #3946 from ajbeamon/fix-memory-issue-due-to-iterator-invalidation
Fix memory error due to iterator invalidation
2020-10-24 22:51:10 -07:00
sfc-gh-tclinkenbeard dd55eeeaca Start backup agent in RestoreBackup workload 2020-10-24 22:28:46 -07:00
sfc-gh-tclinkenbeard 8191a38b88 Support rvalue reference overload for Optional::get 2020-10-24 21:05:42 -07:00
sfc-gh-tclinkenbeard 2a849dc52c Update BackupContainerAzureBlobStoreImpl::WriteFile::sync 2020-10-24 16:48:06 -07:00
sfc-gh-tclinkenbeard 195873e1cc Cleaned up unnecessary backup container includes 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard 195ca30a20 Azure backup cleanup 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard e389a5dabe Fix issues with Azure credentials 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard c6739f7075 Add skeleton for BackupContainerAzureBlobStore::listURLs 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard bb09f0e657 Improve AsyncTaskThread encapsulation 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard 7cba81316a Fix some race conditions in AsyncTaskThread (some more remain) 2020-10-24 16:48:04 -07:00
sfc-gh-tclinkenbeard 4d127a29cc Added testing and fixed some bugs in AsyncTaskThread 2020-10-24 16:48:04 -07:00
sfc-gh-tclinkenbeard 456a7c77a2 Add random delay to AsyncTaskThread::execAsync in simulation 2020-10-24 16:48:04 -07:00
sfc-gh-tclinkenbeard f3c52ed41e Guard Azure backup compilation behind CMake variable 2020-10-24 16:48:04 -07:00
sfc-gh-tclinkenbeard e3f94c80fc Added BackupContainerAzureBlobStore::getURLFormat 2020-10-24 16:48:03 -07:00
sfc-gh-tclinkenbeard dc3738b97f Improve encapsulation for BackupContainerFileSystem 2020-10-24 16:48:03 -07:00
sfc-gh-tclinkenbeard 6a27619544 Remove unnecessary copies in BackupContainer code 2020-10-24 16:48:03 -07:00
sfc-gh-tclinkenbeard 1d28285cc5 Made BackupContainer.h header guard consistent with other header guards 2020-10-24 16:48:03 -07:00
sfc-gh-tclinkenbeard ae91cf1d44 Make BackupContainerFileSystem.h a non-actor file 2020-10-24 16:48:02 -07:00
sfc-gh-tclinkenbeard 9242456d71 Improve encapsulation for BackupContainerAzureBlobStore 2020-10-24 16:48:02 -07:00
sfc-gh-tclinkenbeard 226b3f6bf2 Improve encapsulation for BackupContainerS3BlobStore 2020-10-24 16:48:02 -07:00
sfc-gh-tclinkenbeard e1d58d3c66 Moved BackupContainerS3BlobStore into its own files 2020-10-24 16:48:02 -07:00
sfc-gh-tclinkenbeard e15a268548 Use anonymous namespace for BackupContainerLocalDirectory helper functions 2020-10-24 16:48:02 -07:00
sfc-gh-tclinkenbeard 961aeaecac Moved BackupContainerAzureBlobStore into its own files 2020-10-24 16:48:01 -07:00
sfc-gh-tclinkenbeard e5338d213b Moved BackupContainerLocalDirectory into its own files 2020-10-24 16:48:01 -07:00
sfc-gh-tclinkenbeard 3c6de425a1 Moved BackupContainerFileSystem implementation to cpp file 2020-10-24 16:48:01 -07:00
sfc-gh-tclinkenbeard cd50d53b1e Created BackupContainerFileSystem.actor.h 2020-10-24 16:48:01 -07:00
sfc-gh-tclinkenbeard 29d6fc5dff Clarify scope of IBackupFile_impl namespace 2020-10-24 16:48:00 -07:00
sfc-gh-tclinkenbeard 0879e529d2 Add error handling to AsyncTaskThread::execAsync 2020-10-24 16:48:00 -07:00
sfc-gh-tclinkenbeard e9de39f525 Add machine attrition to BackupBlobCorrectness test 2020-10-24 16:48:00 -07:00
sfc-gh-tclinkenbeard 8c7515914e Update description override in Blob backup/restore workloads 2020-10-24 16:48:00 -07:00