Commit Graph

3120 Commits

Author SHA1 Message Date
sfc-gh-tclinkenbeard 86c7c1e946 Fix IAsyncFileSystem method signatures 2020-12-28 01:57:42 -04:00
sfc-gh-tclinkenbeard 5b2e88b187 Use structured bindings in for loops 2020-12-27 01:46:20 -04:00
sfc-gh-tclinkenbeard 5bfa6cea98 Merge remote-tracking branch 'origin/master' into misc-changes 2020-12-26 20:47:00 -04:00
sfc-gh-tclinkenbeard 33ec968d5a Mark expectedSize methods const 2020-12-26 18:30:44 -04:00
sfc-gh-tclinkenbeard 4e460c0b30 Remove BlobStore.actor.cpp 2020-12-26 13:30:16 -04:00
Jingyu Zhou bbb56e4089 Merge branch 'release-6.2' of https://github.com/apple/foundationdb into release-6.3 2020-12-23 14:26:59 -08:00
Vishesh Yadav 6957e64886 fix: Calculate fault tolerance when keys are not fully replicated
Whem the database is not fully replicated to remote, fault tolerance
can be calculated by couting total number of tLogs replicas in primary
and satellite - 1, as we can lose all but one of those, but we were
subtracting 2 instead of 1.
2020-12-22 16:26:19 -08:00
Vishesh Yadav a1809f7d86 doc: Fault Tolerance and Region Configuration 2020-12-22 16:25:17 -08:00
Xin Dong 8d4cbfbb86
Merge branch 'release-6.2' into feature/allow-manually-trigger-dd-teams-info-logging 2020-12-22 10:00:24 -08:00
Jingyu Zhou 0ecfaf138e
Merge pull request #4150 from sfc-gh-ljoswiak/fixes/sps-tracing
Remove "a/" from tracing keys in special-key-space
2020-12-21 13:48:01 -08:00
Chaoguang Lin 9db9a84798 Ignore negative duration value 2020-12-21 13:29:16 -08:00
Chaoguang Lin b68d84aaea Merge remote-tracking branch 'upstream/master' into add-c-function-for-management-commands 2020-12-21 12:32:31 -08:00
Chaoguang Lin 7b4f7ce4e0 update comments 2020-12-20 22:47:55 -08:00
Chaoguang Lin adc916121e Copy the network address stringref 2020-12-20 22:44:04 -08:00
Alvin Moore fb62ce4f64 Removed the override 2020-12-14 08:34:09 -05:00
Alvin Moore 24cdbc5cee Fixed error with Windows CMake build 2020-12-14 08:23:24 -05:00
Andrew Noyes 9601769b01
Merge pull request #3858 from sfc-gh-rchen/stable_interfaces
Stable interfaces
2020-12-11 09:34:27 -08:00
Richard Chen 5f57d72a59 remove print statements and format protocol version workload 2020-12-11 04:46:20 +00:00
Russell Sears 4cb821cd63 Merge remote-tracking branch 'upstream/release-6.2' into merge-6.2-to-6.3 2020-12-09 15:47:44 -08:00
Lukas Joswiak 43fd545f06 Remove a/ from tracing path in special-key-space 2020-12-09 13:40:16 -08:00
Trevor Clinkenbeard b305e71ece
Merge pull request #4141 from sfc-gh-anoyes/anoyes/merge-release-6.3-master
Merge release 6.3 master
2020-12-09 08:50:57 -08:00
sfc-gh-tclinkenbeard c8786a65c3 Remove unnecessary uses of virtual 2020-12-08 09:09:33 -08:00
sfc-gh-tclinkenbeard 276f80cfce Mark Tag::toTagDataIndex const 2020-12-08 09:09:33 -08:00
Trevor Clinkenbeard 9581bc0279
Merge pull request #4129 from sfc-gh-anoyes/anoyes/merge-release-6.3-master
Merge release 6.3 master
2020-12-08 08:57:54 -08:00
Lukas Joswiak 54237f28ea Throw error on commit for late trace options 2020-12-07 14:43:44 -08:00
Andrew Noyes cc669f399e Merge remote-tracking branch 'upstream/release-6.3' into anoyes/merge-release-6.3-master 2020-12-07 22:26:11 +00:00
Lukas Joswiak 18201d6f4f Add option to enable transaction tracing 2020-12-07 11:24:14 -08:00
A.J. Beamon 75836d6114 Fix double counting of range reads in TransactionMetrics 2020-12-07 09:01:19 -08:00
Chaoguang Lin d97523a966 Fix typo 2020-12-06 14:04:16 -08:00
Andrew Noyes 7fbc4d7391 Resolve conflicts 2020-12-04 23:58:42 +00:00
Chaoguang Lin e5cad0f077 Fix the bug if boundary same as range and add comments 2020-12-04 14:58:40 -08:00
Lukas Joswiak 76142549e0 Return keys from range read in lexicographic order 2020-12-04 11:21:39 -08:00
Andrew Noyes 877997632d Merge branch 'release-6.3' into anoyes/merge-release-6.3-master
Include conflict markers for review purposes
2020-12-04 01:38:07 +00:00
Xin Dong ac02329d7d Added a command in fdbcli to allow user to manually trigger the detailed teams info loggings in data distributor 2020-12-03 14:42:30 -08:00
Lukas Joswiak 3669615e4b Refactor and clean up 2020-12-03 14:06:11 -08:00
Chaoguang Lin 8d59dae26d Add check for existence of databaseRebootWorker in c api 2020-12-03 13:47:59 -08:00
Chaoguang Lin 88e66545bb Change the api to return bool instead of int 2020-12-03 12:01:32 -08:00
Richard Chen c77d9e4abe merge conflicts 2020-12-02 21:53:19 +00:00
Lukas Joswiak 1f166bc183 Add options to set custom transaction ID and disable tracing 2020-11-30 14:57:17 -08:00
Andrew Noyes dc2bac5670 Resolve conflicts 2020-11-24 19:09:42 +00:00
Andrew Noyes 1f541f02be Merge branch 'anoyes/merge-6.2-to-6.3' into anoyes/release-6.3-merge
Merge, leaving conflict markers for now
2020-11-24 16:55:34 +00:00
Chaoguang Lin 2fae7333c0 Add duration parameter in the api 2020-11-23 14:55:29 -08:00
sfc-gh-tclinkenbeard b46384e1b8 Initialize client and flow knobs 2020-11-22 09:56:18 -08:00
sfc-gh-tclinkenbeard b1e3478267 Simplified global knobs 2020-11-21 13:27:48 -08:00
Markus Pilman 615029a393
Merge pull request #4082 from sfc-gh-dyoungworth/dyoungworth/merge_6_3_master
merge 6 3 master
2020-11-19 20:53:51 -07:00
Chaoguang Lin 2320f970c1 Add reboot_worker and pythong binding 2020-11-19 16:43:39 -08:00
Chaoguang Lin cc4b282236 Remove the incorrect(unnecessary) versioning stuff, since the error is thrown by the server 2020-11-19 13:17:38 -08:00
Chaoguang Lin da39b05620 Add comments about error type change 2020-11-18 12:14:59 -08:00
Chaoguang Lin a101d3d706 Add versioning 2020-11-18 12:06:31 -08:00
Chaoguang Lin a4174d3108 Change operation_failed to dd_not_found 2020-11-18 00:18:42 -08:00
Chaoguang Lin aec0398fd0 Merge remote-tracking branch 'upstream/master' into add-c-function-for-management-commands 2020-11-17 11:39:12 -08:00
David Youngworth d64cf8b9e3 Merge branch 6.3 into master 2020-11-17 11:22:45 -08:00
David Youngworth fdf41110e5 Merge branch 'release-6.3' into dyoungworth/merge_6_2_to_6_3 2020-11-16 14:49:51 -08:00
David Youngworth d0391db862 Merge branch 'release-6.2' into release-6.3 2020-11-16 10:15:23 -08:00
sfc-gh-tclinkenbeard 12a6205d99 Move MetricLogger from fdbclient to fdbserver 2020-11-15 11:41:57 -08:00
sfc-gh-tclinkenbeard 82a50ea157 Improve type safety of ClientLogEvents 2020-11-14 19:22:19 -08:00
sfc-gh-tclinkenbeard eab75d4ee1 Make enums automatically binary serializable 2020-11-14 19:22:04 -08:00
sfc-gh-tclinkenbeard 45c9a0abc7 Revert "Revert "Add limiting health metrics""
This reverts commit 209ebcc595.
2020-11-13 17:24:57 -08:00
Trevor Clinkenbeard 209ebcc595
Revert "Add limiting health metrics" 2020-11-13 17:08:46 -08:00
Trevor Clinkenbeard 8c0b4dbe4c
Merge pull request #4067 from sfc-gh-tclinkenbeard/add-limiting-health-metrics
Add limiting health metrics
2020-11-13 16:04:44 -08:00
sfc-gh-tclinkenbeard 6c4493166f Add limiting storage queue and durability lag to health metrics 2020-11-12 20:14:41 -08:00
Meng Xu 222da17558 Merge branch 'release-6.2' into mengxu/ha-code-read 2020-11-12 13:39:27 -08:00
Jon Fu cc13ef08bd Sort the failed sets before modifying them in attempts to make changes consistent 2020-11-12 16:26:34 -05:00
Markus Pilman 0f205620bf
Merge branch 'master' into features/udp 2020-11-12 13:51:17 -07:00
Meng Xu c2dd7d1d38 Remove unresolved questions 2020-11-11 22:39:11 -08:00
Markus Pilman 1343f40117 don't allow empty coments 2020-11-11 14:07:54 -07:00
Markus Pilman bdd3dbfa7d remove duplicates 2020-11-10 14:01:07 -07:00
sfc-gh-tclinkenbeard 4669f837fa Add uses of makeReference 2020-11-07 22:10:18 -08:00
Jon Fu 51db9a7e0a add static method to access backup pause key instead of constructing it manually 2020-11-06 14:03:29 -05:00
Meng Xu 4788544a6f Revise comments based on review suggestions
Ack. Jingyu and Xin for their suggestions.
2020-11-06 08:51:13 -08:00
Xin Dong 2909e35415 When moving dispaching shard relocations, log the source and destination storage servers. 2020-11-05 16:13:18 -08:00
Andrew Noyes c50e997f60 Make status tests deterministic
This change seems to be incorrect since afaict INetwork::timer isn't
guaranteed to be monotonic. Maybe we can make that guarantee or add an
INetwork::timer_monotonic symbol?
2020-11-05 17:05:34 +00:00
Meng Xu 1664e2ff7f Add more comments and questions to LR tLog and loadbalance 2020-11-01 21:22:23 -08:00
Richard Chen 9c6c2704d0 Merge branch 'master' of https://github.com/apple/foundationdb into stable_interfaces 2020-10-30 23:59:32 +00:00
Meng Xu 063700e4d6 Add comments and questions to HA and tLog code reading
The comments' correctness need to be confirmed by reviewers.
2020-10-30 12:14:57 -07:00
sfc-gh-tclinkenbeard ca26cb57a2 Reapply BlobStore bug fix to S3BlobStore.actor.cpp
Because BlobStore.actor.cpp was renamed, this commit was lost in the
merge, so reapplying here
2020-10-30 10:06:35 -07:00
sfc-gh-tclinkenbeard 09350c760e Merge remote-tracking branch 'origin/master' into merge 2020-10-30 08:36:19 -07:00
sfc-gh-tclinkenbeard 035708f43a Post-merge cleanup 2020-10-29 22:35:27 -07:00
Trevor Clinkenbeard 0faaecc780
Merge branch 'master' into merge 2020-10-29 22:27:40 -07:00
sfc-gh-tclinkenbeard cf4c8e375f Merge remote-tracking branch 'origin/release-6.3' into merge 2020-10-29 22:15:41 -07:00
sfc-gh-tclinkenbeard 55e86c1336 Disambiguate between S3BlobStore and other blob stores 2020-10-29 20:42:23 -07:00
Steve Atherton 96cc700440
Merge pull request #3961 from sfc-gh-tclinkenbeard/azure-backup
Add support for writing backup files directly to Azure blob storage
2020-10-29 00:30:40 -07:00
Chaoguang Lin a72bb52eae Merge branch 'master' of github.com:apple/foundationdb into add-c-function-for-management-commands 2020-10-28 22:32:44 -07:00
Steve Atherton 99c1880a83 Merge commit 'f9581de2005e6b085776e81b9fcaa16442b32589' into merge-6.2-to-6.3
# Conflicts:
#	fdbserver/Knobs.cpp
#	fdbserver/Knobs.h
2020-10-27 12:21:26 -07:00
Richard Chen bf7bf470d9 Merge branch 'master' of https://github.com/apple/foundationdb into stable_interfaces 2020-10-26 19:36:19 +00:00
Richard Chen 5b546c4854 change protocol version to hex encoded string in status json. Move constant from flow transport header to cpp 2020-10-26 19:35:38 +00:00
Andrew Noyes a15bc32b14
Merge pull request #3945 from sfc-gh-clin/add-consistencycheck-to-special-keys
Add consistencycheck command to special keys
2020-10-26 10:59:17 -07:00
Steve Atherton 9501edb960 Bug fix, blob client was not correctly using keys longer than 64 bytes in request signing. 2020-10-25 21:11:04 -07:00
sfc-gh-tclinkenbeard 2a849dc52c Update BackupContainerAzureBlobStoreImpl::WriteFile::sync 2020-10-24 16:48:06 -07:00
sfc-gh-tclinkenbeard 195873e1cc Cleaned up unnecessary backup container includes 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard 195ca30a20 Azure backup cleanup 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard e389a5dabe Fix issues with Azure credentials 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard c6739f7075 Add skeleton for BackupContainerAzureBlobStore::listURLs 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard bb09f0e657 Improve AsyncTaskThread encapsulation 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard 7cba81316a Fix some race conditions in AsyncTaskThread (some more remain) 2020-10-24 16:48:04 -07:00
sfc-gh-tclinkenbeard 4d127a29cc Added testing and fixed some bugs in AsyncTaskThread 2020-10-24 16:48:04 -07:00
sfc-gh-tclinkenbeard 456a7c77a2 Add random delay to AsyncTaskThread::execAsync in simulation 2020-10-24 16:48:04 -07:00
sfc-gh-tclinkenbeard f3c52ed41e Guard Azure backup compilation behind CMake variable 2020-10-24 16:48:04 -07:00
sfc-gh-tclinkenbeard e3f94c80fc Added BackupContainerAzureBlobStore::getURLFormat 2020-10-24 16:48:03 -07:00
sfc-gh-tclinkenbeard dc3738b97f Improve encapsulation for BackupContainerFileSystem 2020-10-24 16:48:03 -07:00