a860778b51
Add write buffering to BackupContainerLocalDirectory::BackupFile to greatly reduce the number of IAsyncFile::write() calls made when writing backup data. The buffer size is controlled by a knob.
2021-01-09 07:57:48 -08:00
fbcc85843f
clarify comment for serverKeys possible values
2021-01-06 17:15:31 -05:00
43a79a34ff
Merge pull request #4175 from vishesh/task/document
...
Docs, fix and hack for Fault Tolerance
2021-01-05 15:46:45 -08:00
58360a192f
Add a counter for the number of status requests made by a client
2021-01-05 10:18:43 -08:00
278e7de6f5
added more documentation
2021-01-04 16:59:08 -05:00
a0d33c5d03
added more comments
2021-01-04 16:00:12 -05:00
53d23d95d8
initial commit in adding more documentation to special keys
2021-01-04 15:26:48 -05:00
e097c98956
Remove headed added by IDE, add comments
2021-01-04 00:18:01 -08:00
da7b65cd71
Change the interface back to return int64_t
2021-01-03 22:45:09 -08:00
e7e2439abe
Remove unnecessary copy from BackupContainerAzureBlobStoreImpl::read
2021-01-01 09:43:03 -04:00
70e62d34ca
Merge remote-tracking branch 'origin/master' into misc-changes
2020-12-28 01:58:56 -04:00
86c7c1e946
Fix IAsyncFileSystem method signatures
2020-12-28 01:57:42 -04:00
5b2e88b187
Use structured bindings in for loops
2020-12-27 01:46:20 -04:00
5bfa6cea98
Merge remote-tracking branch 'origin/master' into misc-changes
2020-12-26 20:47:00 -04:00
33ec968d5a
Mark expectedSize methods const
2020-12-26 18:30:44 -04:00
4e460c0b30
Remove BlobStore.actor.cpp
2020-12-26 13:30:16 -04:00
bbb56e4089
Merge branch 'release-6.2' of https://github.com/apple/foundationdb into release-6.3
2020-12-23 14:26:59 -08:00
6957e64886
fix: Calculate fault tolerance when keys are not fully replicated
...
Whem the database is not fully replicated to remote, fault tolerance
can be calculated by couting total number of tLogs replicas in primary
and satellite - 1, as we can lose all but one of those, but we were
subtracting 2 instead of 1.
2020-12-22 16:26:19 -08:00
a1809f7d86
doc: Fault Tolerance and Region Configuration
2020-12-22 16:25:17 -08:00
8d4cbfbb86
Merge branch 'release-6.2' into feature/allow-manually-trigger-dd-teams-info-logging
2020-12-22 10:00:24 -08:00
0ecfaf138e
Merge pull request #4150 from sfc-gh-ljoswiak/fixes/sps-tracing
...
Remove "a/" from tracing keys in special-key-space
2020-12-21 13:48:01 -08:00
9db9a84798
Ignore negative duration value
2020-12-21 13:29:16 -08:00
b68d84aaea
Merge remote-tracking branch 'upstream/master' into add-c-function-for-management-commands
2020-12-21 12:32:31 -08:00
7b4f7ce4e0
update comments
2020-12-20 22:47:55 -08:00
adc916121e
Copy the network address stringref
2020-12-20 22:44:04 -08:00
fb62ce4f64
Removed the override
2020-12-14 08:34:09 -05:00
24cdbc5cee
Fixed error with Windows CMake build
2020-12-14 08:23:24 -05:00
9601769b01
Merge pull request #3858 from sfc-gh-rchen/stable_interfaces
...
Stable interfaces
2020-12-11 09:34:27 -08:00
5f57d72a59
remove print statements and format protocol version workload
2020-12-11 04:46:20 +00:00
4cb821cd63
Merge remote-tracking branch 'upstream/release-6.2' into merge-6.2-to-6.3
2020-12-09 15:47:44 -08:00
43fd545f06
Remove a/ from tracing path in special-key-space
2020-12-09 13:40:16 -08:00
b305e71ece
Merge pull request #4141 from sfc-gh-anoyes/anoyes/merge-release-6.3-master
...
Merge release 6.3 master
2020-12-09 08:50:57 -08:00
c8786a65c3
Remove unnecessary uses of virtual
2020-12-08 09:09:33 -08:00
276f80cfce
Mark Tag::toTagDataIndex const
2020-12-08 09:09:33 -08:00
9581bc0279
Merge pull request #4129 from sfc-gh-anoyes/anoyes/merge-release-6.3-master
...
Merge release 6.3 master
2020-12-08 08:57:54 -08:00
54237f28ea
Throw error on commit for late trace options
2020-12-07 14:43:44 -08:00
cc669f399e
Merge remote-tracking branch 'upstream/release-6.3' into anoyes/merge-release-6.3-master
2020-12-07 22:26:11 +00:00
18201d6f4f
Add option to enable transaction tracing
2020-12-07 11:24:14 -08:00
75836d6114
Fix double counting of range reads in TransactionMetrics
2020-12-07 09:01:19 -08:00
d97523a966
Fix typo
2020-12-06 14:04:16 -08:00
7fbc4d7391
Resolve conflicts
2020-12-04 23:58:42 +00:00
e5cad0f077
Fix the bug if boundary same as range and add comments
2020-12-04 14:58:40 -08:00
76142549e0
Return keys from range read in lexicographic order
2020-12-04 11:21:39 -08:00
877997632d
Merge branch 'release-6.3' into anoyes/merge-release-6.3-master
...
Include conflict markers for review purposes
2020-12-04 01:38:07 +00:00
ac02329d7d
Added a command in fdbcli to allow user to manually trigger the detailed teams info loggings in data distributor
2020-12-03 14:42:30 -08:00
3669615e4b
Refactor and clean up
2020-12-03 14:06:11 -08:00
8d59dae26d
Add check for existence of databaseRebootWorker in c api
2020-12-03 13:47:59 -08:00
88e66545bb
Change the api to return bool instead of int
2020-12-03 12:01:32 -08:00
c77d9e4abe
merge conflicts
2020-12-02 21:53:19 +00:00
1f166bc183
Add options to set custom transaction ID and disable tracing
2020-11-30 14:57:17 -08:00
dc2bac5670
Resolve conflicts
2020-11-24 19:09:42 +00:00
1f541f02be
Merge branch 'anoyes/merge-6.2-to-6.3' into anoyes/release-6.3-merge
...
Merge, leaving conflict markers for now
2020-11-24 16:55:34 +00:00
2fae7333c0
Add duration parameter in the api
2020-11-23 14:55:29 -08:00
b46384e1b8
Initialize client and flow knobs
2020-11-22 09:56:18 -08:00
b1e3478267
Simplified global knobs
2020-11-21 13:27:48 -08:00
615029a393
Merge pull request #4082 from sfc-gh-dyoungworth/dyoungworth/merge_6_3_master
...
merge 6 3 master
2020-11-19 20:53:51 -07:00
2320f970c1
Add reboot_worker and pythong binding
2020-11-19 16:43:39 -08:00
cc4b282236
Remove the incorrect(unnecessary) versioning stuff, since the error is thrown by the server
2020-11-19 13:17:38 -08:00
da39b05620
Add comments about error type change
2020-11-18 12:14:59 -08:00
a101d3d706
Add versioning
2020-11-18 12:06:31 -08:00
a4174d3108
Change operation_failed to dd_not_found
2020-11-18 00:18:42 -08:00
aec0398fd0
Merge remote-tracking branch 'upstream/master' into add-c-function-for-management-commands
2020-11-17 11:39:12 -08:00
d64cf8b9e3
Merge branch 6.3 into master
2020-11-17 11:22:45 -08:00
fdf41110e5
Merge branch 'release-6.3' into dyoungworth/merge_6_2_to_6_3
2020-11-16 14:49:51 -08:00
d0391db862
Merge branch 'release-6.2' into release-6.3
2020-11-16 10:15:23 -08:00
12a6205d99
Move MetricLogger from fdbclient to fdbserver
2020-11-15 11:41:57 -08:00
82a50ea157
Improve type safety of ClientLogEvents
2020-11-14 19:22:19 -08:00
eab75d4ee1
Make enums automatically binary serializable
2020-11-14 19:22:04 -08:00
45c9a0abc7
Revert "Revert "Add limiting health metrics""
...
This reverts commit 209ebcc595
2020-11-13 17:24:57 -08:00
209ebcc595
Revert "Add limiting health metrics"
2020-11-13 17:08:46 -08:00
8c0b4dbe4c
Merge pull request #4067 from sfc-gh-tclinkenbeard/add-limiting-health-metrics
...
Add limiting health metrics
2020-11-13 16:04:44 -08:00
6c4493166f
Add limiting storage queue and durability lag to health metrics
2020-11-12 20:14:41 -08:00
222da17558
Merge branch 'release-6.2' into mengxu/ha-code-read
2020-11-12 13:39:27 -08:00
cc13ef08bd
Sort the failed sets before modifying them in attempts to make changes consistent
2020-11-12 16:26:34 -05:00
0f205620bf
Merge branch 'master' into features/udp
2020-11-12 13:51:17 -07:00
c2dd7d1d38
Remove unresolved questions
2020-11-11 22:39:11 -08:00
1343f40117
don't allow empty coments
2020-11-11 14:07:54 -07:00
bdd3dbfa7d
remove duplicates
2020-11-10 14:01:07 -07:00
4669f837fa
Add uses of makeReference
2020-11-07 22:10:18 -08:00
51db9a7e0a
add static method to access backup pause key instead of constructing it manually
2020-11-06 14:03:29 -05:00
4788544a6f
Revise comments based on review suggestions
...
Ack. Jingyu and Xin for their suggestions.
2020-11-06 08:51:13 -08:00
2909e35415
When moving dispaching shard relocations, log the source and destination storage servers.
2020-11-05 16:13:18 -08:00
c50e997f60
Make status tests deterministic
...
This change seems to be incorrect since afaict INetwork::timer isn't
guaranteed to be monotonic. Maybe we can make that guarantee or add an
INetwork::timer_monotonic symbol?
2020-11-05 17:05:34 +00:00
1664e2ff7f
Add more comments and questions to LR tLog and loadbalance
2020-11-01 21:22:23 -08:00
9c6c2704d0
Merge branch 'master' of https://github.com/apple/foundationdb into stable_interfaces
2020-10-30 23:59:32 +00:00
063700e4d6
Add comments and questions to HA and tLog code reading
...
The comments' correctness need to be confirmed by reviewers.
2020-10-30 12:14:57 -07:00
ca26cb57a2
Reapply BlobStore bug fix to S3BlobStore.actor.cpp
...
Because BlobStore.actor.cpp was renamed, this commit was lost in the
merge, so reapplying here
2020-10-30 10:06:35 -07:00
09350c760e
Merge remote-tracking branch 'origin/master' into merge
2020-10-30 08:36:19 -07:00
035708f43a
Post-merge cleanup
2020-10-29 22:35:27 -07:00
0faaecc780
Merge branch 'master' into merge
2020-10-29 22:27:40 -07:00
cf4c8e375f
Merge remote-tracking branch 'origin/release-6.3' into merge
2020-10-29 22:15:41 -07:00
55e86c1336
Disambiguate between S3BlobStore and other blob stores
2020-10-29 20:42:23 -07:00
96cc700440
Merge pull request #3961 from sfc-gh-tclinkenbeard/azure-backup
...
Add support for writing backup files directly to Azure blob storage
2020-10-29 00:30:40 -07:00
a72bb52eae
Merge branch 'master' of github.com:apple/foundationdb into add-c-function-for-management-commands
2020-10-28 22:32:44 -07:00
99c1880a83
Merge commit 'f9581de2005e6b085776e81b9fcaa16442b32589' into merge-6.2-to-6.3
...
# Conflicts:
# fdbserver/Knobs.cpp
# fdbserver/Knobs.h
2020-10-27 12:21:26 -07:00
bf7bf470d9
Merge branch 'master' of https://github.com/apple/foundationdb into stable_interfaces
2020-10-26 19:36:19 +00:00
5b546c4854
change protocol version to hex encoded string in status json. Move constant from flow transport header to cpp
2020-10-26 19:35:38 +00:00
a15bc32b14
Merge pull request #3945 from sfc-gh-clin/add-consistencycheck-to-special-keys
...
Add consistencycheck command to special keys
2020-10-26 10:59:17 -07:00
9501edb960
Bug fix, blob client was not correctly using keys longer than 64 bytes in request signing.
2020-10-25 21:11:04 -07:00
2a849dc52c
Update BackupContainerAzureBlobStoreImpl::WriteFile::sync
2020-10-24 16:48:06 -07:00
195873e1cc
Cleaned up unnecessary backup container includes
2020-10-24 16:48:05 -07:00
195ca30a20
Azure backup cleanup
2020-10-24 16:48:05 -07:00
e389a5dabe
Fix issues with Azure credentials
2020-10-24 16:48:05 -07:00
c6739f7075
Add skeleton for BackupContainerAzureBlobStore::listURLs
2020-10-24 16:48:05 -07:00
bb09f0e657
Improve AsyncTaskThread encapsulation
2020-10-24 16:48:05 -07:00
7cba81316a
Fix some race conditions in AsyncTaskThread (some more remain)
2020-10-24 16:48:04 -07:00
4d127a29cc
Added testing and fixed some bugs in AsyncTaskThread
2020-10-24 16:48:04 -07:00
456a7c77a2
Add random delay to AsyncTaskThread::execAsync in simulation
2020-10-24 16:48:04 -07:00
f3c52ed41e
Guard Azure backup compilation behind CMake variable
2020-10-24 16:48:04 -07:00
e3f94c80fc
Added BackupContainerAzureBlobStore::getURLFormat
2020-10-24 16:48:03 -07:00
dc3738b97f
Improve encapsulation for BackupContainerFileSystem
2020-10-24 16:48:03 -07:00
6a27619544
Remove unnecessary copies in BackupContainer code
2020-10-24 16:48:03 -07:00
1d28285cc5
Made BackupContainer.h header guard consistent with other header guards
2020-10-24 16:48:03 -07:00
ae91cf1d44
Make BackupContainerFileSystem.h a non-actor file
2020-10-24 16:48:02 -07:00
9242456d71
Improve encapsulation for BackupContainerAzureBlobStore
2020-10-24 16:48:02 -07:00
226b3f6bf2
Improve encapsulation for BackupContainerS3BlobStore
2020-10-24 16:48:02 -07:00
e1d58d3c66
Moved BackupContainerS3BlobStore into its own files
2020-10-24 16:48:02 -07:00
e15a268548
Use anonymous namespace for BackupContainerLocalDirectory helper functions
2020-10-24 16:48:02 -07:00
961aeaecac
Moved BackupContainerAzureBlobStore into its own files
2020-10-24 16:48:01 -07:00
e5338d213b
Moved BackupContainerLocalDirectory into its own files
2020-10-24 16:48:01 -07:00
3c6de425a1
Moved BackupContainerFileSystem implementation to cpp file
2020-10-24 16:48:01 -07:00
cd50d53b1e
Created BackupContainerFileSystem.actor.h
2020-10-24 16:48:01 -07:00
29d6fc5dff
Clarify scope of IBackupFile_impl namespace
2020-10-24 16:48:00 -07:00
0879e529d2
Add error handling to AsyncTaskThread::execAsync
2020-10-24 16:48:00 -07:00
0a99438d84
Update pNumDeleted in BackupContainerAzureBlobStore::deleteContainer
2020-10-24 16:48:00 -07:00
2049789a99
Remove BackupContainerAzure.actor.cpp
2020-10-24 16:47:59 -07:00
ad911f4d61
Encapsulate some methods in BackupContainerAzureBlobStore
2020-10-24 16:47:59 -07:00
72b24c36e7
Fix header for AsyncTaskThread.h
2020-10-24 16:47:59 -07:00
82b6daa16b
First draft of Azure blob storage backup container
2020-10-24 16:47:51 -07:00
309e38dc06
add unit test and some cleanup
2020-10-23 19:34:18 +00:00
9043357934
Merge pull request #3360 from sfc-gh-tclinkenbeard/use-vector-for-tagset
...
Use std::vector for TagSet
2020-10-23 10:34:20 -07:00
055add9682
conflicts
2020-10-23 06:33:00 +00:00
90caa24af1
add function to get correct checksum class. Remove IChecksum::checkSum function
2020-10-23 02:24:29 +00:00
bd578a0d95
clang-format
2020-10-22 18:27:58 -07:00
3cbed7b0d1
Add checker to make sure registered special key range following snake case naming
2020-10-22 18:25:51 -07:00
c8eb003ec4
Change to \xff\xff/management/in_progress_exclusion, the snake case naming style
2020-10-22 18:05:54 -07:00
c8b3b37b4a
Remove unused code for #3930
2020-10-22 17:04:08 -07:00
0060eeb6f8
Merge pull request #3930 from sfc-gh-clin/fix-FuzzApiCorrectness
...
Fix FuzzApiCorrectness test failures
2020-10-22 16:24:37 -07:00
4c42917b1d
Fix typos in comments
2020-10-22 15:36:10 -07:00
1d081401c6
Fix Tag::load bug
2020-10-22 14:13:14 -07:00
95654ce7e7
Change dbLocked to snake_case naming db_locked
2020-10-22 11:35:39 -07:00
2b4ec39a2f
Avoid passing references from an iterator into an insertion that invalidates the iterator.
2020-10-22 11:30:08 -07:00
1d64b2c335
clang-format
2020-10-22 11:28:03 -07:00
b728fe473e
Add consistencycheck command to special keys
2020-10-22 11:08:54 -07:00
dec643987f
Add wait time after dd not found error
2020-10-21 16:58:23 -07:00
8d937a56f2
Throw operation_failed() if dd not found when calling ddMetricsRequestServer
...
Remove time_out error in DDMetricsList rpc
Add retry logic for dd special key when dd not found
Update FuzzApiCorrectness test
2020-10-21 15:28:03 -07:00
e183a10c8c
Add "waitForDestUID" flag for abortBackup
2020-10-20 22:55:31 -07:00
8cc3e4d3c6
Merge release-6.3 into master
2020-10-19 22:51:56 -07:00
c84a5f4014
change IChecksum interface and remove coordinator protocol version optional
2020-10-19 21:39:07 +00:00
a4ccf8c5b6
add checksum class to change checksum in the future. expose get server protocol api
2020-10-19 16:57:11 +00:00
944f30484a
Merge pull request #3759 from dongxinEric/misc/3739/expose-time-since-last-recovery
...
This resolves issue #3739 by exposing time since last full recovery.
2020-10-19 09:03:31 -07:00
47a9bc9d3d
Fix commit_unknown_result issue
2020-10-18 23:11:19 -07:00
bfd3328448
Fix a race between submit and abort backup
...
After submit a backup, immediately abort the backup may cause a rare race
condition, which results in BackupCorrectnessLeftoverVersionKey error.
Specifically, in the StartFullBackupTaskFunc:
1st Txn sets the destUid at the source database and the 2nd Txn writes the dest
DB.
An abort can come after the 1st Txn succeeds, and clears the config rage so
that the 2nd Txn above would fail. Because 2nd Txn didn't write destUid, the
3rd Txn of abort can't read the correct source DB for latestVersionKey, which
contains the destUid value.
The fix is to let the 1st Txn of abort to wait until destUid becomes valid.
2020-10-18 23:11:15 -07:00
545ee4269d
master conflicts
2020-10-19 01:03:54 +00:00
1c533e7363
fix flowtransport conflicts
2020-10-19 01:00:03 +00:00
c1d88b39ab
Merge remote-tracking branch 'origin/master' into add-upgrade-and-backup-restore-test
2020-10-17 11:35:12 -07:00
c1b4e62bde
Change the trace from SevInfo to SevDebug
2020-10-15 13:55:31 -07:00
0718329705
Make getDesiredClusterKeyName const
...
This fixes a virtual function overload in NameQuorumChange
2020-10-15 10:39:38 -07:00
24ea35e56f
Merge pull request #3748 from sfc-gh-ljoswiak/visibility-2
...
Add TLogVersion::V6
2020-10-14 17:35:32 -07:00
bf00369576
getRange only enters special key space codepath when both begin key and end key are in (\xff\xff, \xff\xff\xff)
2020-10-14 16:57:38 -07:00
e47e0108a7
Add new TLogVersion
2020-10-14 15:41:10 -07:00
a1e868a569
Merge pull request #3862 from sfc-gh-tclinkenbeard/use-override-more
...
Add uses of override keyword, remove unnecessary uses of virtual
2020-10-14 15:06:45 -07:00
bbc6d2aa03
Merge pull request #3872 from sfc-gh-clin:add-lock-unlock-to-special-keys
...
Add lock/unlock to special keys
2020-10-13 09:09:49 -07:00
4eb20a1283
merge anoyes/stable-interface and add back in isCompatible
2020-10-12 20:39:37 +00:00
2f5b0bef08
switch to test newer incompatible version. Fix PR comments. Modify schema
2020-10-12 18:29:16 +00:00
a4e1efbc0e
revert MultiVersionTransaction
2020-10-12 18:25:14 +00:00
5488ff1d81
draft diff protocol
2020-10-12 18:24:03 +00:00
b233f44d2d
remove some print statements and spin lock that was used for debugging
2020-10-12 18:20:37 +00:00
41843f07e6
add simulator support for different process versions and ProtocolVersion test
2020-10-12 18:19:31 +00:00
76d0027fa2
merge anoyes/stable-interface and add back in isCompatible
2020-10-12 18:18:30 +00:00
d3b57d9873
Merge pull request #3823 from sfc-gh-jfu/jfu-snapshot-record-version
...
Have snapshot record to system keys and write lastEpochEnd on recovery
2020-10-09 07:27:19 -07:00
dc4612712d
Merge remote-tracking branch 'origin/master' into use-override-more
2020-10-09 07:12:41 -07:00
ccf2ca73f3
Fix Windows CMake build
2020-10-08 23:58:58 -07:00
76440018fb
Remove unnecessary error thrown when calling clear range on the lock special key range
2020-10-08 21:39:13 -07:00
5d902f9177
Merge pull request #3394 from dongxinEric/feature/range-split-points-based-on-size
...
Feature/range split points based on size
2020-10-08 14:25:11 -07:00
c66a775d64
Merge remote-tracking branch 'upstream/master' into add-lock-unlock-to-special-keys
2020-10-08 14:23:16 -07:00
53d3759e73
Add lock command to special key \xff\xff/dbLocked
2020-10-08 14:23:02 -07:00
2def07a18d
Apply suggestions from code review
2020-10-08 13:31:47 -07:00
a9607bdcec
Explicitly seal classes that inherit but aren't inherited from
2020-10-07 21:58:24 -07:00
a3de8c333b
Use override where applicable in fdbclient
2020-10-07 16:57:38 -07:00
f03a355c4e
Merge branch 'release-6.2' into release-6.3
...
# Conflicts:
# CMakeLists.txt
# documentation/sphinx/source/downloads.rst
# fdbrpc/FlowTransport.actor.cpp
# fdbrpc/FlowTransport.h
# flow/Arena.h
# flow/Knobs.cpp
# flow/Knobs.h
# packaging/msi/FDBInstaller.wxs
2020-10-07 12:28:22 -07:00
dea7000970
Merge remote-tracking branch 'upstream/master' into visibility-1
2020-10-06 18:38:15 -07:00
7218586f2f
adjust test spec and backup describe
2020-10-06 17:03:09 -04:00
76da0a7cbc
Backport #3426 to release-6.2
2020-10-05 13:53:51 -07:00
c622a11c70
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version
2020-10-05 13:15:56 -04:00
43ac7f21a4
Mark toString methods const
2020-10-04 23:27:10 -07:00
d944e13e5b
Make TaskBucket::getAvailableSpace const
2020-10-04 23:27:09 -07:00
8ae0679112
Remove unnecessary separation of declaration and definition of version field
2020-10-04 23:27:05 -07:00
b294e148c5
another compile fix
2020-10-04 16:54:43 -07:00
614c8bc895
Get read versions requests must be load balanced on the number of requests because ratekeeper gives out an equal budget to each proxy
2020-10-04 16:20:24 -07:00
6326de052b
Remove unused LogFileWriter::FFs
2020-10-02 17:03:08 -07:00
cacf4be449
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version
2020-10-02 12:57:17 -04:00
268ba0bddc
Merge remote-tracking branch 'origin/release-6.3' into merge-6.3
2020-10-01 14:14:06 -06:00
13d1978c19
Merge branch 'release-6.3' into feature-fix-fault-tolerance
2020-09-30 19:00:31 -07:00
8c729ca8e6
only add additional fault tolerance for availability if automatic failover is enabled
2020-09-30 18:04:23 -07:00
c7a55fe15f
Merge pull request #3829 from yliucode/process-class
...
Support specifying proxy as process class and converting it to commit proxy
2020-09-30 16:46:24 -07:00
fe5c30e778
fault tolerance was not being properly increased when usable regions was 2 and satellites are configured.
2020-09-30 16:41:00 -07:00
0c579674e6
Add more help messages for configuring 'proxies'
2020-09-30 13:29:01 -07:00
e2705668be
Lower WATCH_TIMEOUT default value to 30.0
2020-09-30 11:52:51 -07:00
8da8c6ff0d
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version
2020-09-30 14:25:29 -04:00
44cd3b0999
add stopBackup to incrementalBackup workload
2020-09-30 14:24:52 -04:00
3705f5a6fe
Merge pull request #3820 from sfc-gh-tclinkenbeard/improve-type-safety
...
Improve ConfigurationResult and CoordinatorsResult type safety
2020-09-30 10:46:59 -07:00
c34385ef7b
Support proxy process class
2020-09-30 01:23:10 -07:00
21071b6214
Merge pull request #3813 from xumengpanda/mengxu/merge-to-master-PR
...
Merge 6.3 to master and resolve conflicts
2020-09-28 15:24:18 -07:00
cfaa207f88
fix spacing and newlines at ends of files
2020-09-28 16:32:20 -04:00
3aa4070adb
remove trace events used for debugging
2020-09-28 16:27:30 -04:00
e02caac2d9
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version
2020-09-28 16:20:33 -04:00
6c726ba8dd
Improve ConfigurationResult and CoordinatorsResult type safety
2020-09-27 15:29:15 -07:00
1fb11858e6
Fix failure caused by merge
2020-09-27 11:03:16 -07:00
8d9e7adac7
Merge pull request #3817 from yliucode/proxy-doc
...
Mention GRV & Commit proxy in docs and add backward compatibility for configuring proxies
2020-09-25 22:58:55 -07:00
480fc82779
Resolve review comments
2020-09-25 16:58:54 -07:00
bbc7ce581e
Resolve conflicts merging from 6.3 to master
2020-09-25 16:08:31 -07:00
3278e21b0b
Change description of GRV proxy and Commit proxy in docs and add backward compatibility support for configuring proxies in fdbcli
2020-09-25 10:50:48 -07:00
b6b87cd8d4
fileconfigure fails with Assertion false failed
2020-09-25 20:20:00 +03:00
862336de8f
Merge branch 'master' into mengxu/merge-to-master-PR
2020-09-24 17:06:00 -07:00
a96d6f85c5
Removed redundant field number_of_old_generations_of_tlogs from status json
2020-09-24 09:44:51 -07:00
6ed330572e
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version
2020-09-24 12:09:17 -04:00
feb3bda79e
Merge pull request #3797 from xumengpanda/mengxu/fr-write-traffic-control-PR
...
Fast Restore: Add write rate control
2020-09-23 15:50:08 -07:00
3a03c9bd74
Remove deprecated enumActionResult
2020-09-23 15:14:09 -07:00
d13a9d3c91
Make EBackupState an enum class
2020-09-23 15:14:09 -07:00
69580593dd
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version
2020-09-23 15:35:05 -04:00
50f681cd32
Apply suggestions from code review
...
Co-authored-by: A.J. Beamon <ajbeamon@users.noreply.github.com>
2020-09-23 10:54:49 -07:00
b37daf88d4
add jitter to the delay
2020-09-22 22:24:40 -07:00
09ff05c629
backed out buggify of apiVersion because there are too many tests that depend on it for a patch release
2020-09-22 21:15:49 -07:00
e0fbadfeb5
Added a buggify so older API versions are run in simulation
2020-09-22 18:58:01 -07:00
c99627a7ab
Merge branch 'release-6.3' of github.com:apple/foundationdb into feature-apiverison-batch-error
2020-09-22 17:06:17 -07:00
7dec47938e
protect api versions older than 630 from seeing batch_transaction_throttled errors
2020-09-22 17:05:09 -07:00
002b1bec4c
FastRestore:Control write traffic at each applier
...
Controller assigns each applier a write rate.
Applier keeps the write-rate worth of transactions outstanding to DB.
This is to avoid heavily overloading DB while still keep enough
traffic to DB to get a good write throughput.
2020-09-22 08:14:28 -07:00
9b7d75b6dd
WIP
2020-09-21 13:41:35 -04:00
7d606ebff4
Fix some accidental s/NULL/nullptr replacements
2020-09-20 11:33:18 -07:00
b4e209bd4e
Replace NULL with nullptr in fdbclient
2020-09-20 11:33:09 -07:00
a52ef0acb8
Merge pull request #3677 from sfc-gh-clin/add-setclass-to-special-key-space
...
Add setclass to special keys
2020-09-19 14:55:03 -07:00
d4e3e98957
Use new getRestoreSet in RestoreController
2020-09-17 17:56:36 -07:00
71309a79f9
Merge branch 'release-6.3' into range
2020-09-17 17:54:33 -07:00
cf69f455a9
Merge pull request #3785 from apple/release-6.3
...
Merge Release 6.3 to master
2020-09-17 14:43:56 -07:00
4df0f60729
Instead of using fully_recovered, use accepting_commits as a singal of DB turned available. Also add the number of old generations into status
2020-09-17 09:55:25 -07:00
ea27e4bd9c
Merge pull request #3772 from yliucode/rename
...
Rename master proxy as commit proxy
2020-09-16 20:06:50 -07:00
1fe31aa9e8
Merge pull request #3706 from yliucode/tlogs
...
Report missing old tlogs in recovery before storage servers are fully recovered
2020-09-16 14:07:06 -07:00
cc5bc16bd8
Rename more places from proxy to commit proxy
2020-09-15 22:29:49 -07:00
8224e17a08
Integrate extended getRestoreSet API into fast restore
...
The extended getRestoreSet provides a much smaller set of backup files for small keyrange restore;
This commit integrate it into fast restore so that fast restore does not have to filter out unneeded backup files.
2020-09-15 09:38:43 -07:00
3dfadff6d8
Merge remote-tracking branch 'upstream/master' into add-c-function-for-management-commands
2020-09-14 16:45:47 -07:00
cc32074ed7
Rename actor
2020-09-14 16:45:34 -07:00
f9a5b727a6
Add comments questions and TODOs
2020-09-14 16:28:01 -07:00
a3c861b59d
Merge pull request #3777 from apple/release-6.3
...
Merge Release 6.3 into master
2020-09-14 10:32:50 -07:00
0282a1745a
Address more review comments
2020-09-11 16:44:09 -07:00
0a7d2d31f1
Review some review comments from AJ
2020-09-11 16:17:23 -07:00
6dbcd42ebd
No need for a new protocol version since the serialization won't change. Added code for deserializing from old binary.
2020-09-11 16:16:56 -07:00
1b923477f7
Apply suggestions from code review
...
Co-authored-by: A.J. Beamon <ajbeamon@users.noreply.github.com>
2020-09-11 14:28:56 -07:00
260c8d9568
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version
2020-09-11 15:05:58 -04:00
22996284c7
added changes to allow writing of last epoch end version to special keys when performing recovery due to snapshot
2020-09-11 15:00:11 -04:00
Steve Atherton