Chaoguang Lin
3fed0456ca
Add an verify option for \xff\xff/worker_interfaces special keys ( #7873 )
...
* Add the verify option for \xff\xff/worker_interfaces
* Remove unused code
* update documentations
* update documentations
* solve comments from review
* update some of the comments to be more clear
2022-08-15 14:05:07 -04:00
Vaidas Gasiunas
79571dd2b4
Testing upgrades to a future version of FDB ( #7780 )
...
* Enable configuring the next future protocol version as the current protocol version in FDB client, fdbserver, and fdbcli
* Auto format python files used in upgrade tests
* Add a test for upgrading to a future FDB version
* Emphasize that the options for using future protocol version are intended for test purposes only
* Make the global variable for current protocol version visible only locally
* Refactirng to avoid using currentProtocolVersion() in static intialization
* Update go bindings
2022-08-08 17:29:49 +02:00
A.J. Beamon
7f53b340f5
Merge branch 'main' into feature-metacluster
...
# Conflicts:
# bindings/python/tests/fdbcli_tests.py
# fdbcli/TenantCommands.actor.cpp
# fdbclient/ClientKnobs.cpp
# fdbclient/include/fdbclient/ClientKnobs.h
# fdbclient/include/fdbclient/Tenant.h
# fdbserver/BlobManager.actor.cpp
# fdbserver/BlobWorker.actor.cpp
# fdbserver/TenantCache.actor.cpp
# fdbserver/storageserver.actor.cpp
# fdbserver/workloads/TenantManagementWorkload.actor.cpp
# flow/include/flow/error_definitions.h
2022-07-28 11:43:21 -07:00
A.J. Beamon
7c6b3fb0b8
Merge branch 'main' into feature-metacluster
2022-07-27 08:55:10 -07:00
Jon Fu
6dbaf46ec8
restructure test workload impl and map
2022-07-26 13:53:04 -07:00
A.J. Beamon
f2a8af9155
Better API version handling for fdbcli tenant commands
2022-07-26 09:04:29 -07:00
A.J. Beamon
a64693518a
Add support for tenant groups
2022-07-26 09:04:29 -07:00
A.J. Beamon
279296c29f
Merge branch 'tenant-metadata-change' into feature-metacluster
...
# Conflicts:
# fdbclient/SystemData.cpp
# fdbclient/Tenant.cpp
# fdbclient/include/fdbclient/SystemData.h
# fdbclient/include/fdbclient/Tenant.h
# fdbclient/include/fdbclient/TenantManagement.actor.h
# fdbserver/TenantCache.actor.cpp
# fdbserver/storageserver.actor.cpp
# fdbserver/workloads/TenantManagementWorkload.actor.cpp
2022-07-20 09:18:27 -07:00
Markus Pilman
1de37afd52
Make TEST macros C++ only ( #7558 )
...
* proof of concept
* use code-probe instead of test
* code probe working on gcc
* code probe implemented
* renamed TestProbe to CodeProbe
* fixed refactoring typo
* support filtered output
* print probes at end of simulation
* fix missed probes print
* fix deduplication
* Fix refactoring issues
* revert bad refactor
* make sure file paths are relative
* fix more wrong refactor changes
2022-07-19 13:15:51 -07:00
A.J. Beamon
860d3843cc
Merge remote-tracking branch 'origin/feature-tenant-groups' into feature-metacluster
2022-07-16 19:33:26 -07:00
A.J. Beamon
c08592368f
Add support for tenant groups
2022-07-15 21:18:41 -07:00
A.J. Beamon
0fe6f6ad36
Merge remote-tracking branch 'origin/update-prefix-encoding-in-tenant-metadata-json' into feature-metacluster
...
# Conflicts:
# bindings/python/tests/fdbcli_tests.py
# fdbcli/TenantCommands.actor.cpp
# fdbclient/include/fdbclient/TenantManagement.actor.h
# fdbclient/include/fdbclient/TenantSpecialKeys.actor.h
# fdbserver/workloads/TenantManagementWorkload.actor.cpp
2022-07-14 14:32:29 -07:00
A.J. Beamon
cb499fa5db
Merge branch 'main' into feature-metacluster
2022-07-13 15:28:34 -07:00
A.J. Beamon
91ccdbcb03
Use a more standard encoding in the JSON metadata reported for tenants.
2022-07-13 15:22:19 -07:00
A.J. Beamon
a3f970cf3a
Parse integer options in fdbcli rather than passing the bytes unparsed. This allows specifing the string "1" instead of "\x01\x00\x00\x00\x00\x00\x00\x00".
2022-07-11 16:39:59 -07:00
A.J. Beamon
b9cc5389b1
Undo some changes that aren't needed
2022-07-07 14:48:36 -07:00
A.J. Beamon
a32cc5218c
Fix some merge issues
2022-07-07 11:55:31 -07:00
A.J. Beamon
1519f24f77
Merge branch 'main' into feature-metacluster
2022-07-07 09:35:40 -07:00
A.J. Beamon
aea4d802c6
Merge branch 'main' into feature-metacluster
2022-06-30 15:08:09 -07:00
Jon Fu
5e7bb0aa21
Merge branch 'main' of github.com:apple/foundationdb into jfu-tenant-rename
2022-06-29 13:20:19 -07:00
sfc-gh-tclinkenbeard
2134fa9a0c
Merge remote-tracking branch 'origin/main' into global-tag-throttling3
2022-06-28 19:51:41 -07:00
A.J. Beamon
e1a93988ef
Merge branch 'main' into feature-metacluster
2022-06-28 14:58:07 -07:00
Jon Fu
869c6fcac5
reintroduce renameTenantCommandActor as a pass-through function
2022-06-28 11:35:40 -07:00
Jon Fu
904ac358ce
call directly into management api and remove extra function
2022-06-28 11:35:38 -07:00
Jon Fu
ddfdbdcb09
initial commit introducing renameTenant function
2022-06-28 11:34:44 -07:00
sfc-gh-tclinkenbeard
086e4bff06
Merge remote-tracking branch 'origin/main' into global-tag-throttling3
2022-06-28 10:18:13 -07:00
Markus Pilman
fc2f695b15
Merge remote-tracking branch 'origin/main' into features/cmake-refactor-dirs
2022-06-28 10:41:07 -06:00
Markus Pilman
4ac236eeba
fdbcli compiling
2022-06-27 19:20:18 -06:00
Markus Pilman
03d913a1de
Flow compiling
2022-06-27 17:05:55 -06:00
A.J. Beamon
4bafe77889
Some refactoring of tenant code:
...
* extract tenant management into its own file and namespace
* rename the tenant management workload source file
* extract tenant special keys functions to a separate file
* extract some helper functions to GenericTransactionHelper.h
* convert StringRef -> TenantNameRef
* move some TenantMapEntry implementation into the cpp file
* add some helper functions to decode/encode a tenant mode
2022-06-27 12:32:49 -07:00
Markus Pilman
d35445a868
enforce include modularization in cmake
2022-06-23 14:37:35 -06:00
A.J. Beamon
9f3819752f
Change the command to create a metacluster from using 'configure tenant_mode=management' to 'metacluster create <NAME>'. Distribute this name to all processes in a metacluster. Eliminate the tenant mode entirely from metacluster clusters, instead relying on a metacluster registration key.
2022-06-22 12:15:43 -07:00
sfc-gh-tclinkenbeard
308e0113a8
Update fdbcli quota usage output
2022-06-16 16:26:45 -07:00
sfc-gh-tclinkenbeard
99d243197e
Add fdbcli quota command
2022-06-16 14:07:16 -07:00
A.J. Beamon
2907aafa60
Merge branch 'main' into feature-metacluster
2022-06-02 12:18:42 -07:00
Chaoguang Lin
5e8c3130e6
Extend the reboot interface to accept comma-delimited string;
...
Only fetch requested worker interfaces in rebootWorkerActor
Add killall test to multiprocess_fdbcli_tests
Make the rebootWorker only sends requests if all the requested workers are valid
Add comments; Organize print texts; Fix the bug clear the map every time run kill/suspend/expensive_data_check
2022-05-20 12:06:33 -07:00
A.J. Beamon
69261f9f10
Merge branch 'main' into feature-metacluster
...
# Conflicts:
# fdbclient/MultiVersionTransaction.actor.cpp
# fdbclient/MultiVersionTransaction.h
# fdbserver/tester.actor.cpp
2022-05-19 09:11:30 -07:00
Evan Tschannen
583120514f
fixed compilation errors
2022-05-12 17:19:25 -07:00
Evan Tschannen
c51ad847d6
revert "kill" command to previous 7.0 behavior because the current implementation is killing processes one at a time
2022-05-12 13:12:23 -07:00
Vishesh Yadav
7578d5ebc7
Create GlobalConfig object for each database instance
...
Currently, GlobalConfig is a singleton that means for each process there is only
one GlobalConfig object. This is bug from clients perspective as a client can
keep connections to several databases. This patch tracks GlobalConfig for each
database using an unordered_map in flowGlobals.
We discovered this bug while testing multi-version client, where the client got
stuck. This was lucky, as normally it'd just write down config to the wrong
database.
2022-05-09 14:54:51 -07:00
A.J. Beamon
7c3b99f5bd
Add support for connection to clusters via a connection string. Start work on multi-cluster operations with data cluster registration.
2022-05-06 09:53:53 -07:00
Trevor Clinkenbeard
0069ce51a5
Merge pull request #7054 from sfc-gh-tclinkenbeard/remove-non-tls-support
...
Remove `DISABLE_TLS` CMake option
2022-05-03 22:13:07 -07:00
A.J. Beamon
7e860dc92c
Some initial metacluster implementation
2022-05-03 12:53:35 -07:00
sfc-gh-tclinkenbeard
225146176d
Apply clang-format to fdbcli.actor.cpp and Net2.actor.cpp
2022-05-03 12:13:09 -07:00
sfc-gh-tclinkenbeard
06825775db
Fix formatting of lines with TLS_OPTION_FLAGS
2022-05-02 22:56:06 -07:00
sfc-gh-tclinkenbeard
7f05221cfe
Removed TLS_DISABLED macro
2022-05-02 22:15:27 -07:00
A.J. Beamon
43c2ca35a5
Move fdbcli command and hint generators into the files implementing the command.
2022-05-02 08:39:59 -07:00
Renxuan Wang
c69a07a858
Check in the new Hostname logic. ( #6926 )
...
* Revert #6655 .
20220407-031010-renxuan-c101052c21da8346 compressed=True data_size=31004844 duration=4310801 ended=100000 fail_fast=10 max_runs=100000 pass=100000 priority=100 remaining=0 runtime=1:04:15 sanity=False started=100047 stopped=20220407-041425 submitted=20220407-031010 timeout=5400 username=renxuan
* Revert #6271 .
20220407-051532-renxuan-470f0fe6aac1c217 compressed=True data_size=30982370 duration=3491067 ended=100002 fail_fast=10 max_runs=100000 pass=100002 priority=100 remaining=0 runtime=0:59:57 sanity=False started=100141 stopped=20220407-061529 submitted=20220407-051532 timeout=5400 username=renxuan
* Revert #6266 .
Remove resolving-related functionalities in connection string. Connection string will be used for storing purpose only, and non-mutable.
20220407-175119-renxuan-55d30ee1a4b42c2f compressed=True data_size=30970443 duration=5437659 ended=100000 fail_fast=10 max_runs=100000 pass=100000 priority=100 remaining=0 runtime=0:59:31 sanity=False started=100154 stopped=20220407-185050 submitted=20220407-175119 timeout=5400 username=renxuan
* Add hostname to coordinator interfaces.
* Turn on the new hostname logic.
* Add the corresponding change in config txns.
The most notable change is before calling basicLoadBalance(), we need to call tryInitializeRequestStream() to initialize request streams first.
Passed correctness tests.
* Return error when hostnames cannot be resolved in coordinators command.
* Minor fixes.
2022-04-27 21:54:13 -07:00
Andrew Noyes
29cf5f1fbf
Fix an ASSERT when an fdbcli command times out ( #6857 )
...
* Re-throw operation_cancelled
There's a few places in fdbcli where we don't rethrow operation
cancelled but wait on a future. It's very unusual that you don't want to
rethrow operation_cancelled.
* Update ASSERT
It's possible to get error_code_broken_promise here if the network has
already shutdown.
2022-04-14 12:09:25 -07:00
Aaron Molitor
cbaef8f03b
update version to 7.2.0
2022-04-11 23:23:27 -05:00