Steve Atherton
e5e4457c6e
Merge commit '8ad98dc9db2a1f9c3c1b44b22e0532bfa8c89ee5' into pml-delay
...
# Conflicts:
# fdbserver/storageserver.actor.cpp
2022-11-11 11:49:31 -08:00
Jingyu Zhou
8ad98dc9db
Merge pull request #8696 from sfc-gh-dadkins/sfc-gh-dadkins/arena-self-ref
...
Assert that we don't try to have an ArenaBlock depend on itself.
2022-11-11 09:47:39 -08:00
Kevin Hoxha
6c729e7f25
Make the timing consitent in simulation
2022-11-11 09:44:00 -08:00
Hui Liu
036b6ac4df
Merge pull request #8699 from sfc-gh-huliu/cli2
...
Add fdbcli blobrestore to start the full restore
2022-11-11 09:23:31 -08:00
Hui Liu
0f8e5af5cf
Add micro-benchmark for blob delta serialization
2022-11-11 09:22:11 -08:00
Hui Liu
5834517570
Add fdbcli blobrestore to start the full restore
2022-11-11 08:32:23 -08:00
Xiaoxi Wang
b79268326a
Merge branch 'main' of https://github.com/apple/foundationdb into feature/main/dataApi
2022-11-11 08:29:22 -08:00
Vaidas Gasiunas
b5182dc43f
Define client config tests as python unit tests ( #8791 )
2022-11-11 15:59:18 +01:00
Steve Atherton
3b4a467a92
Remove runners list from PriorityMultiLock and rely on reference counting in the release handler instead of canceling the release handlers. This improves the microbenchmark by 26%.
2022-11-11 00:34:03 -08:00
Steve Atherton
7aa1e23bc6
Remove UserTag in PriorityMultiLock since now more priority levels are cheaply supported.
2022-11-11 00:14:12 -08:00
Steve Atherton
d7b7af9e98
Change default read priority configuration to use a separate priority level per ReadType because the PriorityMultiLock now supports more priority ids with less overhead.
2022-11-11 00:02:47 -08:00
Steve Atherton
27954415ef
Remove TaskPriority completely from PriorityMultiLock and let callers decide if a delay() is needed.
2022-11-10 23:13:33 -08:00
Dan Adkins
f91e13ee91
Disable Rollback fault injection workload for SpecialKeySpaceCorrectness test. ( #8465 )
...
One of the special keyspace tests reads values from
`\xff\xff/worker_interfaces' in two different ways. The rollback workload
can trigger a cluster recovery between the two reads. The cluster controller
can update the worker interface for a machine in that time, causing the
test to fail.
It's not expected that the worker_interfaces keyspace will remain unchanged
through a cluster reconfiguration. The purpose of the test was to check
that 'get' and 'getRange' returned consistent results for this special keyspace.
Therefore, we've disabled Rollback failures in this test.
2022-11-10 21:26:37 -08:00
Chaoguang Lin
9b1c8ba932
Disable the quota,suspend commands; Add timeout for fdbcli commands ( #8785 )
2022-11-10 21:25:11 -08:00
neethuhaneesha
18c75e18a6
Adding counters for singlekey clear requests ( #8747 )
2022-11-10 20:04:20 -08:00
Steve Atherton
3c7129b7a8
Change runners from a Deque to an intrusive linked list of FastAllocated items so they can be removed as they complete.
2022-11-10 19:49:27 -08:00
Dan Adkins
a864216d97
Make Arena::dependOn(Arena) a no-op in case they're referring to the same ArenaBlock.
...
The intent is to have one ArenaBlock live at least at long as another. If they're
the same, that's accomplished without doing any additional bookkeeping.
2022-11-10 19:36:59 -08:00
Dan Adkins
2a8f5c7c3c
Assert that we don't try to have an ArenaBlock depend on itself.
...
It introduces a cycle in the `next` pointers in the ArenaBlockRef's,
which results in infinite recursion as we follow them in `getTotalSize`.
This doesn't fix the underlying problem, but gives a better failure
than a stack overflow.
2022-11-10 19:36:59 -08:00
Ankita Kejriwal
3b4e0056a7
Add a knob to enable/disable storage quota enforcement
2022-11-10 19:35:21 -08:00
Ankita Kejriwal
838dfb16c8
Update the simulation testing for storage quota to use/test tenant groups
2022-11-10 19:00:48 -08:00
Ankita Kejriwal
d50a4f6134
Update the CreateTenant workload to allow specifying a tenant group
2022-11-10 18:59:32 -08:00
Xiaoge Su
c489dbcb26
Disable forwarding log of RocksDB to FDB by default
2022-11-10 18:58:19 -08:00
Ankita Kejriwal
abc4b45af1
Set the storage quota on tenant groups instead of tenants
...
Update all the relevant data structures and monitors accordingly.
2022-11-10 18:56:43 -08:00
Jingyu Zhou
924ef0dac9
Merge pull request #8773 from jzhou77/fix
...
Fix a stack overflow bug
2022-11-10 15:23:50 -08:00
Xiaoxi Wang
1816e5caa8
setup the MGS after each test call
2022-11-10 15:22:01 -08:00
Jon Fu
55367daf28
Merge branch 'main' of github.com:apple/foundationdb into tenant-list-filter
2022-11-10 14:29:32 -08:00
Jon Fu
93fb151e6c
add fdbcli error handling, remove invalid state and change some offset logic
2022-11-10 14:29:01 -08:00
Markus Pilman
581cdad435
Fix formatting
2022-11-10 15:09:36 -07:00
Markus Pilman
53a1177dd2
address review comments
2022-11-10 14:55:20 -07:00
Xiaoxi Wang
4691a35215
format code
2022-11-10 13:11:24 -08:00
Xiaoxi Wang
7c9334121a
mark MoveKeysParams const&
2022-11-10 12:51:22 -08:00
Jingyu Zhou
80e0810bcc
Fix stack overflows
2022-11-10 12:10:15 -08:00
Jingyu Zhou
2361acbe22
Change SevWarn to SevInfo for injected errors
2022-11-10 12:10:00 -08:00
Jingyu Zhou
012465ec26
Merge pull request #8744 from yao-xiao-github/update-unit
...
Update histogram unit.
2022-11-10 08:53:56 -08:00
Christian Wende
502652d5f9
Mako: Add Timeout Support ( #8718 )
...
* Mako: Add Timeout Support
* Mako: Change log levels, do not count timeouts as errors, and add function that checks if error is expected for async run mode
* Mako: Fix formatting
2022-11-10 14:04:45 +01:00
Vaidas Gasiunas
0160570c2a
Failing client initialization on errors in external clients; Update package version to 7.3.0 ( #8719 )
...
* Network setup to fail on the initialization failures of external clients
* MVC: A more intuitive error when failing to load an API function
* Testing initializing FDB client with different configuration options
* Enable strict external client configuration check only for new API versions
* Upgrade FDB package version to 7.3.0; Update upgrade tests
2022-11-10 13:01:41 +01:00
Vaidas Gasiunas
37420c7c72
API Tests: Fix atomic operations workload for tests with restarts on timeouts ( #8749 )
...
* run_c_api_tests an option to disable log dump
* ApiTester: Utility for self-conflicting transactions
* ApiTester: A reusable code for making write transactions self-conflicting; Make atomic operation transactions self-conflicting
2022-11-10 10:23:28 +01:00
Ankita Kejriwal
716b8fa2aa
Merge pull request #8589 from sfc-gh-akejriwal/commitproxies
...
Reject transactions belonging to tenants that are currently over their storage quota
2022-11-09 22:17:39 -08:00
Ankita Kejriwal
76733ddde6
Merge branch 'main' of github.com:apple/foundationdb into commitproxies
2022-11-09 19:09:06 -08:00
Ankita Kejriwal
b43779fdd5
Merge pull request #8766 from sfc-gh-akejriwal/monitorusage
...
Handle future_version() in tenant-aware storage metrics function
2022-11-09 18:43:55 -08:00
Ankita Kejriwal
8b489be340
Handle future_version() in tenantaware storage metrics function
2022-11-09 17:50:04 -08:00
Ankita Kejriwal
105648b888
Merge branch 'main' of github.com:apple/foundationdb into commitproxies
2022-11-09 17:38:30 -08:00
Ankita Kejriwal
a9c61cc1ef
Address code review comments
2022-11-09 17:38:13 -08:00
Chaoguang Lin
9a643286cb
Make the hardcoded timeouts as parameters in test files; Also longRunningTest para to disable Simulation timeout restriction ( #8765 )
2022-11-09 16:57:51 -08:00
Xiaoxi Wang
93daa9ebb7
Merge branch 'main' of https://github.com/apple/foundationdb into fix/main/restoreStats
2022-11-09 16:30:41 -08:00
Xiaoxi Wang
189a74e7b3
only test when changeConfig success
2022-11-09 16:28:33 -08:00
Trevor Clinkenbeard
ea8767c0a1
Merge pull request #8737 from sfc-gh-tclinkenbeard/combine-gtt-knobs
...
Create `TAG_THROTTLING_PAGE_SIZE` knob
2022-11-09 14:34:14 -08:00
Jingyu Zhou
1f71e26c89
Merge pull request #8745 from jzhou77/fix
...
Fix transaction_too_old error when version vector is enabled
2022-11-09 14:08:30 -08:00
Xiaoxi Wang
1927193baf
IssueConfigurationChange check result
2022-11-09 13:53:11 -08:00
Nim Wijetunga
f1ef9d2671
Fix Bulk Load With Tenants Workload ( #8754 )
...
* fix bulk load
* Trigger Build
2022-11-09 13:18:34 -08:00