Commit Graph

24036 Commits

Author SHA1 Message Date
Steve Atherton e5e4457c6e Merge commit '8ad98dc9db2a1f9c3c1b44b22e0532bfa8c89ee5' into pml-delay
# Conflicts:
#	fdbserver/storageserver.actor.cpp
2022-11-11 11:49:31 -08:00
Jingyu Zhou 8ad98dc9db
Merge pull request #8696 from sfc-gh-dadkins/sfc-gh-dadkins/arena-self-ref
Assert that we don't try to have an ArenaBlock depend on itself.
2022-11-11 09:47:39 -08:00
Kevin Hoxha 6c729e7f25 Make the timing consitent in simulation 2022-11-11 09:44:00 -08:00
Hui Liu 036b6ac4df
Merge pull request #8699 from sfc-gh-huliu/cli2
Add fdbcli blobrestore to start the full restore
2022-11-11 09:23:31 -08:00
Hui Liu 0f8e5af5cf Add micro-benchmark for blob delta serialization 2022-11-11 09:22:11 -08:00
Hui Liu 5834517570 Add fdbcli blobrestore to start the full restore 2022-11-11 08:32:23 -08:00
Xiaoxi Wang b79268326a Merge branch 'main' of https://github.com/apple/foundationdb into feature/main/dataApi 2022-11-11 08:29:22 -08:00
Vaidas Gasiunas b5182dc43f
Define client config tests as python unit tests (#8791) 2022-11-11 15:59:18 +01:00
Steve Atherton 3b4a467a92 Remove runners list from PriorityMultiLock and rely on reference counting in the release handler instead of canceling the release handlers. This improves the microbenchmark by 26%. 2022-11-11 00:34:03 -08:00
Steve Atherton 7aa1e23bc6 Remove UserTag in PriorityMultiLock since now more priority levels are cheaply supported. 2022-11-11 00:14:12 -08:00
Steve Atherton d7b7af9e98 Change default read priority configuration to use a separate priority level per ReadType because the PriorityMultiLock now supports more priority ids with less overhead. 2022-11-11 00:02:47 -08:00
Steve Atherton 27954415ef Remove TaskPriority completely from PriorityMultiLock and let callers decide if a delay() is needed. 2022-11-10 23:13:33 -08:00
Dan Adkins f91e13ee91
Disable Rollback fault injection workload for SpecialKeySpaceCorrectness test. (#8465)
One of the special keyspace tests reads values from
`\xff\xff/worker_interfaces' in two different ways. The rollback workload
can trigger a cluster recovery between the two reads. The cluster controller
can update the worker interface for a machine in that time, causing the
test to fail.

It's not expected that the worker_interfaces keyspace will remain unchanged
through a cluster reconfiguration. The purpose of the test was to check
that 'get' and 'getRange' returned consistent results for this special keyspace.

Therefore, we've disabled Rollback failures in this test.
2022-11-10 21:26:37 -08:00
Chaoguang Lin 9b1c8ba932
Disable the quota,suspend commands; Add timeout for fdbcli commands (#8785) 2022-11-10 21:25:11 -08:00
neethuhaneesha 18c75e18a6
Adding counters for singlekey clear requests (#8747) 2022-11-10 20:04:20 -08:00
Steve Atherton 3c7129b7a8 Change runners from a Deque to an intrusive linked list of FastAllocated items so they can be removed as they complete. 2022-11-10 19:49:27 -08:00
Dan Adkins a864216d97 Make Arena::dependOn(Arena) a no-op in case they're referring to the same ArenaBlock.
The intent is to have one ArenaBlock live at least at long as another. If they're
the same, that's accomplished without doing any additional bookkeeping.
2022-11-10 19:36:59 -08:00
Dan Adkins 2a8f5c7c3c Assert that we don't try to have an ArenaBlock depend on itself.
It introduces a cycle in the `next` pointers in the ArenaBlockRef's,
which results in infinite recursion as we follow them in `getTotalSize`.

This doesn't fix the underlying problem, but gives a better failure
than a stack overflow.
2022-11-10 19:36:59 -08:00
Ankita Kejriwal 3b4e0056a7 Add a knob to enable/disable storage quota enforcement 2022-11-10 19:35:21 -08:00
Ankita Kejriwal 838dfb16c8 Update the simulation testing for storage quota to use/test tenant groups 2022-11-10 19:00:48 -08:00
Ankita Kejriwal d50a4f6134 Update the CreateTenant workload to allow specifying a tenant group 2022-11-10 18:59:32 -08:00
Xiaoge Su c489dbcb26 Disable forwarding log of RocksDB to FDB by default 2022-11-10 18:58:19 -08:00
Ankita Kejriwal abc4b45af1 Set the storage quota on tenant groups instead of tenants
Update all the relevant data structures and monitors accordingly.
2022-11-10 18:56:43 -08:00
Jingyu Zhou 924ef0dac9
Merge pull request #8773 from jzhou77/fix
Fix a stack overflow bug
2022-11-10 15:23:50 -08:00
Xiaoxi Wang 1816e5caa8 setup the MGS after each test call 2022-11-10 15:22:01 -08:00
Jon Fu 55367daf28 Merge branch 'main' of github.com:apple/foundationdb into tenant-list-filter 2022-11-10 14:29:32 -08:00
Jon Fu 93fb151e6c add fdbcli error handling, remove invalid state and change some offset logic 2022-11-10 14:29:01 -08:00
Markus Pilman 581cdad435 Fix formatting 2022-11-10 15:09:36 -07:00
Markus Pilman 53a1177dd2 address review comments 2022-11-10 14:55:20 -07:00
Xiaoxi Wang 4691a35215 format code 2022-11-10 13:11:24 -08:00
Xiaoxi Wang 7c9334121a mark MoveKeysParams const& 2022-11-10 12:51:22 -08:00
Jingyu Zhou 80e0810bcc Fix stack overflows 2022-11-10 12:10:15 -08:00
Jingyu Zhou 2361acbe22 Change SevWarn to SevInfo for injected errors 2022-11-10 12:10:00 -08:00
Jingyu Zhou 012465ec26
Merge pull request #8744 from yao-xiao-github/update-unit
Update histogram unit.
2022-11-10 08:53:56 -08:00
Christian Wende 502652d5f9
Mako: Add Timeout Support (#8718)
* Mako: Add Timeout Support

* Mako: Change log levels, do not count timeouts as errors, and add function that checks if error is expected for async run mode

* Mako: Fix formatting
2022-11-10 14:04:45 +01:00
Vaidas Gasiunas 0160570c2a
Failing client initialization on errors in external clients; Update package version to 7.3.0 (#8719)
* Network setup to fail on the initialization failures of external clients

* MVC: A more intuitive error when failing to load an API function

* Testing initializing FDB client with different configuration options

* Enable strict external client configuration check only for new API versions

* Upgrade FDB package version to 7.3.0; Update upgrade tests
2022-11-10 13:01:41 +01:00
Vaidas Gasiunas 37420c7c72
API Tests: Fix atomic operations workload for tests with restarts on timeouts (#8749)
* run_c_api_tests an option to disable log dump

* ApiTester: Utility for self-conflicting transactions

* ApiTester: A reusable code for making write transactions self-conflicting; Make atomic operation transactions self-conflicting
2022-11-10 10:23:28 +01:00
Ankita Kejriwal 716b8fa2aa
Merge pull request #8589 from sfc-gh-akejriwal/commitproxies
Reject transactions belonging to tenants that are currently over their storage quota
2022-11-09 22:17:39 -08:00
Ankita Kejriwal 76733ddde6 Merge branch 'main' of github.com:apple/foundationdb into commitproxies 2022-11-09 19:09:06 -08:00
Ankita Kejriwal b43779fdd5
Merge pull request #8766 from sfc-gh-akejriwal/monitorusage
Handle future_version() in tenant-aware storage metrics function
2022-11-09 18:43:55 -08:00
Ankita Kejriwal 8b489be340 Handle future_version() in tenantaware storage metrics function 2022-11-09 17:50:04 -08:00
Ankita Kejriwal 105648b888 Merge branch 'main' of github.com:apple/foundationdb into commitproxies 2022-11-09 17:38:30 -08:00
Ankita Kejriwal a9c61cc1ef Address code review comments 2022-11-09 17:38:13 -08:00
Chaoguang Lin 9a643286cb
Make the hardcoded timeouts as parameters in test files; Also longRunningTest para to disable Simulation timeout restriction (#8765) 2022-11-09 16:57:51 -08:00
Xiaoxi Wang 93daa9ebb7 Merge branch 'main' of https://github.com/apple/foundationdb into fix/main/restoreStats 2022-11-09 16:30:41 -08:00
Xiaoxi Wang 189a74e7b3 only test when changeConfig success 2022-11-09 16:28:33 -08:00
Trevor Clinkenbeard ea8767c0a1
Merge pull request #8737 from sfc-gh-tclinkenbeard/combine-gtt-knobs
Create `TAG_THROTTLING_PAGE_SIZE` knob
2022-11-09 14:34:14 -08:00
Jingyu Zhou 1f71e26c89
Merge pull request #8745 from jzhou77/fix
Fix transaction_too_old error when version vector is enabled
2022-11-09 14:08:30 -08:00
Xiaoxi Wang 1927193baf IssueConfigurationChange check result 2022-11-09 13:53:11 -08:00
Nim Wijetunga f1ef9d2671
Fix Bulk Load With Tenants Workload (#8754)
* fix bulk load

* Trigger Build
2022-11-09 13:18:34 -08:00