ec615181ce
Mark several more methods const
2022-11-15 14:57:32 -08:00
c9968f5c0c
Mark several methods of ILogSystem, IPeekCursor and LogPushData const
2022-11-15 14:57:32 -08:00
ba04aea3e2
Mark PromiseStream::getFuture non-const
2022-11-15 14:57:06 -08:00
cecb41694f
Storage change feed fetch performance improvements ( #8736 )
2022-11-15 16:22:45 -06:00
37f920a9d2
Merge pull request #8829 from sfc-gh-vgasiunas/vgasiunas-lock-ports-for-tests
...
Avoid port collisions in ctests
2022-11-15 13:49:51 -08:00
c03f60c618
Update rare code probe annotations
2022-11-15 13:21:25 -08:00
95cf6f9a0f
Avoid Sev40 for rare code probe miss
2022-11-15 13:21:25 -08:00
c9a601cf4b
Add MissedNonRareProbes field to Joshua results
2022-11-15 13:21:25 -08:00
009d8b7d06
Print rareness of code probes in Joshua results summary
2022-11-15 13:21:25 -08:00
7ed8838094
Update testing section of global-tag-throttling.md
2022-11-15 12:58:34 -08:00
696c451fa6
Reenable ThroughputQuota.toml test
2022-11-15 12:58:34 -08:00
13513252f8
Merge pull request #8832 from sfc-gh-satherton/pml-kill-bug
...
Bug fix: Use-after-destruct in PriorityMultiLock
2022-11-15 12:52:38 -08:00
bfbd75a91a
Merge pull request #8826 from sfc-gh-akejriwal/fdbcli
...
Add fdbcli commands to get, set, and clear storage quota
2022-11-15 11:58:58 -08:00
30e2743d3d
Merge branch 'main' of github.com:apple/foundationdb into fdbcli
2022-11-15 10:56:30 -08:00
1bc6e4cc6f
Merge pull request #8819 from sfc-gh-huliu/fix
...
BlobManifest - add limits for getRange and transactions for resiliency
2022-11-15 10:24:52 -08:00
d5f7cd862c
Explicitly clear waiting task queues in PriorityMultiLock::kill().
2022-11-15 10:18:07 -08:00
31b563d9a0
Use gettempdir to determine the system temp directory in local cluster
2022-11-15 19:03:03 +01:00
391776ab38
Bug fix: Use-after-destruct in PriorityMultiLock because kill() was clearing the priorities vector which can no longer be done because release handlers can still hold a reference to the instance and point into the vector.
2022-11-15 09:53:37 -08:00
c09092921b
Revert debugging info and apply clang-format
2022-11-15 09:41:21 -08:00
18b07368ed
Add more detailed reasons for physical shard creation
2022-11-15 09:41:21 -08:00
6086853b46
Use file locking to avoid port collisions in ctests using local cluster
2022-11-15 16:35:08 +01:00
00c270fc3f
BlobManifest - add limits for getRange and transactions for resilency with large manifest
2022-11-14 20:09:44 -08:00
3deb9a413b
Add fdbcli commands to get, set, and clear storage quota
2022-11-14 18:26:54 -08:00
73d3e0f42f
Merge pull request #8775 from sfc-gh-huliu/bench
...
Add micro-benchmark for blob delta serialization
2022-11-14 11:37:39 -08:00
2b133e5bd1
Merge pull request #8797 from sfc-gh-satherton/pml-delay
...
Another ProrityMultiLock refactor and re-add StorageServer priority read locking without perf regression
2022-11-14 11:30:01 -08:00
6a86369097
apitester: add better support for blob api commands + tenant abstraction ( #8700 )
...
* blob/apitester: rename tenantDebugString() -> debugTenantStr()
* blob/apitester: fix int64_t initialization to -1
* blob/apitester: add missing override for randomOperation()
* blob/cpp: cpp blob tenant operations
* apitester: add tenant to execution context
* apitester: DatabaseOps abstraction
This creates a base abstract class for Database and Tenant operations to
share.
* blob/apitester: add setup phase to verifyRange() prior to operations
This let's us ensure blob storage is setup prior to running apitester
against the cluster.
* apitester: expand execOperation() to take a tenant
Now that db operations can be transparently applied to tenants or
databases through the IDatabaseOps interface, allow execOperation() to
take a tenant accordingly.
* blob/testerapi: blobbify in TesterApiWorkload setup
Before we were blobbifying wholesale through TestRunner. This makes the
change to blobbifying and verifying in setup, so the workload can
properly test database and tenant scope functions.
2022-11-14 10:49:51 +01:00
7d5d94f09b
Merge pull request #8804 from sfc-gh-akejriwal/monitorusage
...
Add a command to clear storage quota
2022-11-13 06:38:15 -08:00
a1a2839cb3
Revert "Extend Transaction Window during Restore in Simulation" ( #8806 )
...
* fix resolver bug
* trigger build
2022-11-12 15:24:30 -08:00
8a99f9ea05
Merge pull request #8739 from sfc-gh-tclinkenbeard/fix-tag-throttler-release-transactions
...
Avoid indefinitely growing `GrvProxyTagThrottler::TagQueue` budget
2022-11-12 15:01:36 -08:00
30e0fa6433
Merge remote-tracking branch 'origin/main' into fix-tag-throttler-release-transactions
2022-11-12 09:09:56 -08:00
d61b88e6b3
Bug fix, Redwood's ioLock was not a Reference<>. Renamed several knobs, functions, and Redwood metrics for clarity.
2022-11-11 20:07:48 -08:00
8bc9a2bffd
Add a command to clear storage quota
2022-11-11 17:59:54 -08:00
f25577f4c2
Apply clang-format
2022-11-11 17:21:32 -08:00
b90aecad2f
Update shard move flag name
2022-11-11 17:21:32 -08:00
30af886389
Clean up DD remote team selection in physical shard move
2022-11-11 17:21:32 -08:00
b7629ce56e
store and reset original Knob value in GetMappedRange test ( #8800 )
2022-11-11 15:20:26 -08:00
7e78795284
add bytelimit for prefetch ( #8768 )
...
* add bytelimit for prefetch
A fraction of byteLimit will be used as the limit to fetch index.
For the indexes fetched, fetch records for them in batch.
byteLimit always count the index size, it also count record if exist,
it at least return 1 index-record entry and always include the last entry
despite that adding the last entry despite it might exceed limit.
There is a Knob STRICTLY_ENFORCE_BYTE_LIMIT, when it is set, records
will be discarded once the byteLimit is hit, despite they are fetched.
Otherwise, return the whole batch.
2022-11-11 13:36:06 -08:00
314c0b8c9b
Merge pull request #8787 from sfc-gh-akejriwal/monitorusage
...
Add a knob to enable/disable storage quota enforcement
2022-11-11 13:25:42 -08:00
cfd8396c8c
Merge pull request #8786 from sfc-gh-akejriwal/tenantgroup
...
Update the storage quota mechanisms to set quota on tenant groups instead of tenants
2022-11-11 13:12:28 -08:00
2efb828901
This is a combination of 2 commits.
...
msgpack: Refactor msgpack encoding in tracing to be reusable across different parts of fdb
2022-11-11 12:08:20 -08:00
e5e4457c6e
Merge commit '8ad98dc9db2a1f9c3c1b44b22e0532bfa8c89ee5' into pml-delay
...
# Conflicts:
# fdbserver/storageserver.actor.cpp
2022-11-11 11:49:31 -08:00
8ad98dc9db
Merge pull request #8696 from sfc-gh-dadkins/sfc-gh-dadkins/arena-self-ref
...
Assert that we don't try to have an ArenaBlock depend on itself.
2022-11-11 09:47:39 -08:00
6c729e7f25
Make the timing consitent in simulation
2022-11-11 09:44:00 -08:00
036b6ac4df
Merge pull request #8699 from sfc-gh-huliu/cli2
...
Add fdbcli blobrestore to start the full restore
2022-11-11 09:23:31 -08:00
0f8e5af5cf
Add micro-benchmark for blob delta serialization
2022-11-11 09:22:11 -08:00
5834517570
Add fdbcli blobrestore to start the full restore
2022-11-11 08:32:23 -08:00
b5182dc43f
Define client config tests as python unit tests ( #8791 )
2022-11-11 15:59:18 +01:00
3b4a467a92
Remove runners list from PriorityMultiLock and rely on reference counting in the release handler instead of canceling the release handlers. This improves the microbenchmark by 26%.
2022-11-11 00:34:03 -08:00
7aa1e23bc6
Remove UserTag in PriorityMultiLock since now more priority levels are cheaply supported.
2022-11-11 00:14:12 -08:00
d7b7af9e98
Change default read priority configuration to use a separate priority level per ReadType because the PriorityMultiLock now supports more priority ids with less overhead.
2022-11-11 00:02:47 -08:00
sfc-gh-tclinkenbeard