1a7203d27b
Merge pull request #9213 from sfc-gh-ajbeamon/fix-get-keyserver-locations-memory-error
...
Fix a memory issue in getKeyLocation functions
2023-01-23 12:47:28 -08:00
d79f270de6
Merge branch 'main' into fix-get-keyserver-locations-memory-error
2023-01-23 11:53:56 -08:00
5210f2995f
Merge pull request #9154 from jzhou77/fix
...
Fix a consistency scan infinite looping without progress
2023-01-23 11:02:13 -08:00
adb8d3ec7a
Fix a memory issue when getting key range locations that manifests in particular when getting range split points
2023-01-23 11:01:37 -08:00
95db42a28a
Merge pull request #9210 from sfc-gh-ajbeamon/avoid-using-invalid-tenant
...
Avoid using an invalid tenant when creating a transaction from a tenant ID
2023-01-23 10:55:39 -08:00
8b6a0f8f2b
Merge pull request #9193 from neethuhaneesha:SystemMetrics
...
Added metrics for read range operations.
2023-01-23 10:21:04 -08:00
c1333556a9
Avoid using an invalid tenant when creating a transaction from a tenant ID in SS
2023-01-23 09:51:15 -08:00
d578ace1f0
Merge pull request #9195 from halfprice/zhewu/log-ping-latency
...
Log PingLatency when there is no ping latency samples, but ping attempts
2023-01-23 09:34:29 -08:00
496b29aa3c
Update fdbserver/ConsistencyScan.actor.cpp
2023-01-23 09:34:04 -08:00
ab06bf3b20
Merge pull request #9157 from sfc-gh-tclinkenbeard/drop-udp-packets-more
...
Drop UDP packets more frequently in simulation
2023-01-23 09:29:59 -08:00
507aeb9f5c
Merge pull request #9158 from sfc-gh-tclinkenbeard/mark-code-probe-nosim
...
Mark code probe as non-simulation only
2023-01-23 09:29:05 -08:00
900ed4f575
Merge pull request #9189 from sfc-gh-cwende/mako-cwende-add-cpu-usage-stats
...
Mako: Add CPU Usage statistics
2023-01-23 09:27:45 -08:00
a68db40023
Merge pull request #9190 from sfc-gh-tclinkenbeard/improve-gtt-tracing
...
Improve GlobalTagThrottler tracing
2023-01-23 09:27:05 -08:00
70dcff7903
Merge pull request #9194 from sfc-gh-dadkins/sfc-gh-dadkins/commit-debug-typos
...
Fix some typos in the CommitDebug tags.
2023-01-23 09:26:08 -08:00
1876addaae
Merge pull request #9203 from sfc-gh-jshim/fix-actor-fuzz-timeout
...
Remove database involvement from ActorFuzz test
2023-01-23 09:24:12 -08:00
5a973e7d0f
Merge pull request #9175 from sfc-gh-cwende/mako-cwende-improve-argument-validation
...
mako: improve argument validation
2023-01-23 17:35:19 +01:00
0be35b547d
Merge pull request #9191 from sfc-gh-ajbeamon/remove-name-from-tenantinfo
...
Remove tenant name from the TenantInfo object
2023-01-23 07:51:52 -08:00
0e4224851c
mako: improve arg validation comments (worker ~> workflow)
2023-01-23 15:42:32 +01:00
a9ef2d1c99
mako: do not include unnecessary headers
2023-01-23 15:26:13 +01:00
8fb67d28ce
mako: Improve location of CPU utilization measurements and improve how multiple measurements are accumulated
2023-01-23 15:13:48 +01:00
bced2e124c
Added metrics for read range operations.
2023-01-22 19:22:07 -08:00
a04d093224
Improve GlobalTagThrottler tracing
2023-01-22 17:26:42 -08:00
a6157a968b
Remove database involvement from ActorFuzz test
2023-01-22 00:36:13 +01:00
bb62ff94fa
Log PingLatency when there is no ping latency samples, but ping attempts
2023-01-20 18:35:24 -08:00
e34c97fe00
Fix some typos in the CommitDebug tags.
...
s/ApplyMetada/ApplyMetadata/ is not a big deal, but might as well spell it right.
The two identical ApplyMetaDaEffect entries were a little trickier to pick apart
in the logs, when otherwise grouping CommitDebug entries by ID.
2023-01-20 17:35:45 -08:00
b10d1f227b
Remove tenant name from the TenantInfo object
2023-01-20 14:04:43 -08:00
d47a2ab60f
Merge pull request #9128 from sfc-gh-ajbeamon/transactions-use-tenant-object
...
Transactions take a tenant object rather than a tenant name
2023-01-20 12:06:36 -08:00
3a514d3451
Add design for avoiding storage servers for idempotency ids ( #9113 )
...
* Add design for avoiding storage servers for idempotency ids
* Update design/idempotency_ids.md
2023-01-20 11:26:54 -08:00
4b10080132
Make sure we are properly setting the tenant name during tenant creation; simplify deletion process in bulk load with tenants
2023-01-20 10:28:49 -08:00
ec6716ff2e
Restore kv ( #9030 )
...
* Allow multiple keyranges in CheckpointRequest.
Include DataMove ID in CheckpointMetaData.
* Use UID dataMoveId instead of Optional<UID>.
* Implemented ShardedRocks::checkpoint().
* Implementing createCheckpoint().
* Attempted to change getCheckpointMetaData*() for a single keyrange.
* Added getCheckpointMetaDataForRange.
* Minor fixes for NativeAPI.actor.cpp.
* Replace UID CheckpointMetaData::ssId with std::vector<UID>
CheckpointMetaData::src;
* Implemented getCheckpointMetaData() and completed checkpoint creation
and fetch in test.
* Refactoring CheckpointRequest and CheckpointMetaData
rename `dataMoveId` as `actionId` and make it Optional.
* Fixed ctor of CheckpointMetaData.
* Implemented ShardedRocksDB::restore().
* Tested checkpoint restore, and added range check for restore, so that
the target ranges can be a subset of the checkpoint ranges.
* Added test to partially restore a checkpoint.
* Refactor: added checkpointRestore().
* Sort ranges for comparison.
* Cleanups.
* Check restore ranges are empty; Add ranges in main thread.
* Resolved comments.
* Fixed GetCheckpointMetaData range check issue.
* Refactor CheckpointReader for CF checkpoint.
* Added CheckpointAsKeyValues as a parameter for newCheckpointReader.
* PhysicalShard::restoreKvs().
* Added `ranges` in fetchCheckpoint.
* Added RocksDBCheckpointKeyValues::ranges.
* Added ICheckpointIterator and implemented for RocksDBCheckpointReader.
* Refactored OpenAction for CheckpointReader, handled failure cases.
* Use RocksDBCheckpointIterator::end() in readRange.
* Set CheckpointReader timout and other Rocks read options.
* Implementing fetchCheckpointRange().
* Added more CheckpointReader tests.
* Cleanup.
* More cleanup.
* Added fetchCheckpointRanges test.
* Implemented restore of kv-based checkpoint.
* Improved CheckpointRestore test for kv, non-kv, as well as partial
restore.
* Added test of merge.
* Fixed merge test.
* Cleanup.
* Resolved comments.
Co-authored-by: He Liu <heliu@apple.com>
2023-01-20 09:58:34 -08:00
258198ca20
Merge branch 'main' into transactions-use-tenant-object
...
# Conflicts:
# fdbclient/include/fdbclient/DatabaseContext.h
# fdbserver/workloads/BulkLoadWithTenants.actor.cpp
2023-01-20 09:06:39 -08:00
827c3b63ce
removing extra unecessary conflict checking in BM lock check ( #9171 )
2023-01-20 10:49:30 -06:00
88838227a3
Merge pull request #9187 from jzhou77/release-notes
...
Add 7.1.26, 7.1.27 release notes
2023-01-20 08:41:18 -08:00
39528b62ea
mako: Rename WorkerStatistics ~> WorkflowStatistsics
2023-01-20 16:36:21 +01:00
63d6902001
Better feed version semantics documentation, and a bug fix ( #9183 )
2023-01-20 08:17:51 -06:00
e2913b5b3d
mako: add comments
2023-01-20 12:27:03 +01:00
7d1e8e10f0
mako: add cpu usage statistics, including some refactoring of statistics accumulation
2023-01-20 11:14:36 +01:00
21befd59ef
Merge pull request #9184 from sfc-gh-dadkins/sfc-gh-dadkins/bug/backup-lock-bytes
...
Increase buggified lock bytes for backup workers to at least 256 MB.
2023-01-19 20:06:50 -08:00
19f027d7c3
Add 7.1.26, 7.1.27 release notes
2023-01-19 20:03:38 -08:00
36e8e5a3bb
Merge pull request #9176 from sfc-gh-huliu/restoreversion
...
Restore to a previous version
2023-01-19 17:37:23 -08:00
5dcece90e1
Increase buggified lock bytes for backup workers to at least 256 MB.
...
We are still encountered simulation failures where the backup worker
is waiting on the lock and an assertion fails.
2023-01-19 17:36:06 -08:00
c85b984c3a
blobrestore to previous point of time
2023-01-19 14:45:01 -08:00
82c92abca2
Change Noisy Sev30s to Sev20s ( #9180 )
...
change noisy sev30 traces to sev20
2023-01-19 14:06:34 -08:00
d7e3b1b301
Replace the lambda function by an inlined function
2023-01-19 14:00:21 -08:00
0f695e8e6c
Update flow/include/flow/serialize.h
...
Co-authored-by: Simon Giesecke <simon.giesecke@snowflake.com>
2023-01-19 14:00:21 -08:00
94a9424ec7
fixup! Fix test failures
2023-01-19 14:00:21 -08:00
0b79843213
fixup! Fix the initialization
2023-01-19 14:00:21 -08:00
672f3fc079
fixup! Reformat source
2023-01-19 14:00:21 -08:00
5005ebb1fe
Add documents for ObjectWriter's change on std::function
2023-01-19 14:00:21 -08:00
5f3e38a7e8
Remove SaveContext
...
Wall time 1012.5, clang time 13998.9
2023-01-19 14:00:21 -08:00
A.J. Beamon