Commit Graph

22610 Commits

Author SHA1 Message Date
Markus Pilman f471f3da04
Merge pull request #8227 from sfc-gh-mpilman/bugfixes/ubsan-ratecontrol
prevent int overflow
2022-09-19 17:28:00 -06:00
Markus Pilman 62ac01b481 All workloads to disable some failures 2022-09-19 16:42:55 -06:00
Chaoguang Lin 125137b987
Change the special key space correctness workload to hit code probe (#8214) 2022-09-19 15:01:21 -07:00
Markus Pilman 7581b64daa don't do the min-calculation twice 2022-09-19 15:57:46 -06:00
Markus Pilman 441ea31fca prevent int overflow 2022-09-19 15:16:53 -06:00
Josh Slocum 0f3f493c28
Merge pull request #8218 from sfc-gh-jslocum/aligned_purge
fixes for non-aligned blob range calls
2022-09-19 15:00:02 -05:00
A.J. Beamon 3a1fa5bd7c
Merge pull request #8223 from sfc-gh-ajbeamon/change-literal-string-ref
Convert literal string ref instances to use _sr suffix
2022-09-19 12:53:17 -07:00
1inker db1f858c64
ANSI C syntax mandates declare functions without parameters with void in parameters list. K&R syntax is obsolete. (#8222) 2022-09-19 12:09:05 -07:00
A.J. Beamon 4fd64630e8 Convert literal string ref instances to use _sr suffix 2022-09-19 11:35:58 -07:00
Markus Pilman bd8347d92e
Merge pull request #7769 from sfc-gh-mpilman/features/always-inject-faults
Separated normal workloads and failure injection
2022-09-19 11:48:36 -06:00
1inker cc1b0edd44
Patch for commit #24b2de8de8: set Boost_iostreams_FOUND variable before check it (#8203) 2022-09-19 09:30:27 -07:00
Markus Pilman 5fef9e2d8e
Merge pull request #8178 from sfc-gh-anoyes/anoyes/disable-kaio
Add an option to disable kernel-aio in test harness
2022-09-19 10:24:53 -06:00
Markus Pilman 028a5dcb77 by default, add a failure injection workload at most 3 times 2022-09-19 09:42:34 -06:00
Markus Pilman e1627e0a78 Merge remote-tracking branch 'origin/main' into features/always-inject-faults 2022-09-19 09:38:55 -06:00
Josh Slocum 88f88707f5 fixes for non-aligned blob range calls 2022-09-16 19:06:15 -05:00
Yi Wu e66942ada4
Update Redwood encryption interface (#8172)
Update Redwood encryption interface to make it better suit for per-tenant encryption, where we will need to do tenant page split.
2022-09-16 15:56:05 -07:00
Markus Pilman ef2d301305 Merge remote-tracking branch 'origin/main' into features/always-inject-faults 2022-09-16 16:41:16 -06:00
Andrew Noyes 2bdfc52f97
Fix heap use after free (#8189)
Previously, we had Ref types outliving the arena's that owned them,
specifically encryptDomains in the getResolution actor. Refactor to use
Standalone's, which both fixes the memory error and makes this easier to
reason about.

Also fix a potential ODR violation.
2022-09-16 13:46:05 -07:00
Markus Pilman 9441795c8e address review comments 2022-09-16 14:40:10 -06:00
Steve Atherton 4cbe8be459
Merge pull request #8201 from sfc-gh-satherton/kaio-latency-pctile
Changed AsyncFileKAIO Read/WriteSync latency metrics to LatencySample
2022-09-16 10:46:38 -07:00
Evan Tschannen f5161c362e
fix: persistentData->commit() was not protected by the persistentDataCommitLock (#8200)
* fix: persistentData->commit() was not protected by the persistentDataCommitLock, meaning it is possible for inconsistent data to be made durable on the tlog

* fixed a compilation error
2022-09-16 09:47:20 -07:00
Trevor Clinkenbeard 7b4598a53d
Merge pull request #8197 from sfc-gh-jslocum/bg_code_coverage_cleanup
cleaning tss and blob granule file code probes
2022-09-16 09:32:20 -07:00
sfc-gh-ngoyal 1bd97fe628
Recruit new singleton for consistency checker. (#5804)
* Recruit new singleton for consistency checker.

* Recruit the consistency checker only if enabled.

* Add a yield in monitorConsistencyChecker().

* Minor fixes.

* Consistency check workload enhancements.

* Minor fixes and clarifications.

* clang format

* Clang format.

* Minor fixes, cleanup, debug tracing.

* Misc.

* Move the consistency scan information from dbconfig to a key backed object.

* Move consistency scan config out of db cofig to a state object and feature rename.

* ConsistencyCheck workload refactor.

* devFormat

* Update fdbcli/ConsistencyScanCommand.actor.cpp

* Review Comments.

Co-authored-by: negoyal <neelam.goyal@gmail.com>
Co-authored-by: Ata E Husain Bohra <ata.husain@snowflake.com>
2022-09-16 09:03:06 -07:00
Josh Slocum 4ead9a697f cleaning tss and blob granule file code probes 2022-09-16 09:51:33 -05:00
Josh Slocum 17c855be7e
Merge pull request #8196 from sfc-gh-jslocum/cf_metrics_fix
not counting end of stream as an error for change feeds
2022-09-16 09:05:25 -05:00
Junhyun Shim f5fef5a417
Merge pull request #8174 from sfc-gh-jshim/authz-documentation
Add documentation for Authz
2022-09-16 10:17:02 +02:00
Steve Atherton 4817838207 Change now() to timer() but minimize the calls to only once per io_submit() and once per get_events() for more accurate timings which will only measure the time the IO spent in the kernel (including any necessary pre-op truncate). 2022-09-15 20:38:02 -07:00
Steve Atherton 0e0a10ab45 Merge commit '59b04d46cff720df5d267daa8dc8a60c25466f74' into kaio-latency-pctile 2022-09-15 20:27:02 -07:00
Steve Atherton 59b04d46cf
Merge pull request #8192 from sfc-gh-sgwydir/FDBCORE-2926
Linking atomic explicitly is not needed
2022-09-15 19:53:00 -07:00
Jingyu Zhou 1510124a33
Merge pull request #8191 from jzhou77/fix-tuple
Make a new memory arena for Tuple::clear
2022-09-15 17:35:05 -07:00
Josh Slocum 977c03ff78 not counting end of stream as an error for change feeds 2022-09-15 17:37:52 -05:00
Sam Gwydir d78b996ac0 fix logic; print message 2022-09-15 14:17:31 -07:00
Sam Gwydir f1d25aea64 Linking atomic explicitly is not needed 2022-09-15 13:53:40 -07:00
Steve Atherton 2bf90ca5ec Change KAIO latency metrics to use LatencySample for easier usability. Rename a SQLite-specific knob to indicate it is specific to SQLite. 2022-09-15 13:27:23 -07:00
Hao Fu e9a12b4a1a
Fix memory bug in index prefetch code path (#8187)
Same address is being reused for multiple queries incorrectly.
2022-09-15 16:18:37 -04:00
Junhyun Shim dcdb347ff1 Address review comments 2022-09-15 21:59:54 +02:00
Jingyu Zhou a4f9ef8aaa Make a new memory arena for Tuple::clear
To avoid potential problem of invalidating contents of previously returned from
pack() calls.
2022-09-15 12:49:11 -07:00
Hui Liu b19f1b5e3b
Merge pull request #8109 from sfc-gh-huliu/bmr
Add blob manifest for full restore
2022-09-15 11:05:41 -07:00
Markus Pilman 2d1b58d020
Update flow/Knobs.cpp
Co-authored-by: Trevor Clinkenbeard <trevor.clinkenbeard@snowflake.com>
2022-09-15 11:54:45 -06:00
Trevor Clinkenbeard 0ae5321b52
Merge pull request #8186 from sfc-gh-tclinkenbeard/make-gsimulator-ptr
Make `g_simulator` a pointer
2022-09-15 10:29:22 -07:00
Hui Liu 59be25848f bootstrap blob manager and blob worker from blob manifest 2022-09-15 09:50:12 -07:00
Trevor Clinkenbeard 6c211be57c
Merge pull request #8182 from sfc-gh-nwijetunga/nim/remove-code-probes
Remove FileBackupAgent Code Probes
2022-09-15 09:07:47 -07:00
sfc-gh-tclinkenbeard b9fbd8c130 Fix -Wlogical-op-parentheses warning 2022-09-15 09:00:33 -07:00
sfc-gh-tclinkenbeard 82adc1e856 Make g_simulator a pointer 2022-09-15 09:00:33 -07:00
Junhyun Shim f57c5f1f16 Further formatting and phrasing changes 2022-09-15 08:13:21 +02:00
Steve Atherton c7924c9fb3
Merge pull request #8173 from sfc-gh-satherton/read-stage-latencies
Add new latency samples for GetValue, GetRange, QueueWait, and VersionWait
2022-09-14 17:31:51 -07:00
Steve Atherton c254de5031 Rename read latency trace events to a different scheme. 2022-09-14 16:16:23 -07:00
Lukas Joswiak 54a12483e4 Add build date and time to build_flags
Also fixes the Boost lib version.
2022-09-14 15:11:51 -07:00
Lukas Joswiak cfbd04ae78 Add explicit check for a simulated network 2022-09-14 14:14:49 -07:00
Lukas Joswiak d6b25d6ce8 Initialize configuration database type in simulator 2022-09-14 14:14:49 -07:00