Commit Graph

14811 Commits

Author SHA1 Message Date
Markus Pilman 8555723b98 removing testing case 2021-03-26 15:46:54 -06:00
Markus Pilman 43bed1d9dd Fix bug where betterMasterExist and recruitment disagree 2021-03-26 15:06:59 -06:00
Zhe Wu c3aff4340f Address merge conflicts 2021-03-26 11:36:02 -07:00
Andrew Noyes 8d52abf048
Update fdbclient/vexillographer/fdb.options 2021-03-26 11:33:28 -07:00
Andrew Noyes c3ba4659ff Document that ryw disable can only be set at beginning of transaction 2021-03-26 18:06:21 +00:00
Dan Lambright 244c537bc6
Merge pull request #4578 from dlambrig/knob
add SYSTEM_MONITOR_FREQUENCY knob.
2021-03-26 13:52:29 -04:00
Dan Lambright bd68591ea2 add SYSTEM_MONITOR_FREQUENCY knob. 2021-03-26 09:17:36 -04:00
Aaron Molitor a8601024dd
Update build badge in README.md 2021-03-25 23:03:00 -05:00
Aaron Molitor 59db01a7be update README.md 2021-03-25 22:41:46 -05:00
Trevor Clinkenbeard 5cbb6421d2
Merge pull request #4573 from sfc-gh-jfu/jfu-test-parser
Updated test parser to read new option correctly
2021-03-25 20:25:51 -07:00
Jon Fu 69d88dcf96 adjust placement of option in test workload 2021-03-25 15:25:50 -04:00
Jon Fu 1541f4234a Updated test parser with new option and also added option to test file with default value 2021-03-25 14:40:06 -04:00
Chaoguang Lin da5930171e Fix boost build on OS X 2021-03-25 11:30:22 -07:00
Jingyu Zhou a9d8806828 Use the restored range in the actual restore 2021-03-25 10:07:25 -07:00
Jingyu Zhou 3fefebb23a
Merge pull request #4554 from sfc-gh-satherton/restore-log-filtering2
Mutation log filtering during restore
2021-03-24 22:54:09 -07:00
Aaron Molitor 73d0c2ac15
Docker updates (#4551)
* add alias to start joshua with default correctness package
add lxml to pip packages being installed
add byobu, fish, ripgrep, the_silver_searcher and zsh to devel images (fish and ripgrep not avaialbe in c6)
sort yum packages being installed
add aws cli and kubectl for starting correctness/joshua
fix cmk output location, remove cluster-file in j
add docker to centos7 build image
use printf to create/update files in devel image

* add ycsb incomplete Dockerfile, remove buildspec.yml
2021-03-24 19:59:03 -05:00
Nim Wijetunga bdccf8bc80 fix formatting issues 2021-03-25 00:11:11 +00:00
Nim Wijetunga a84592df7e add test for network busyness 2021-03-24 23:59:40 +00:00
Nim Wijetunga 21f1e1d5de add comment 2021-03-24 23:38:42 +00:00
Nim Wijetunga b5412b355e Add Java API for network busyness 2021-03-24 23:34:34 +00:00
Steve Atherton 720c0b3a4f
Added const.
Co-authored-by: Trevor Clinkenbeard <trevor.clinkenbeard@snowflake.com>
2021-03-24 14:36:55 -07:00
Evan Tschannen a2d4c0cf89
Merge pull request #4542 from sfc-gh-mpilman/features/better-sim-output
Features/better sim output
2021-03-24 14:32:51 -07:00
A.J. Beamon f1166f2bf6
Merge pull request #4545 from sfc-gh-anoyes/anoyes/fix-truncate-simulation
In simulation, fix treatment of extending a file with truncate as a "pending modification"
2021-03-24 12:35:32 -07:00
Jon Fu b246e673bc Added comment to seedShardServers (taken from existing desc in .h file) 2021-03-24 15:34:19 -04:00
Nim Wijetunga cc083ea1c7
Merge pull request #15 from apple/master
Merge Master
2021-03-24 15:19:00 -04:00
Andrew Noyes eb80321ea3 Attempt to fix windows build 2021-03-24 18:48:10 +00:00
Trevor Clinkenbeard 0db28f6ea0
Merge pull request #4535 from jzhou77/fix-dd
Fix DD Assertion failed in canBeSet
2021-03-24 10:50:04 -07:00
Andrew Noyes c186d363c6 Add unit test 2021-03-24 17:32:07 +00:00
Andrew Noyes d0e64d176b
Merge pull request #4544 from sfc-gh-jfu/jfu-fix-valgrind-errors
Initialize extraDB in simulationConfig according to TestConfig parameter
2021-03-24 10:09:05 -07:00
A.J. Beamon ed811008ca
Merge pull request #4504 from sfc-gh-nwijetunga/network_busyness
Monitor Network Thread Busyness
2021-03-24 09:44:09 -07:00
Chaoguang Lin cb39d1a6ed Refactor consistencycheck command using special keys 2021-03-24 09:33:20 -07:00
Steve Atherton a6136ffc62 Applied clang-format to recent changes. 2021-03-24 06:51:08 -07:00
Steve Atherton 17a19021fb Added mutation batch filtering during restore, to the extent possible where each restore mutation log task only sees one block of data (usually 1MB) which can contain incomplete and therefore unfilterable mutation sets. 2021-03-24 06:38:50 -07:00
Evan Tschannen e8ed192647
Merge pull request #4548 from sfc-gh-etschannen/fix-master-config-change
Do not call expectedLogSets() with the wrong configuration
2021-03-23 18:31:08 -07:00
Nim Wijetunga ea16d2cccd address pr comments 2021-03-23 23:09:08 +00:00
Nim Wijetunga e174ea0dfd fix comment typo 2021-03-23 22:04:32 +00:00
Markus Pilman 816e583277
Merge pull request #4547 from sfc-gh-etschannen/fix-bme-satellite-fallback
Fixed an assertion failure in better master exists
2021-03-23 16:03:35 -06:00
Markus Pilman dbf34c3e1d
Merge pull request #4550 from sfc-gh-etschannen/fix-open-atomic
Fixed a simulation only durability error
2021-03-23 16:03:21 -06:00
Markus Pilman c3fdbe355b
Merge pull request #4549 from sfc-gh-etschannen/fix-rss-safety-check
Fixed simulation timeouts of the RemoveServerSafely workload
2021-03-23 16:02:59 -06:00
Chaoguang Lin 35f9fe08a2 Remove unnecessary header in IClientApi.h 2021-03-23 14:44:14 -07:00
Jon Fu 9fd3c559c2 Added some missing comments for structs 2021-03-23 17:24:00 -04:00
Andrew Noyes 170c197c4c Truncate marks everything after size modified 2021-03-23 21:07:12 +00:00
Andrew Noyes e83de2b799 Fix bug: minSizeAfterPendingModifications needs to be maxed 2021-03-23 21:00:21 +00:00
Nim Wijetunga de1c354b12 address pr comments 2021-03-23 20:56:37 +00:00
Evan Tschannen a893309112 Opening a file with OPEN_ATOMIC_WRITE_AND_CREATE should create a new file handle, so that if a file with the same name is still in use, operations against it will not happen to the new file. This can happen when the disk queue replaces a file. 2021-03-23 13:47:46 -07:00
Evan Tschannen 272e649a3c The checkSafeExclusions function only ensures the exclusion is safe from the storage server prospective, but does not confirm it is safe in terms of the tlog replication 2021-03-23 13:31:16 -07:00
Evan Tschannen 0ea513b503 It is not safe to call expectedLogSets() with a potentially newer configuration than the one from the recovery 2021-03-23 13:21:48 -07:00
Evan Tschannen 10b6b5d710 If the current configuration does not have a satellite fallback policy we do not care if the old configuration is in fallback mode 2021-03-23 13:02:31 -07:00
Markus Pilman 35700f919f
Merge pull request #4495 from sfc-gh-etschannen/feature-fix-exlude-failed
Execute exclude failed commands after shutting down the rest of data distribution
2021-03-23 13:59:00 -06:00
Andrew Noyes 0daf6cf632 Consider extending a file with truncate as a "pending modification"
Before this, truncating and reading concurrently could cause to read
uninitialized memory. So could truncating then reading, since the effect
of the truncate in the actual file was allowed to be delayed. Now reads
will wait for a truncate that extends the file to complete if they
intersect the newly-zeroed region.
2021-03-23 19:44:36 +00:00