Commit Graph

5405 Commits

Author SHA1 Message Date
sramamoorthy 89b7a052f5 Bug fixes for snapping coordinators 2019-05-28 22:07:46 -07:00
sramamoorthy 539e65efad Skip parsing mutations if it is tagged for TxsTag
In Tlog, if a mutation is targetted for TxsTag then skip from
parsing them.
2019-05-28 22:07:46 -07:00
sramamoorthy 8370871e4c stale RESTORE option related code removed 2019-05-28 22:07:46 -07:00
sramamoorthy 17ecba8313 trace cleanup and other indentation changes 2019-05-28 22:07:46 -07:00
sramamoorthy 898bed66c1 Allow only whitelisted binary path for exec op 2019-05-28 22:07:46 -07:00
sramamoorthy aa79480d69 changes to make fdbfork asynchronous 2019-05-28 22:07:46 -07:00
sramamoorthy c4d27ac9d2 bug fixes in SnapTest
Earlier the test was checking for the following condition:
durable version of storage > min version of tlog, but the
check has been modified to:
durable version of storage >= min version of tlog - 1.

Ensure that the pre-snap validate keys are exactly 1000 in
the case of commit retires.
2019-05-28 22:07:46 -07:00
sramamoorthy f129d996fe Remove dumpAfterTest=true in snap tests 2019-05-28 22:07:46 -07:00
sramamoorthy d282016f93 Exec op to tag only local storage nodes 2019-05-28 22:07:46 -07:00
sramamoorthy a60145b9a1 Restore the cluster in single region configuration 2019-05-28 22:07:46 -07:00
sramamoorthy f7ba0635ef Make Exec op the first op in the batch 2019-05-28 22:07:46 -07:00
sramamoorthy 382b246930 trace change and retain fitness file after restore 2019-05-28 22:07:46 -07:00
sramamoorthy 281c785f94 '--restoring' cmd line arg removed for fdbserver
'--restoring' command line option was introduced to indicate
simulated fdbserver to restore from snapshot and restart the cluster.
As part of this change that option is removed and restore
information is stored in the restartInfo.ini.
2019-05-28 22:07:46 -07:00
sramamoorthy 6431513ad0 Fail exec req until the cluster is fully_recovered 2019-05-28 22:07:46 -07:00
sramamoorthy 4016f16c76 Fix few compilation and bugs in rebase 2019-05-28 22:07:46 -07:00
sramamoorthy 3d5998e9dd tlog: when pops are disabled, store them & replay
In Tlogs, disable pop is done whlie taking snapshots. Earlier, tlogs
were ignoring the pops if it got pop requests when pops were
disabled. In this change, instead of ignoring the pop - it remembers
the list of pops in-memory and plays them once the popping is
enabled.
2019-05-28 22:07:46 -07:00
sramamoorthy 4bc4c615da exec op to all tlog, restore change in test &other
- exec operation to go to all the TLogs
- minor bug fix in tlog
- restore implementation for the simulator
- restore snap UID to be stored in restartInfo.ini
- test cases added
- indentation and trace file fixes
2019-05-28 22:07:46 -07:00
sramamoorthy 72dd067173 Trace message changes and fix few FIXMEs 2019-05-28 22:07:46 -07:00
sramamoorthy 69edefe68b Snapshot based backup and resotre implementation 2019-05-28 22:07:46 -07:00
chaoguang 5350c2777a change g_random to deterministicRandom() 2019-05-28 18:37:55 -07:00
chaoguang a7920ef311 Merge branch 'master' of https://github.com/apple/foundationdb into MakoWorkload 2019-05-28 18:21:02 -07:00
chaoguang ca034846b4 update comments, parameter names and descriptions 2019-05-28 17:29:45 -07:00
chaoguang 7329466182 update comments, parameter names and descriptions 2019-05-28 15:43:41 -07:00
Alex Miller a4f12a19a3
Merge pull request #1570 from ajbeamon/thread-safe-random-number-generation
Make random number generation thread safe
2019-05-28 15:06:14 -07:00
mmacintyre 0f46b6c926 Add sql_create_report call to generate sql file
After all testing iterations are complete, run sql_create_report to generate the sql
file and (for now) archive it with the job.

SNOW-78373
2019-05-28 10:22:24 -07:00
Alec Grieser 7fd5cc6b35
Merge pull request #1637 from ajbeamon/documentation-fix
Fix documentation header underline length
2019-05-24 12:54:13 -07:00
A.J. Beamon b7e2cb64c3 Fix underline length 2019-05-24 11:56:46 -07:00
A.J. Beamon ec80ff1e8d Remove unneeded redefinition of random functions. 2019-05-24 11:55:25 -07:00
A.J. Beamon fc204c846a Make IRandom reference counted. Simplify the logic around deterministicRandom() to require less state and branching. 2019-05-23 18:51:59 -07:00
A.J. Beamon 764ca2971c Merge branch 'master' into thread-safe-random-number-generation 2019-05-23 18:49:49 -07:00
A.J. Beamon 296adada93 Use c++11 thread_local instead of redefining it to platform specific variants. 2019-05-23 18:35:45 -07:00
Evan Tschannen 31939fd044
Merge pull request #1597 from atn34/cmake-flatbuffers-off
Hardcode flatbuffers to off for ctest
2019-05-23 11:13:54 -07:00
A.J. Beamon 20d83d61db Merge branch 'master' into thread-safe-random-number-generation 2019-05-23 11:07:08 -07:00
Evan Tschannen b451c2cd56
Merge pull request #1497 from alexmiller-apple/fastrecovery
Add an \xff keyrange that is backed by the txnStateStore.
2019-05-23 10:52:35 -07:00
A.J. Beamon 00ec629b5a
Merge pull request #1634 from ajbeamon/merge-release-6.1-into-master
Merge release 6.1 into master
2019-05-23 10:50:21 -07:00
A.J. Beamon f417e60264 Merge branch 'merge-release-6.1-into-master' into thread-safe-random-number-generation
# Conflicts:
#	fdbserver/QuietDatabase.actor.cpp
2019-05-23 09:52:00 -07:00
A.J. Beamon d29c7e4c9b Merge branch 'release-6.1' into merge-release-6.1-into-master
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
#	fdbserver/QuietDatabase.actor.cpp
#	versions.target
2019-05-23 09:28:45 -07:00
A.J. Beamon e5381e0612 Fix some new usages of g_random 2019-05-23 09:23:27 -07:00
A.J. Beamon 603721e125 Merge branch 'master' into thread-safe-random-number-generation
# Conflicts:
#	fdbclient/ManagementAPI.actor.cpp
#	fdbrpc/AsyncFileCached.actor.h
#	fdbrpc/genericactors.actor.cpp
#	fdbrpc/sim2.actor.cpp
#	fdbserver/DiskQueue.actor.cpp
#	fdbserver/workloads/BulkSetup.actor.h
#	flow/ActorCollection.actor.cpp
#	flow/Net2.actor.cpp
#	flow/Trace.cpp
#	flow/flow.cpp
2019-05-23 08:35:47 -07:00
Pieter Joost van de Sande 7debb23cf6 change common errors for easy comparison 2019-05-23 13:40:00 +02:00
Evan Tschannen 003cc6be18 fix: nothingPersistent could be incorrect when popped is equal to persistentDataVersion 2019-05-22 20:23:35 -10:00
chaoguang c527b1a6b1 renaming function, add comments, fix bugs. 2019-05-22 17:39:36 -07:00
Evan Tschannen 9cd77446d3
Merge pull request #1630 from ajbeamon/remove-invalid-sphinx-c-cross-references
Docs: remove invalid C domain cross references
2019-05-22 15:30:23 -07:00
Alec Grieser d3cb61e290
Merge pull request #1623 from ajbeamon/documentation-fixes
A bunch of documentation fixes
2019-05-22 14:54:41 -07:00
A.J. Beamon d695b6b09b Remove searches for files in sys.prefix 2019-05-22 14:36:16 -07:00
A.J. Beamon 681e432d6c The time-series documentation doesn't need to use the ruby module or be in the ruby domain. Change 'timen' to 'timeN' 2019-05-22 14:03:40 -07:00
A.J. Beamon ab96a44a1c There are no custom static files, so don't specify a static path. 2019-05-22 13:46:58 -07:00
A.J. Beamon cfb598b707 The C documentation used a bunch of cross-references to types, variables, and macros that we didn't define in our documentation. This didn't break the documentation, but it had the effect of making variables that did have links look the same as those that do not. I've switched these to use normal code formatting instead. 2019-05-22 13:37:31 -07:00
Evan Tschannen 4e12721227 fix: nothingPersistent could be incorrect when popped is equal to persistentDataVersion 2019-05-22 11:23:21 -07:00
Alec Grieser c5fd42eb22
Merge pull request #1619 from ajbeamon/update-go-required-version
Update required go version to 1.11. Update release notes.
2019-05-22 09:53:50 -07:00