wbtiger
/
foundationdb
mirror of https://github.com/apple/foundationdb.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,233 Commits 34 Branches 304 Tags 265 MiB
Commit Graph

1504 Commits

Author SHA1 Message Date
Evan Tschannen 82d957e0bb
Merge pull request #1178 from vishesh/task/issue-963-IPv6 
IPv6 Support
 2019-03-05 17:14:16 -08:00
Vishesh Yadav a9562f61be fix: missing argument to printf in fdbserver 2019-03-05 14:03:09 -08:00
Steve Atherton 21f55e1878
Merge pull request #1190 from bnamasivayam/restore-multiple-ranges 
Add support for restoring multiple ranges.
 2019-03-05 10:15:55 -08:00
Evan Tschannen 69d7633d5b
Merge pull request #1217 from alexmiller-apple/tstlog-goodref 
Spill-By-Reference TLog Part 4: Actually Usable Reference Spilling
 2019-03-04 20:58:24 -08:00
Trevor Clinkenbeard 89cbb77b4e Merge branch 'master' of https://github.com/apple/foundationdb into lazily-fetch-health-metrics 2019-03-04 14:17:58 -08:00
Trevor Clinkenbeard 56ae46f89e Client lazily fetches health metrics from proxies 2019-03-04 14:16:39 -08:00
Vishesh Yadav e93cd0ff21 Add some checks and comments to IPv6 changes #963 2019-03-04 14:12:45 -08:00
Vishesh Yadav 592e224155 net: add/use formatIpPort to format IP:PORT pairs #963 2019-03-04 14:12:45 -08:00
Vishesh Yadav cc9ad0e202 net: Use IPv6 in simulation testing #963 
25% times we will use IPv6 addresses
 2019-03-04 14:12:45 -08:00
Vishesh Yadav 57832e625d net: Support IPv6 #963 
- NetworkAddress now contains IPAddress object which can be either
IPv4 or IPv6 address. 128bits are used even for IPv4 addresses,
however only 32bits are used when using/serializing IPv4 address.

- ConnectPacket is updated to store IPv6 address. Backward compatible
with old format since the first 32bits of IP address field is used
for serialization of IPv4.

- Mainly updates rest of the code to use IPAddress structure instead
of plain uint32_t.

- IPv6 address/pair ports should be represented as `[ip]:port` as per
convention. This applies to both cluster files and command line
arguments.
 2019-03-04 14:12:41 -08:00
Alex Miller baa3e1af2c Replace `/sizeof(Page)*sizeof(Page)` with `pageFloor()`. 2019-03-04 01:42:39 -08:00
Alex Miller ee64b43366 Change DQ shrink logic to consider "active" bytes rather than file size. 
We know what the current ideal size of the DQ file should be, so we
should use it.
 2019-03-04 01:42:39 -08:00
Alex Miller 244903a9de Spill txsTag by value under TagMsg/ and not TagMsgRef/ 
There's not a tremendous reason as to why this matters now, but I feel
like I might regret sometime later not keeping the same schema under the
same key.
 2019-03-04 01:42:39 -08:00
Alex Miller 72c2cf11ab Replace ResourceLimiter with FlowLock. 2019-03-04 01:42:38 -08:00
Alex Miller 94bf75cb00 Allow the disk queue to shrink if it has unneeded slack space. 2019-03-04 01:42:38 -08:00
Alex Miller 52d5a721a6 Don't allocate 2x the memory for a read to save 1% of allocated memory. 2019-03-04 01:42:38 -08:00
Alex Miller aff9ebe21a Spill (start,length) instead of (begin,end) to save a few bytes. 2019-03-04 01:42:38 -08:00
Alex Miller 2aa527c0ef Fix a bug resulting from concurrent TLog changes. 
TLogServer was forked into OldTLogServer_6_0 at the same time that
3247d594 modified TLogServer, so the modification never made it into
OldTLogServer_6_0, resulting in a rare failure.

Manual code inspection revealed that there was also
78976161 that concurrently modified TLogServer, so that change was
copied to OldTLogServer_6_0 as well.
 2019-03-04 01:42:38 -08:00
Alex Miller fb4cb8c3a8 Print out configuration changes in ConfigureTest. 2019-03-04 01:42:38 -08:00
Alex Miller 9ef283d4e7 Implement hard limiting of memory used to serve peek requests. 2019-03-04 01:42:38 -08:00
Alex Miller e3506ad9af Add a yield to parseMessagesForTag 2019-03-04 01:42:38 -08:00
Alex Miller 742f6e1847 Solve overreading via pre-calculating tag bytes per commit 2019-03-04 01:42:38 -08:00
Alex Miller e7d8520c63 Batch more when spilling data. 2019-03-04 01:42:38 -08:00
Alex Miller 71a794ccc3 Re-enable spill-by-reference testing. 2019-03-04 01:42:38 -08:00
Alex Miller 04e1170c88 Spill txsTag by value 2019-03-04 01:42:38 -08:00
Alex Miller 4d4e0a1d54 Fix the build on -O0. 
C++ < 17 requires definitions of declared static constexpr variables.
 2019-03-04 01:42:38 -08:00
Alex Miller db546af4a3 Fix the build on -O0. 
C++ < 17 requires definitions of declared static constexpr variables.
 2019-03-04 01:38:58 -08:00
Trevor Clinkenbeard 39f612d132 Merge branch 'master' of https://github.com/apple/foundationdb into add-health-metrics 2019-03-02 17:07:00 -08:00
Trevor Clinkenbeard 2940b8d5fd Update all per-process storage server health metrics at once 
Ratekeeper updates all storage servers' health metrics in updateRate
with only a single map lookup
 2019-03-02 16:08:28 -08:00
Evan Tschannen 841eb10af0
Replace g_network->now() with now() 
Co-Authored-By: tclinken <trevorclinkenbeard@gmail.com>
 2019-03-02 08:15:56 -08:00
Evan Tschannen a37a65a7ff
Replace g_network->now() with now() 
Co-Authored-By: tclinken <trevorclinkenbeard@gmail.com>
 2019-03-02 08:15:05 -08:00
Balachandar Namasivayam 2a47fbb5a2 Fix tab spaces again 2019-03-01 15:30:40 -08:00
Balachandar Namasivayam 4324434b99 Fix tab spaces 2019-03-01 15:29:09 -08:00
Balachandar Namasivayam 74f64e4570 Fix FuzzApiCorrectness failure. 2019-03-01 15:25:37 -08:00
A.J. Beamon 655c9d82c7 Various cleanup from review 2019-03-01 14:06:47 -08:00
A.J. Beamon 2af99080ac Merge branch 'master' into ratekeeper-batch-priority-limits 2019-03-01 13:02:07 -08:00
mpilman d08aad7fc4 Old build system now working on both docker images 2019-02-28 14:24:52 -08:00
mpilman d0c06ec8c0 Make old build system work on build/cmake/Dockerfile 2019-02-28 14:24:52 -08:00
A.J. Beamon e2bcecb08f Merge branch 'master' into ratekeeper-batch-priority-limits 2019-02-28 12:52:44 -08:00
A.J. Beamon 759c53a333 Add some very basic exercising of priority batch to simulation 2019-02-28 12:18:45 -08:00
A.J. Beamon 93f7849261 Fix typo 2019-02-28 12:02:47 -08:00
A.J. Beamon 3e6a6a6569 Update status schema for correctness. Send the count of batch transactions started back to ratekeeper so that it can be logged with other ratekeeper metrics. 2019-02-28 12:00:58 -08:00
A.J. Beamon eb629d87a5 Add information about batch ratekeeper to status. Make it possible to track latencies in the ReadWrite workload for concurrently run instances separately. 2019-02-28 09:53:16 -08:00
A.J. Beamon af69ba035a
Merge pull request #1200 from bnamasivayam/master 
User provided Client Transaction id merging
 2019-02-28 11:16:44 -05:00
Alex Miller 59df4ab39a Disable testing spill-by-reference. 
There was a bad interaction between Spill-by-reference work (96f5c811)
and some concurrent piece of work that touched txsTag, which is causing
failures.

So let's disable this to get master back to a clean state while we debug why.
 2019-02-28 00:16:37 -08:00
Trevor Clinkenbeard d2bde4e55b Merge branch 'master' of https://github.com/apple/foundationdb into add-health-metrics 2019-02-27 16:30:25 -08:00
Trevor Clinkenbeard 3f59f82670 Calculate durabilityLag instead of NDV for health metrics 2019-02-27 16:30:01 -08:00
Evan Tschannen 934e0457e9 Merge branch 'master' of github.com:apple/foundationdb 
# Conflicts:
#	fdbclient/DatabaseConfiguration.cpp
 2019-02-27 15:21:06 -08:00
Evan Tschannen 976309de97 fix: removed upgrade code from when transactions logs did not have known committed versions, because it could cause remote logs to choose a start version in a range of versions between and epoch end and the following recovery version 2019-02-27 15:15:20 -08:00
Evan Tschannen 51e6b1dda0
Merge pull request #1197 from ajbeamon/avoid-transient-errors-in-incorrect-cluster-file-contents-detection 
Improve avoidance of transient issues when logging IncorrectClusterFileContents...
 2019-02-27 14:44:45 -08:00