wbtiger
/
foundationdb
mirror of https://github.com/apple/foundationdb.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,063 Commits 34 Branches 304 Tags 265 MiB
Commit Graph

5063 Commits

Author SHA1 Message Date
Alvin Moore 0654afa40e Merge branch 'master' of github.com:apple/foundationdb into new-docker 
# Conflicts:
#	build/Dockerfile
#	build/docker-compose.yaml
 2019-04-24 13:33:07 -07:00
Alvin Moore 5479baa493 Modified syntax to support python 2.6 2019-04-24 13:14:53 -07:00
Evan Tschannen be40a042c4
Merge pull request #1489 from etschannen/prepare-release-6.1.3 
update installer WIX GUID following release
 2019-04-23 22:16:51 -07:00
Evan Tschannen 6edfd2bc81 update installer WIX GUID following release 2019-04-23 22:16:19 -07:00
Evan Tschannen 7ef82dac35
Merge pull request #1488 from etschannen/post-release-cleanup-6.1.2 
Post release cleanup 6.1.2
 2019-04-23 22:15:31 -07:00
Evan Tschannen 2f345ec43d update installer WIX GUID following release 2019-04-23 22:14:49 -07:00
Evan Tschannen 1ee3007481 update versions target to 6.1.3 2019-04-23 22:14:49 -07:00
Evan Tschannen c96a30e449
Merge pull request #1487 from etschannen/release-6.1 
updated documentation for 6.1.3
 2019-04-23 22:11:43 -07:00
Evan Tschannen d554284e2e updated documentation for 6.1.3 2019-04-23 22:10:32 -07:00
Evan Tschannen 53c3c225c8
Merge pull request #1486 from etschannen/release-6.1 
Highly prioritize storageServerRejoin messages on the proxy
 2019-04-23 22:07:42 -07:00
Jingyu Zhou 5462f560e7 Add pseudo locality for log routers and tlogs 
This changes the logic of pop operations from log routers (LG):
- LG pops tagLocalityLogRouterMapped from TLogs;
- TLog converts tagLocalityLogRouterMapped back to tagLocalityLogRouter before
  popping.

Later when we add more psuedo localities, the same pattern can be used.
 2019-04-23 21:35:56 -07:00
Evan Tschannen 774b92e240 updated release notes 2019-04-23 20:59:11 -07:00
Evan Tschannen 4fa1c008f9 Highly prioritize storageServerRejoin messages on the proxy, so that storage servers can rejoin the cluster even when a proxy is CPU saturated 2019-04-23 20:56:01 -07:00
Evan Tschannen d8dbbe8186
Merge pull request #1485 from ajbeamon/speed-up-and-parameterize-spring-cleaning 
Increase the frequency that lazy deletes are run. Add more parameters…
 2019-04-23 18:26:02 -07:00
Sergey Sudakovich 0ca6595e49 Fix doc building assumes 'foundationdb' top level dir 
When cloning repository without specifying the destination,
building documentation works fine. But it fail when the top
level directory is not 'foundatinodb'.

To reproduce:

```
git clone https://github.com/apple/foundationdb.git /tmp/apple-fdb
cd /tmp/apple-fdb/documentation/sphinx
make
```
will result in

```
Exception occurred:
File
"/Users/ssudakovich/.pyenv/versions/2.7.13/lib/python2.7/xml/etree/ElementTree.py", line 647, in parse
  source = open(source, "rb")
IOError: [Errno 2] No such file or directory: u'/private/tmp/apple_fdb/documentation/sphinx/../../../foundationdb/versions.target'
```
 2019-04-23 17:30:01 -07:00
A.J. Beamon 253d2400ef Merge branch 'release-6.1' into speed-up-and-parameterize-spring-cleaning 
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
 2019-04-23 14:38:52 -07:00
A.J. Beamon 78293e08aa
Merge pull request #1482 from satherton/sqlite-chunk-size 
SQLite file chunk size
 2019-04-23 14:37:40 -07:00
A.J. Beamon ea7abff9df Clean up from review 2019-04-23 14:16:52 -07:00
A.J. Beamon 9e03add326 Add PR link to release notes 2019-04-23 14:03:23 -07:00
A.J. Beamon 4ad0496b39 Increase the frequency that lazy deletes are run. Add more parameters for better control over the spring cleaning process. 2019-04-23 14:01:51 -07:00
Stephen Atherton fe33d43377 Added release note for sqlite chunk size. 2019-04-23 13:48:07 -07:00
Stephen Atherton df0548503d Merge branch 'release-6.1' of https://github.com/apple/foundationdb into sqlite-grow-bigger 2019-04-23 13:43:58 -07:00
Stephen Atherton b4f833c27e Added sampled logging for slow ftruncate/fallocate calls. 2019-04-23 13:40:23 -07:00
Evan Tschannen 02be26a0c4
Merge pull request #1479 from etschannen/release-6.1 
Replace removed teams
 2019-04-23 13:24:56 -07:00
Evan Tschannen 96e59357fd
Merge pull request #1480 from alexmiller-apple/deprioritize-spilled-peeks-6.1 
Lower the priority of spilled peeks to below spilling
 2019-04-23 13:11:52 -07:00
A.J. Beamon e0f76edf77
Merge pull request #1471 from AlvinMooreSr/release-6.1-merge 
Merge Release 6.1 Into Master
 2019-04-23 11:08:21 -07:00
Alvin Moore 20b995d244 Updated old release 6.1 release notes 2019-04-23 10:17:08 -07:00
Stephen Atherton 83db547306 Implemented the chunk size and db size hint fileControl options in our SQLite VFS implementation. KeyValueStoreSQLite now sets file chunk size based on a new knob, SQLITE_CHUNK_SIZE_PAGES. 2019-04-23 04:50:58 -07:00
Alvin Moore c2f8799537 Removed the setting of permissions and ownership for the /opt directory 
Installed boto3 via pip
 2019-04-22 22:09:25 -07:00
Alex Miller c25fac9421 Lower the priority of spilled peeks to below that of spilling. 
This prevents peeking from starving the TLog of CPU time to spill, and
thus impacting write throughput at prolonged saturation.
 2019-04-22 18:39:21 -07:00
Evan Tschannen cc9f2ee752 updated release notes 2019-04-22 17:58:03 -07:00
Evan Tschannen e0f7ec96aa Data distribution needs to build new teams as old teams are removed to ensure data remains balanced across servers 2019-04-22 17:29:46 -07:00
Jingyu Zhou 439d5a3843 Use emplace_back instead of push_back in Proxy 2019-04-22 14:03:48 -07:00
Alvin Moore ad7487282b Changed working directory to fix problem with debug rpms 2019-04-22 12:04:08 -07:00
Jingyu Zhou d2b215b926 Refactor tag population of ServerCacheInfo 2019-04-22 11:55:04 -07:00
Alvin Moore 7f5b89d699 Updated the services defined within the docker-compose file to use enable scl tools 
Removed conditionals from docker-compose
 2019-04-22 11:40:00 -07:00
Alvin Moore 45868e9198 Updated the build docker file to be Centos-based 2019-04-22 09:06:55 -07:00
A.J. Beamon aaa53b9c6a
Merge pull request #1475 from atn34/fix-open-for-ide-linux-error 
Fix unused-variable warning in linux-only code
 2019-04-22 08:38:20 -07:00
Jingyu Zhou 7cb61c766b Fix tLogLocalities for current LogSet 
In toCoreState(), the serialization of current LogSet is different from old
TLog sets. The locality data should be generated, not copied over.

Found by:
-r simulation --crash -f tests/fast/KillRegionCycle.txt -s 254666356 -b on
 2019-04-21 10:41:07 -07:00
Jingyu Zhou 8b67da57bb Fix upgrade test failure 
Serialize pseudoLocalities if protocol version is larger than 0x0FDB00B061060001LL.
Note this version may need to be changed to "currentProtocolVersion" when merging
into the master, and "currentProtocolVersion" should be incremented.
 2019-04-21 10:41:07 -07:00
Jingyu Zhou 9e8ffd2ff7 Refactor OldLogData ctor 2019-04-21 10:41:07 -07:00
Jingyu Zhou 97986a28b7 Replace push_back with emplace_back for efficiency 
And better code readability.
 2019-04-21 10:41:07 -07:00
Jingyu Zhou 010f825aff Remove pseudoLocalities from LogSet, TLogSet, and CoreTLogSet 2019-04-21 10:41:07 -07:00
Jingyu Zhou 7befce6bf1 More pseudoLocalities and refactors. 2019-04-21 10:41:07 -07:00
Jingyu Zhou 66000a07a5 Use emplace_back instead of push_back 2019-04-21 10:41:07 -07:00
Jingyu Zhou 966ec30fcc Add pseudoLocalities for special tag consumers 2019-04-21 10:41:07 -07:00
Jingyu Zhou b4e7e7a85b Refactor StorageCache updates 2019-04-21 10:41:07 -07:00
Jingyu Zhou 82ec80c42f Refactor TLogSet ctor 2019-04-21 10:41:07 -07:00
Jingyu Zhou d19b0cf1c1 Refactor LogSet with two new constructors 2019-04-21 10:41:07 -07:00
Jingyu Zhou 0b1984978a Small code refactoring. 2019-04-21 10:41:07 -07:00