2018-04-19 06:03:27 +08:00
< img alt = "FoundationDB logo" src = "documentation/FDB_logo.png?raw=true" width = "400" >
2017-05-26 04:48:44 +08:00
FoundationDB is a distributed database designed to handle large volumes of structured data across clusters of commodity servers. It organizes data as an ordered key-value store and employs ACID transactions for all operations. It is especially well-suited for read/write workloads but also has excellent performance for write-intensive workloads. Users interact with the database using API language binding.
2018-03-28 07:19:03 +08:00
2018-04-13 05:35:56 +08:00
To learn more about FoundationDB, visit [foundationdb.org ](https://www.foundationdb.org/ )
2018-03-28 07:19:03 +08:00
2018-04-13 05:35:56 +08:00
## Documentation
2018-04-14 05:52:56 +08:00
Documentation can be found online at < https: // apple . github . io / foundationdb /> . The documentation covers details of API usage, background information on design philosophy, and extensive usage examples. Docs are built from the [source in this repo ](documentation/sphinx/source ).
2018-04-13 05:35:56 +08:00
## Forums
2018-04-14 05:52:56 +08:00
[The FoundationDB Forums ](https://forums.foundationdb.org/ ) are the home for most of the discussion and communication about the FoundationDB project. We welcome your participation! We want FoundationDB to be a great project to be a part of and, as part of that, have established a [Code of Conduct ](CODE_OF_CONDUCT.md ) to establish what constitutes permissible modes of interaction.
2018-04-13 05:35:56 +08:00
## Contributing
2018-04-14 05:52:56 +08:00
Contributing to FoundationDB can be in contributions to the code base, sharing your experience and insights in the community on the Forums, or contributing to projects that make use of FoundationDB. Please see the [contributing guide ](CONTRIBUTING.md ) for more specifics.
2018-04-13 05:35:56 +08:00
## Getting Started
### Binary downloads
2018-04-14 07:01:40 +08:00
Developers interested in using the FoundationDB store for an application can get started easily by downloading and installing a binary package. Please see the [downloads page ](https://www.foundationdb.org/download/ ) for a list of available packages.
2018-04-13 05:35:56 +08:00
2018-04-19 07:03:59 +08:00
### Compiling from source
2018-04-13 05:35:56 +08:00
2019-06-13 08:39:11 +08:00
Developers on an OS for which there is no binary package, or who would like
2019-06-12 05:18:10 +08:00
to start hacking on the code, can get started by compiling from source.
2018-04-13 05:35:56 +08:00
2019-02-07 12:42:13 +08:00
Currently there are two build systems: a collection of Makefiles and a
2019-06-12 05:18:10 +08:00
CMake-based build system. Both of them should currently work for most users,
and CMake should be the preferred choice as it will eventually become the only
build system available.
2019-02-06 11:38:04 +08:00
2019-02-07 12:42:13 +08:00
## CMake
To build with CMake, generally the following is required (works on Linux and
Mac OS - for Windows see below):
2019-02-28 08:54:41 +08:00
2019-02-07 12:42:13 +08:00
1. Check out this repository.
2019-02-28 08:54:41 +08:00
1. Install cmake Version 3.12 or higher [CMake ](https://cmake.org/ )
1. Download version 1.67 of [Boost ](https://sourceforge.net/projects/boost/files/boost/1.67.0/ ).
2019-02-07 12:42:13 +08:00
1. Unpack boost (you don't need to compile it)
1. Install [Mono ](http://www.mono-project.com/download/stable/ ).
1. Install a [JDK ](http://www.oracle.com/technetwork/java/javase/downloads/index.html ). FoundationDB currently builds with Java 8.
1. Create a build directory (you can have the build directory anywhere you
like): `mkdir build`
1. `cd build`
1. `cmake -DBOOST_ROOT=<PATH_TO_BOOST> <PATH_TO_FOUNDATIONDB_DIRECTORY>`
1. `make`
CMake will try to find its dependencies. However, for LibreSSL this can be often
problematic (especially if OpenSSL is installed as well). For that we recommend
passing the argument `-DLibreSSL_ROOT` to cmake. So, for example, if you
LibreSSL is installed under /usr/local/libressl-2.8.3, you should call cmake like
this:
```
cmake -DLibreSSL_ROOT=/usr/local/libressl-2.8.3/ ../foundationdb
```
FoundationDB will build just fine without LibreSSL, however, the resulting
binaries won't support TLS connections.
2019-02-08 16:03:16 +08:00
### Language Bindings
The language bindings that are supported by cmake will have a corresponding
`README.md` file in the corresponding `bindings/lang` directory.
Generally, cmake will build all language bindings for which it can find all
necessary dependencies. After each successful cmake run, cmake will tell you
which language bindings it is going to build.
2019-06-12 05:18:10 +08:00
### Generating `compile_commands.json`
2019-02-07 12:42:13 +08:00
2019-02-15 08:37:48 +08:00
CMake can build a compilation database for you. However, the default generated
2019-02-07 12:42:13 +08:00
one is not too useful as it operates on the generated files. When running make,
the build system will create another `compile_commands.json` file in the source
directory. This can than be used for tools like
[CCLS ](https://github.com/MaskRay/ccls ),
[CQuery ](https://github.com/cquery-project/cquery ), etc. This way you can get
code-completion and code navigation in flow. It is not yet perfect (it will show
2019-02-15 08:37:48 +08:00
a few errors) but we are constantly working on improving the development experience.
2019-02-07 12:42:13 +08:00
2019-06-12 05:18:10 +08:00
CMake will not produce a `compile_commands.json` , you must pass
`-DCMAKE_EXPORT_COMPILE_COMMANDS=ON` . This also enables the target
`processed_compile_commands` , which rewrites `compile_commands.json` to
describe the actor compiler source file, not the post-processed output files,
and places the output file in the source directory. This file should then be
picked up automatically by any tooling.
Note that if building inside of the `foundationdb/foundationdb-build` docker
image, the resulting paths will still be incorrect and require manual fixing.
One will wish to re-run `cmake` with `-DCMAKE_EXPORT_COMPILE_COMMANDS=OFF` to
prevent it from reverting the manual changes.
2019-02-10 06:33:36 +08:00
### Using IDEs
2019-06-12 05:18:10 +08:00
CMake has built in support for a number of popular IDEs. However, because flow
2019-02-10 06:33:36 +08:00
files are precompiled with the actor compiler, an IDE will not be very useful as
a user will only be presented with the generated code - which is not what she
wants to edit and get IDE features for.
2019-02-15 08:37:48 +08:00
The good news is, that it is possible to generate project files for editing
2019-06-12 05:18:10 +08:00
flow with a supported IDE. There is a CMake option called `OPEN_FOR_IDE` which
2019-02-10 06:33:36 +08:00
will generate a project which can be opened in an IDE for editing. You won't be
able to build this project, but you will be able to edit the files and get most
edit and navigation features your IDE supports.
For example, if you want to use XCode to make changes to FoundationDB you can
create a XCode-project with the following command:
2019-02-28 08:54:41 +08:00
```sh
2019-02-10 06:33:36 +08:00
cmake -G Xcode -DOPEN_FOR_IDE=ON < FDB_SOURCE_DIRECTORY >
```
You should create a second build-directory which you will use for building
(probably with make or ninja) and debugging.
2019-02-07 12:42:13 +08:00
### Linux
2019-06-12 05:18:10 +08:00
There are no special requirements for Linux. A docker image can be pulled from
`foundationdb/foundationdb-build` that has all of FoundationDB's dependencies
pre-installed, and is what the CI uses to build and test PRs.
2019-02-07 12:42:13 +08:00
2019-02-08 08:35:52 +08:00
If you want to create a package you have to tell cmake what platform it is for.
And then you can build by simply calling `cpack` . So for debian, call:
```
cmake -DINSTALL_LAYOUT=DEB < FDB_SOURCE_DIR >
make
cpack
```
For RPM simply replace `DEB` with `RPM` .
2019-02-07 12:42:13 +08:00
### MacOS
The build under MacOS will work the same way as on Linux. To get LibreSSL and boost you
2019-04-14 08:29:30 +08:00
can use [Homebrew ](https://brew.sh/ ). LibreSSL will not be installed in
2019-02-07 12:42:13 +08:00
`/usr/local` instead it will stay in `/usr/local/Cellar` . So the cmake command
2019-04-14 08:29:30 +08:00
will look something like this:
2019-02-07 12:42:13 +08:00
2019-02-28 08:54:41 +08:00
```sh
2019-02-07 12:42:13 +08:00
cmake -DLibreSSL_ROOT=/usr/local/Cellar/libressl/2.8.3 < PATH_TO_FOUNDATIONDB_SOURCE >
```
2019-02-06 11:38:04 +08:00
2019-02-08 08:35:52 +08:00
To generate a installable package, you have to call CMake with the corresponding
arguments and then use cpack to generate the package:
2019-02-28 08:54:41 +08:00
```sh
2019-02-08 08:35:52 +08:00
cmake -DINSTALL_LAYOUT=OSX < FDB_SOURCE_DIR >
make
cpack
```
2019-02-06 11:38:04 +08:00
2019-02-07 12:42:13 +08:00
### Windows
Under Windows, the build instructions are very similar, with the main difference
that Visual Studio is used to compile.
2019-02-06 11:38:04 +08:00
1. Install Visual Studio 2017 (Community Edition is tested)
2019-02-28 08:54:41 +08:00
1. Install cmake Version 3.12 or higher [CMake ](https://cmake.org/ )
1. Download version 1.67 of [Boost ](https://sourceforge.net/projects/boost/files/boost/1.67.0/ ).
2019-02-07 12:42:13 +08:00
1. Unpack boost (you don't need to compile it)
1. Install [Mono ](http://www.mono-project.com/download/stable/ ).
1. Install a [JDK ](http://www.oracle.com/technetwork/java/javase/downloads/index.html ). FoundationDB currently builds with Java 8.
2019-02-28 08:54:41 +08:00
1. Set `JAVA_HOME` to the unpacked location and JAVA_COMPILE to
`$JAVA_HOME/bin/javac` .
2019-03-07 03:50:46 +08:00
1. Install [Python ](https://www.python.org/downloads/ ) if it is not already installed by Visual Studio.
2019-02-08 06:19:36 +08:00
1. (Optional) Install [WIX ](http://wixtoolset.org/ ). Without it Visual Studio
won't build the Windows installer.
2019-02-07 12:42:13 +08:00
1. Create a build directory (you can have the build directory anywhere you
like): `mkdir build`
1. `cd build`
1. `cmake -G "Visual Studio 15 2017 Win64" -DBOOST_ROOT=<PATH_TO_BOOST> <PATH_TO_FOUNDATIONDB_DIRECTORY>`
1. This should succeed. In which case you can build using msbuild:
2019-02-28 08:54:41 +08:00
`msbuild /p:Configuration=Release foundationdb.sln` . You can also open the resulting
2019-02-07 12:42:13 +08:00
solution in Visual Studio and compile from there. However, be aware that
2019-02-15 08:37:48 +08:00
using Visual Studio for development is currently not supported as Visual
2019-02-28 08:54:41 +08:00
Studio will only know about the generated files. `msbuild` is located at
`c:\Program Files (x86)\MSBuild\14.0\Bin\MSBuild.exe` for Visual Studio 15.
2019-02-06 11:38:04 +08:00
2019-02-07 01:02:55 +08:00
If you want TLS support to be enabled under Windows you currently have to build
and install LibreSSL yourself as the newer LibreSSL versions are not provided
for download from the LibreSSL homepage. To build LibreSSL:
1. Download and unpack libressl (>= 2.8.2)
2. `cd libressl-2.8.2`
3. `mkdir build`
4. `cd build`
5. `cmake -G "Visual Studio 15 2017 Win64" ..`
6. Open the generated `LibreSSL.sln` in Visual Studio as administrator (this is
necessary for the install)
7. Build the `INSTALL` project in `Release` mode
This will install LibreSSL under `C:\Program Files\LibreSSL` . After that `cmake`
will automatically find it and build with TLS support.
2019-02-08 06:19:36 +08:00
If you installed WIX before running `cmake` you should find the
`FDBInstaller.msi` in your build directory under `packaging/msi` .
2019-06-12 05:18:10 +08:00
## Makefile
#### MacOS
1. Check out this repo on your Mac.
1. Install the Xcode command-line tools.
1. Download version 1.67.0 of [Boost ](https://sourceforge.net/projects/boost/files/boost/1.67.0/ ).
1. Set the `BOOSTDIR` environment variable to the location containing this boost installation.
1. Install [Mono ](http://www.mono-project.com/download/stable/ ).
1. Install a [JDK ](http://www.oracle.com/technetwork/java/javase/downloads/index.html ). FoundationDB currently builds with Java 8.
1. Navigate to the directory where you checked out the foundationdb repo.
1. Run `make` .
#### Linux
1. Install [Docker ](https://www.docker.com/ ).
1. Check out the foundationdb repo.
1. Run the docker image interactively [Docker Run ](https://docs.docker.com/engine/reference/run/#general-form ) with the directory containing the foundationdb repo mounted [Docker Mounts ](https://docs.docker.com/storage/volumes/ ).
```shell
docker run -it -v '/local/dir/path/foundationdb:/docker/dir/path/foundationdb' foundationdb/foundationdb-build:latest
```
2019-06-12 05:24:39 +08:00
1. Run `$ scl enable devtoolset-8 python27 rh-python36 rh-ruby24 -- bash` within the running container. This enables a more modern compiler, which is required to build FoundationDB.
2019-06-12 05:18:10 +08:00
1. Navigate to the container's mounted directory which contains the foundationdb repo.
```shell
cd /docker/dir/path/foundationdb
```
1. Run `make` .
This will build the fdbserver binary and the python bindings. If you want to build our other bindings, you will need to install a runtime for the language whose binding you want to build. Each binding has an `.mk` file which provides specific targets for that binding.
