Go to file
Alec Grieser 1d12618f7d
Merge pull request #1138 from ajbeamon/python-fix-signal-handler
Python now blocks on a future in Python rather than in native code to…
2019-02-11 11:05:22 -08:00
FDBLibTLS Fix dependency bug in FDBLibTLS 2019-02-07 15:37:04 -08:00
bindings Add comment for the code where we replace the semaphore in the exception handler 2019-02-11 10:35:29 -08:00
build Merge pull request #1124 from apple/release-6.0 2019-02-07 12:22:40 -08:00
cmake Guard all versions.h to not break old WIN32 build 2019-02-08 16:06:00 -08:00
design Update backup.md 2018-10-29 14:11:20 -07:00
documentation Update the release note to reflect that the problem was not limited to the REPL. 2019-02-08 13:56:41 -08:00
fdbbackup Guard all versions.h to not break old WIN32 build 2019-02-08 16:06:00 -08:00
fdbcli Guard all versions.h to not break old WIN32 build 2019-02-08 16:06:00 -08:00
fdbclient Guard all versions.h to not break old WIN32 build 2019-02-08 16:06:00 -08:00
fdbmonitor Guard all versions.h to not break old WIN32 build 2019-02-08 16:06:00 -08:00
fdbrpc fdbservice and fdbrpc now compiling 2019-02-07 15:37:04 -08:00
fdbserver Guard all versions.h to not break old WIN32 build 2019-02-08 16:06:00 -08:00
fdbservice Guard all versions.h to not break old WIN32 build 2019-02-08 16:06:00 -08:00
flow Merge pull request #1092 from atn34/trace-format-network-option 2019-02-08 10:52:50 -08:00
layers remove trailing whitespace from our copyright headers ; fixed formatting of python setup.py 2018-02-21 10:25:11 -08:00
packaging Create data and log directory in OS X installer 2019-02-07 18:09:10 -08:00
recipes tuple.Tuple needed to be deconstructed into TupleElement items before appending to key tuple 2018-10-23 22:13:52 -05:00
tests Update tests/CMakeLists.txt 2019-01-24 13:16:06 -08:00
.clang-format Add a clang-format config file. 2018-03-29 12:10:12 -07:00
.gitignore Merge pull request #942 from ajbeamon/remove-cluster-from-bindings 2019-01-24 14:39:09 -08:00
ACKNOWLEDGEMENTS Initial repository commit 2017-05-25 13:48:44 -07:00
CMakeLists.txt Generate Windows-Installer with cmake 2019-02-07 15:37:04 -08:00
CODE_OF_CONDUCT.md Updates markdown link to Contributor Covenant homepage in the Code of Conduct. 2018-04-18 01:08:55 -04:00
CONTRIBUTING.md Adds initial draft of contribution guide. 2018-04-12 17:59:32 -07:00
LICENSE Initial repository commit 2017-05-25 13:48:44 -07:00
Makefile Prefer MCS instead of DMCS which has been deprecated in Mono 2019-01-01 18:53:54 -08:00
README.md Document cpack for deb, rpm, and osx 2019-02-07 18:09:10 -08:00
fdb.cluster.cmake flow compiling with cmake on OS X 2018-12-13 13:58:06 -08:00
foundationdb.sln removed references to nodejs bindings 2018-04-06 17:17:45 -07:00
versions.target bump version to 6.0.2 following 6.0.1 release 2018-07-10 16:26:43 -07:00

README.md

FoundationDB logo

FoundationDB is a distributed database designed to handle large volumes of structured data across clusters of commodity servers. It organizes data as an ordered key-value store and employs ACID transactions for all operations. It is especially well-suited for read/write workloads but also has excellent performance for write-intensive workloads. Users interact with the database using API language binding.

To learn more about FoundationDB, visit foundationdb.org

Documentation

Documentation can be found online at https://apple.github.io/foundationdb/. The documentation covers details of API usage, background information on design philosophy, and extensive usage examples. Docs are built from the source in this repo.

Forums

The FoundationDB Forums are the home for most of the discussion and communication about the FoundationDB project. We welcome your participation! We want FoundationDB to be a great project to be a part of and, as part of that, have established a Code of Conduct to establish what constitutes permissible modes of interaction.

Contributing

Contributing to FoundationDB can be in contributions to the code base, sharing your experience and insights in the community on the Forums, or contributing to projects that make use of FoundationDB. Please see the contributing guide for more specifics.

Getting Started

Binary downloads

Developers interested in using the FoundationDB store for an application can get started easily by downloading and installing a binary package. Please see the downloads page for a list of available packages.

Compiling from source

Developers on a OS for which there is no binary package, or who would like to start hacking on the code can get started by compiling from source.

Currently there are two build systems: a collection of Makefiles and a CMake-based. Both of them should work for most users and CMake will eventually become the only build system available.

Makefile

MacOS

  1. Check out this repo on your Mac.
  2. Install the Xcode command-line tools.
  3. Download version 1.52 of Boost.
  4. Set the BOOSTDIR environment variable to the location containing this boost installation.
  5. Install Mono.
  6. Install a JDK. FoundationDB currently builds with Java 8.
  7. Navigate to the directory where you checked out the foundationdb repo.
  8. Run make.

Linux

  1. Install Docker.

  2. Check out the foundationdb repo.

  3. Build Linux docker image using the file Dockerfile located in the build source directory.

    cd /dir/path/foundationdb
    docker build ./build -t <image-tag-name>
    
  4. Run the docker image interactively Docker Run with the directory containing the foundationdb repo mounted Docker Mounts.

    docker run -it -v '/local/dir/path/foundationdb:/docker/dir/path/foundationdb' <image-tag-name> /bin/bash
    
  5. Navigate to the container's mounted directory which contains the foundationdb repo.

    cd /docker/dir/path/foundationdb
    
  6. Run make.

This will build the fdbserver binary and the python bindings. If you want to build our other bindings, you will need to install a runtime for the language whose binding you want to build. Each binding has an .mk file which provides specific targets for that binding.

CMake

FoundationDB is currently in the process of migrating the build system to cmake. The CMake build system is currently used by several developers. However, most of the testing and packaging infrastructure still uses the old VisualStudio+Make based build system.

To build with CMake, generally the following is required (works on Linux and Mac OS - for Windows see below):

  1. Check out this repository.
  2. Install cmake Version 3.12 or higher CMake
  3. Download version 1.67 of Boost.
  4. Unpack boost (you don't need to compile it)
  5. Install Mono.
  6. Install a JDK. FoundationDB currently builds with Java 8.
  7. Create a build directory (you can have the build directory anywhere you like): mkdir build
  8. cd build
  9. cmake -DBOOST_ROOT=<PATH_TO_BOOST> <PATH_TO_FOUNDATIONDB_DIRECTORY>
  10. make

CMake will try to find its dependencies. However, for LibreSSL this can be often problematic (especially if OpenSSL is installed as well). For that we recommend passing the argument -DLibreSSL_ROOT to cmake. So, for example, if you LibreSSL is installed under /usr/local/libressl-2.8.3, you should call cmake like this:

cmake -DLibreSSL_ROOT=/usr/local/libressl-2.8.3/ ../foundationdb

FoundationDB will build just fine without LibreSSL, however, the resulting binaries won't support TLS connections.

Generating compile_commands.json

CMake can build a compilation database for you. However, the default generatd one is not too useful as it operates on the generated files. When running make, the build system will create another compile_commands.json file in the source directory. This can than be used for tools like CCLS, CQuery, etc. This way you can get code-completion and code navigation in flow. It is not yet perfect (it will show a few errors) but we are constantly working on improving the developement experience.

Linux

There are no special requirements for Linux. However, we are currently working on a Docker-based build as well.

If you want to create a package you have to tell cmake what platform it is for. And then you can build by simply calling cpack. So for debian, call:

cmake -DINSTALL_LAYOUT=DEB  <FDB_SOURCE_DIR>
make
cpack

For RPM simply replace DEB with RPM.

MacOS

The build under MacOS will work the same way as on Linux. To get LibreSSL and boost you can use Hombrew. LibreSSL will not be installed in /usr/local instead it will stay in /usr/local/Cellar. So the cmake command will look somethink like this:

cmake -DLibreSSL_ROOT=/usr/local/Cellar/libressl/2.8.3 <PATH_TO_FOUNDATIONDB_SOURCE>

To generate a installable package, you have to call CMake with the corresponding arguments and then use cpack to generate the package:

cmake -DINSTALL_LAYOUT=OSX  <FDB_SOURCE_DIR>
make
cpack

Windows

Under Windows, the build instructions are very similar, with the main difference that Visual Studio is used to compile.

  1. Install Visual Studio 2017 (Community Edition is tested)
  2. Install cmake Version 3.12 or higher CMake
  3. Download version 1.67 of Boost.
  4. Unpack boost (you don't need to compile it)
  5. Install Mono.
  6. Install a JDK. FoundationDB currently builds with Java 8.
  7. Set JAVA_HOME to the unpacked location and JAVA_COMPILE to $JAVA_HOME/bin/javac
  8. (Optional) Install WIX. Without it Visual Studio won't build the Windows installer.
  9. Create a build directory (you can have the build directory anywhere you like): mkdir build
  10. cd build
  11. cmake -G "Visual Studio 15 2017 Win64" -DBOOST_ROOT=<PATH_TO_BOOST> <PATH_TO_FOUNDATIONDB_DIRECTORY>
  12. This should succeed. In which case you can build using msbuild: msbuild /p:Configuration=Release fdb.sln. You can also open the resulting solution in Visual Studio and compile from there. However, be aware that using Visual Studio for developement is currently not supported as Visual Studio will only know about the generated files.

If you want TLS support to be enabled under Windows you currently have to build and install LibreSSL yourself as the newer LibreSSL versions are not provided for download from the LibreSSL homepage. To build LibreSSL:

  1. Download and unpack libressl (>= 2.8.2)
  2. cd libressl-2.8.2
  3. mkdir build
  4. cd build
  5. cmake -G "Visual Studio 15 2017 Win64" ..
  6. Open the generated LibreSSL.sln in Visual Studio as administrator (this is necessary for the install)
  7. Build the INSTALL project in Release mode

This will install LibreSSL under C:\Program Files\LibreSSL. After that cmake will automatically find it and build with TLS support.

If you installed WIX before running cmake you should find the FDBInstaller.msi in your build directory under packaging/msi.