Go to file
Jingyu Zhou ae6ef0ce90 Add different block size for tests 2023-07-20 21:28:58 -07:00
FDBLibTLS Remove WolfSSL support in FoundationDB 2023-03-23 20:17:18 -07:00
bindings Fix Implib.so imports when 'amd64' architecture is using (#10618) 2023-07-17 12:04:56 +02:00
cmake Introduce initial Swift support in fdbserver (#10156) 2023-06-02 16:09:28 -05:00
contrib fixup! Set up fdbcli path when running a local cluster 2023-07-11 13:13:39 -07:00
design Split GLOBAL_TAG_THROTTLING_FOLDING_TIME into several knobs 2023-05-31 17:20:32 -07:00
documentation Merge remote-tracking branch 'origin/main' into update-doc-building_cluster 2023-07-02 16:43:55 -07:00
fdbbackup support blob restore in fdbrestore (#10248) 2023-05-19 14:45:14 -07:00
fdbcli Add new implementation of audit storage for user data (#10613) 2023-07-16 09:56:26 -07:00
fdbclient Add different block size for tests 2023-07-20 21:28:58 -07:00
fdbkubernetesmonitor Bump golang.org/x/text from 0.3.7 to 0.3.8 in /fdbkubernetesmonitor 2023-02-23 09:51:56 +00:00
fdbmonitor Make fdbmonitor understand $PID, so that --parentpid is usable on fdbserver. 2023-03-28 10:05:00 -07:00
fdbrpc Stable http ports (#10604) 2023-07-13 14:06:52 -04:00
fdbserver Merge pull request #10630 from sfc-gh-yajin/FDBCORE-5469-fix-1 2023-07-17 13:35:54 -07:00
fdbservice Merge branch 'main' into main 2022-09-20 16:56:56 -07:00
flow Add Encryption Related Latency Metrics (#10596) 2023-07-14 11:30:16 -07:00
flowbench blob granule inplace encryption (#10619) 2023-07-17 10:44:11 -07:00
layers Fix comments to use transaction_too_old instead of past_version 2019-04-24 18:50:57 -07:00
metacluster Fix build issues 2023-07-05 15:49:29 -07:00
packaging update links to foundationdb.org to reference GitHub 2023-05-30 10:15:20 -05:00
recipes Update main branch to 7.4 (#10459) 2023-06-15 10:19:39 +02:00
swift_build_support Introduce initial Swift support in fdbserver (#10156) 2023-06-02 16:09:28 -05:00
tests Merge remote-tracking branch 'origin/main' into main-gtt-forget-old-ss 2023-07-09 12:57:23 -07:00
.clang-format apply clang-format to *.c, *.cpp, *.h, *.hpp files 2021-03-10 10:18:07 -08:00
.flake8 Fix several issues found by flake8. Ignore E402, which detects when we have import statements not at the top of the file, since we have many files that use this pattern and are not easy to fix. 2023-05-02 10:06:40 -07:00
.git-blame-ignore-revs Ignore format commits in git blame 2022-06-27 17:32:43 -04:00
.gitignore Encrypt Backup Mutation Log (#8159) 2022-09-20 15:43:39 -07:00
.pre-commit-config.yaml Fix indentation in pre-commit config 2023-05-02 08:46:33 -07:00
ACKNOWLEDGEMENTS Add ACKNOWLEDGEMENTS. Replace memcpy with advsimd implementation. 2021-08-23 19:12:52 -07:00
CMakeLists.txt Update main branch to 7.4 (#10459) 2023-06-15 10:19:39 +02:00
CODE_OF_CONDUCT.md Updates markdown link to Contributor Covenant homepage in the Code of Conduct. 2018-04-18 01:08:55 -04:00
CONTRIBUTING.md Python pre-commit pipeline to enforce best practices. (#8181) 2022-09-30 13:18:55 -07:00
LICENSE Initial repository commit 2017-05-25 13:48:44 -07:00
README.md Remove mentioning of build directory in README.md 2023-05-24 10:22:02 -07:00
SWIFT_GUIDE.md Introduce initial Swift support in fdbserver (#10156) 2023-06-02 16:09:28 -05:00
SWIFT_IDE_SETUP.md Introduce initial Swift support in fdbserver (#10156) 2023-06-02 16:09:28 -05:00
fdb.cluster.cmake Fix port to match sandbox foundationdb.conf 2019-04-03 13:49:44 -07:00
pull_request_template.md Update pull_request_template.md 2022-07-29 13:37:35 -05:00
swift_get_latest_toolchain.sh Introduce initial Swift support in fdbserver (#10156) 2023-06-02 16:09:28 -05:00
versions.target.cmake use FDB_VERSION in lieu of PROJECT_VERSION or CMAKE_PROJECT_VERSION 2021-11-29 15:11:20 -08:00

README.md

FoundationDB logo

Build Status

FoundationDB is a distributed database designed to handle large volumes of structured data across clusters of commodity servers. It organizes data as an ordered key-value store and employs ACID transactions for all operations. It is especially well-suited for read/write workloads but also has excellent performance for write-intensive workloads. Users interact with the database using API language binding.

To learn more about FoundationDB, visit foundationdb.org

Documentation

Documentation can be found online at https://apple.github.io/foundationdb/. The documentation covers details of API usage, background information on design philosophy, and extensive usage examples. Docs are built from the source in this repo.

Forums

The FoundationDB Forums are the home for most of the discussion and communication about the FoundationDB project. We welcome your participation! We want FoundationDB to be a great project to be a part of and, as part of that, have established a Code of Conduct to establish what constitutes permissible modes of interaction.

Contributing

Contributing to FoundationDB can be in contributions to the code base, sharing your experience and insights in the community on the Forums, or contributing to projects that make use of FoundationDB. Please see the contributing guide for more specifics.

Getting Started

Binary downloads

Developers interested in using FoundationDB can get started by downloading and installing a binary package. Please see the downloads page for a list of available packages.

Compiling from source

Developers on an OS for which there is no binary package, or who would like to start hacking on the code, can get started by compiling from source.

The official docker image for building is foundationdb/build which has all dependencies installed. The Docker image definitions used by FoundationDB team members can be found in the dedicated repository..

To build outside the official docker image you'll need at least these dependencies:

  1. Install cmake Version 3.13 or higher CMake
  2. Install Mono
  3. Install Ninja (optional, but recommended)

If compiling for local development, please set -DUSE_WERROR=ON in cmake. Our CI compiles with -Werror on, so this way you'll find out about compiler warnings that break the build earlier.

Once you have your dependencies, you can run cmake and then build:

  1. Check out this repository.
  2. Create a build directory (you can have the build directory anywhere you like).
  3. cd <PATH_TO_BUILD_DIRECTORY>
  4. cmake -G Ninja <PATH_TO_FOUNDATIONDB_DIRECTORY>
  5. ninja # If this crashes it probably ran out of memory. Try ninja -j1

Language Bindings

The language bindings that are supported by cmake will have a corresponding README.md file in the corresponding bindings/lang directory.

Generally, cmake will build all language bindings for which it can find all necessary dependencies. After each successful cmake run, cmake will tell you which language bindings it is going to build.

Generating compile_commands.json

CMake can build a compilation database for you. However, the default generated one is not too useful as it operates on the generated files. When running make, the build system will create another compile_commands.json file in the source directory. This can than be used for tools like CCLS, CQuery, etc. This way you can get code-completion and code navigation in flow. It is not yet perfect (it will show a few errors) but we are constantly working on improving the development experience.

CMake will not produce a compile_commands.json, you must pass -DCMAKE_EXPORT_COMPILE_COMMANDS=ON. This also enables the target processed_compile_commands, which rewrites compile_commands.json to describe the actor compiler source file, not the post-processed output files, and places the output file in the source directory. This file should then be picked up automatically by any tooling.

Note that if building inside of the foundationdb/build docker image, the resulting paths will still be incorrect and require manual fixing. One will wish to re-run cmake with -DCMAKE_EXPORT_COMPILE_COMMANDS=OFF to prevent it from reverting the manual changes.

Using IDEs

CMake has built in support for a number of popular IDEs. However, because flow files are precompiled with the actor compiler, an IDE will not be very useful as a user will only be presented with the generated code - which is not what she wants to edit and get IDE features for.

The good news is, that it is possible to generate project files for editing flow with a supported IDE. There is a CMake option called OPEN_FOR_IDE which will generate a project which can be opened in an IDE for editing. You won't be able to build this project, but you will be able to edit the files and get most edit and navigation features your IDE supports.

For example, if you want to use XCode to make changes to FoundationDB you can create a XCode-project with the following command:

cmake -G Xcode -DOPEN_FOR_IDE=ON <FDB_SOURCE_DIRECTORY>

You should create a second build-directory which you will use for building and debugging.

FreeBSD

  1. Check out this repo on your server.

  2. Install compile-time dependencies from ports.

  3. (Optional) Use tmpfs & ccache for significantly faster repeat builds

  4. (Optional) Install a JDK for Java Bindings. FoundationDB currently builds with Java 8.

  5. Navigate to the directory where you checked out the foundationdb repo.

  6. Build from source.

    sudo pkg install -r FreeBSD \
        shells/bash devel/cmake devel/ninja devel/ccache  \
        lang/mono lang/python3 \
        devel/boost-libs devel/libeio \
        security/openssl
    mkdir .build && cd .build
    cmake -G Ninja \
        -DUSE_CCACHE=on \
        -DUSE_DTRACE=off \
        ..
    ninja -j 10
    # run fast tests
    ctest -L fast
    # run all tests
    ctest --output-on-failure -v
    

Linux

There are no special requirements for Linux. A docker image can be pulled from foundationdb/build that has all of FoundationDB's dependencies pre-installed, and is what the CI uses to build and test PRs.

cmake -G Ninja <FDB_SOURCE_DIR>
ninja
cpack -G DEB

For RPM simply replace DEB with RPM.

MacOS

The build under MacOS will work the same way as on Linux. To get boost and ninja you can use Homebrew.

cmake -G Ninja <PATH_TO_FOUNDATIONDB_SOURCE>

To generate a installable package,

ninja
$SRCDIR/packaging/osx/buildpkg.sh . $SRCDIR

Windows

Under Windows, only Visual Studio with ClangCl is supported

  1. Install Visual Studio 2019 (IDE or Build Tools), and enable llvm support
  2. Install CMake 3.15 or higher
  3. Download Boost 1.77.0
  4. Unpack boost to C:\boost, or use -DBOOST_ROOT=<PATH_TO_BOOST> with cmake if unpacked elsewhere
  5. Install Python if is not already installed by Visual Studio
  6. (Optional) Install OpenJDK 11 to build Java bindings
  7. (Optional) Install OpenSSL 3.x to build with TLS support
  8. (Optional) Install WIX Toolset to build Windows installer
  9. mkdir build && cd build
  10. cmake -G "Visual Studio 16 2019" -A x64 -T ClangCl <PATH_TO_FOUNDATIONDB_SOURCE>
  11. msbuild /p:Configuration=Release foundationdb.sln
  12. To increase build performance, use /p:UseMultiToolTask=true and /p:CL_MPCount=<NUMBER_OF_PARALLEL_JOBS>