Commit Graph

332 Commits

Author SHA1 Message Date
Russell Sears d332d03b34 Have individual YCSB containers record completion of their phase of the load. This allows loads to succeed even if the fdb-kubernetes-tests client crashes out mid run 2021-11-19 14:33:23 -08:00
Andrew Noyes 71fa5e86b9 Don't adduser in client postinstall 2021-11-18 10:52:37 -08:00
Aaron Molitor 124e7eb4f2 refactor docker directory
- make release images ALL based from centos:7
- keep eks images that are based from amazonlinux:2, but create strong alignment with release (centos7) images
- use multi-stage Dockerfile(s)
- have a single build-images script
- remove per image directories (which would only contain scripts that are copied into images)
- remove empty requirements.txt file for sidecar.py (the pip command, package and version are in the Dockerfile)
- don't copy docker into PROJECT_BINARY_DIR
- incorporate latest changes already in master
2021-11-17 16:29:07 -08:00
John Brownlee 01c37a053a
Merge pull request #5993 from brownleej/new-image-fixes
Updates to fdb-kubernetes-monitor to ease integration with the Kubernetes operator
2021-11-17 11:56:19 -08:00
Lukas Joswiak fc08313925 Use path relative to Python binary 2021-11-16 16:36:44 -08:00
Lukas Joswiak 8d4ec8562d Move generated versions.target file to build directory 2021-11-16 16:36:44 -08:00
John Brownlee 2f2e5219da Move the config file scheme into a separate package so it can be imported by the operator.
Move the argument for the number of servers per pod into a command-line argument so we can use the same config file at different storage server densities.
2021-11-12 11:58:38 -08:00
Yao Xiao 86ea63d1da
Add libsanitizer to fdb image. (#5918) 2021-11-04 23:21:54 -07:00
John Brownlee 45a66f9f75
Merge pull request #5456 from brownleej/fdb-kubernetes-monitor
Create fdb-kubernetes-monitor subproject
2021-10-29 11:29:23 -07:00
Aaron Molitor 504f08a102 consolidate docker stuff, add perf and flamegraph parts to release image 2021-10-29 09:58:55 -07:00
Leonidas Tsampros a4d784a3dc packaging: apt doesn't support >= and fix tini installation 2021-10-29 09:58:55 -07:00
Aaron Molitor 3305fe92f6 fix typo in script 2021-10-28 19:45:48 -07:00
John Brownlee a6b903e7f8 Move the new Kubernetes image to centos 7. 2021-10-28 17:40:05 -07:00
John Brownlee 1a5069a047 Use an write-and-rename pattern when copying files for atomicity.
Restructure the usage of the mutex in the monitor class.
2021-10-28 17:40:05 -07:00
John Brownlee c7858d2441 Add the init and sidecar modes for fdb-kubernetes-monitor.
Add support for using a special binary path during upgrades in fdb-kubernetes-monitor.
2021-10-28 17:40:05 -07:00
John Brownlee 7c36123cf8 Adds structured logging in fdb-kubernetes-monitor.
Adds a backoff window when restarting processes in fdb-kubernetes-monitor.
2021-10-28 17:40:05 -07:00
John Brownlee 95ad5854be Add a mechanism to post updates from fdb-kubernetes-monitor to pod annotations.
Remove some of the local test data for fdb-kubernetes-monitor in favor of testing through a Kuberentes statefulset.
2021-10-28 17:40:05 -07:00
John Brownlee 0f173edb47 Add a dockerfile for fdb-kubernetes-monitor. 2021-10-28 17:40:05 -07:00
Aaron Molitor e9091f91c9 make build-ycsb-docker.sh executalbe 2021-10-18 14:55:39 -07:00
Aaron Molitor 7129c2b528 update packaging to align across branches 2021-10-18 14:31:46 -07:00
Aaron Molitor 82bdd03268 add ycsb docker build script 2021-10-18 13:57:39 -07:00
Aaron Molitor 73525085cf cleanup docker build scripts 2021-10-18 13:57:39 -07:00
Aaron Molitor 0e4a6cc921 add ycsb Dockerfile 2021-10-15 00:27:20 -07:00
Johannes M. Scheuermann a597b87af9 Fix typo for None 2021-09-21 10:33:11 +01:00
Johannes M. Scheuermann e091951b8e Fix kubernetes sidecar 2021-09-21 10:33:11 +01:00
Johannes M. Scheuermann 33928904ec Update sidecar to match latest changes in operator 2021-09-21 10:33:11 +01:00
Markus Pilman a2b8812e63 fix permissions again 2021-09-16 15:15:06 -07:00
Markus Pilman d46c195444 fix directory permissions in postinst script 2021-09-16 15:15:06 -07:00
A.J. Beamon 94c3cb3086 Create the logs directory for FDB processes in the correct place 2021-08-27 10:58:32 -07:00
Andrew Noyes 3b4fed4f18
Merge pull request #4818 from sfc-gh-anoyes/anoyes/pkg_tester
Add pkg_tester
2021-08-24 12:22:50 -07:00
Vishesh Yadav 42556a3081
Merge pull request #5373 from falsandtru/samples/go
Fix download addresses
2021-08-20 18:52:21 -07:00
Andrew Noyes 82d0ef705d Tests pass for versioned packages 2021-08-19 16:32:22 +00:00
Andrew Noyes 8bbcfca8a0 Run all tests for versioned packages 2021-08-19 16:32:22 +00:00
Andrew Noyes 505ba2fc42 Works for ubuntu 2021-08-19 16:32:22 +00:00
Markus Pilman 2e8a469b27 Incomplete implementation 2021-08-19 16:32:22 +00:00
Mohamed Oulmahdi deaf302987 Remove deprecated Action parameter for Windows Installer 2021-08-18 18:06:36 +02:00
falsandtru 0527cccdab Fix Golang sample 2021-08-13 02:18:21 +09:00
falsandtru 5a846bddd5 Fix download addresses 2021-08-13 02:17:42 +09:00
Mohamed Oulmahdi 7b590c2447 Add support for building on Windows via Docker
- Add Dockerfile.windows and Dockerfile..windows.devel
- build.ps1: script that produces the binaries (MSI, tools)
- CMake: disable building documentation on windows (not supported)
- Fix invalid path when building setup with WIX
- Remove deprecated @Action attribute from wix project
2021-07-08 11:42:16 +02:00
Daniel Smith 2524a6acc3 Debugging help 2021-06-10 14:04:00 -04:00
Meng Xu 60a9dda0ed
Merge pull request #4899 from Daniel-B-Smith/aws-in-docker
Add AWS CLI tool for downloading from s3
2021-06-09 16:34:57 -07:00
Russell Sears bcd7b5a36c
Merge pull request #4785 from apple/docker-flamegraph
Add perl + flamegraph to EKS docker images
2021-06-09 13:39:04 -07:00
Daniel Smith 948524b95e Add AWS CLI tool for downloading from s3 2021-06-03 12:08:14 -04:00
Andrew Noyes 061afda2ec
Fix several package issues (#4801)
* Make the structure of the server pkg match 6.2.28

* Fix OSX lib path

* Fix install destinations in client

Previously, backup_agent would map to fdbmonitor installation dir -
which is incorrect in the sense that it disagrees with where the default
foundationdb.conf expects to find backup_agent. Add a new backupagent
installation dir and install there, matching foundationdb.conf's
expectations.

Also fix an issue where several of the versions of fdbbackup weren't
being installed

* Update packaging/osx/buildpkg.sh for cmake

* Update README instructions for pkg file

* Remove osx cpack config

* Remove pm install destinations

* Fix weird syntax

* Remove cpack reference to PM

* Address review comments
2021-05-12 11:41:26 -05:00
Russell Sears c80cd575ad Add perl + flamegraph to EKS docker images 2021-05-07 11:24:47 -07:00
Russell Sears 5fed5640d3
Merge pull request #4718 from sears/build-k8s-images
Build k8s images
2021-04-28 17:09:38 -07:00
Russell Sears 55ce798ff4 Reconcile differences in release and sidecar Dockerfile 2021-04-28 05:41:01 +00:00
Russell Sears 6b0ba14199 make release docker build script match EKS one as much as possible 2021-04-27 21:24:39 -07:00
Russell Sears 2eef4e28be Documentation update 2021-04-27 17:15:44 -07:00
Russell Sears ec0f5db98e port sidecar.py to distributions that default to python 2 instead of 3
fix various entrypoint bugs in sidecar
2021-04-27 16:57:35 -07:00