Commit Graph

345 Commits

Author SHA1 Message Date
Aaron Molitor 4ff60db82b Revert "Use full version of fdb to support incompatible release candidates"
This reverts commit f379cf4d05.
2022-02-24 11:55:48 -06:00
Leonidas Tsampros f379cf4d05 Use full version of fdb to support incompatible release candidates 2022-02-24 11:03:42 -06:00
Chris Douglas 3793e4e5f0 Remove rundant WORKDIR directive 2021-12-17 11:34:32 -08:00
Chris Douglas fec0fb9e9f Move awscli to base image from YCSB 2021-12-17 11:25:22 -08:00
Aaron Molitor 95d33cb363 copy packaging/docker to PROJECT_BINARY_DIR (undoing part of #5994),
fetch commit_sha from source_code_directory (don't assume we're in the source tree anymore),
allow custom tag (if a parameter is passed in as $1)
update README.md
2021-12-15 15:23:17 -08:00
A.J. Beamon 5c9b64e414 Backup agent was mistakenly modified in conf files. 2021-12-14 12:02:13 -08:00
A.J. Beamon f24adc7b6a Fix a bunch of places where we used old-style arguments. Allow hyphens for profiler args. 2021-12-14 09:59:14 -08:00
A.J. Beamon f29f487823
Unify flags (#25)
* Unify flags implementation and change help text in backup.actor.cpp
Description

Testing

* Keep LOG_GROUP unchanged

Description

Testing

* Transfer the hyphens to underscores for internal options and user's input, EXCEPT leading hyphens

Description

Testing

* Use a deep copy of the user's input flag to do the match

Description

Testing

* Convert the _ to - in Option arrays of backup.actor.cpp

Description

Testing

* Transter _ to - for files:
        TLSConfig.actor.h, fdbcli.actor.cpp, fdbserver.actor.cpp, FileConverter.h, FileConverter.cpp

Description

Testing

* Change another way to unify flag: using SO_O_ICASE_HYPHEN_AND_UNDERSCORE to determine whether we do the conversion in function IsEqual

Description

Testing

* Change the config command's name from SO_O_ICASE_HYPHEN_AND_UNDERSCORE to SO_O_HYPHEN_TO_UNDERSCORE

Description

Testing

* Update the comment for the SO_O_HYPHEN_TO_UNDERSCORE

Description

Testing

* Fix left underscore in SOption arrays

Description

Testing

* Convert _ to - in several files for commands

Description

Testing

* Make the FDBService and fdbmonitor backward compatible

Description

Testing

* Fix bugs about pointers

Description

Testing

* Check underscore and hyphen at the same time for --knob_, --localily_ and --test_
And fix bugs in fdbmonitor and FDBService
Description

Testing

* Simplify the function in fdbmonitor and FDBService about retrieving arguments.
And fix some documents in masterserver.actor.cpp

Description

Testing

* Convert _ to - for knob in the setKnob functions

Description

Testing

* Convert - to _ in the setKnob functions

Description
Since key in the knob related maps only contain _

Testing

* Rename varialbe name in the fdbmonitor and FDBService for clarification

Description

Testing

Co-authored-by: Chang Liu <chang.liu@snowflake.com>
2021-12-14 08:44:39 -08:00
Aaron Molitor 8aab68303b add discrete tag_postfix to images, cleanup documentation 2021-12-10 15:37:04 -08:00
Aaron Molitor 661181d61c make curl and sha256sum more quiet, pull local binaries from the correct place in build_output_directory 2021-12-03 15:06:09 -08:00
Aaron Molitor 9f5197b54c use FDB_VERSION in lieu of PROJECT_VERSION (package scripts) 2021-11-29 15:11:20 -08:00
Aaron Molitor 77db63274b use FDB_VERSION in lieu of PROJECT_VERSION or CMAKE_PROJECT_VERSION
write FDB_VERSION to a file to avoid regex golf in other build scripts
2021-11-29 15:11:20 -08:00
Aaron Molitor 08b635d405 rename prerelease_string, replace PRERELEASE with SNAPSHOT 2021-11-29 15:11:20 -08:00
Russell Sears d332d03b34 Have individual YCSB containers record completion of their phase of the load. This allows loads to succeed even if the fdb-kubernetes-tests client crashes out mid run 2021-11-19 14:33:23 -08:00
Andrew Noyes 71fa5e86b9 Don't adduser in client postinstall 2021-11-18 10:52:37 -08:00
Aaron Molitor 124e7eb4f2 refactor docker directory
- make release images ALL based from centos:7
- keep eks images that are based from amazonlinux:2, but create strong alignment with release (centos7) images
- use multi-stage Dockerfile(s)
- have a single build-images script
- remove per image directories (which would only contain scripts that are copied into images)
- remove empty requirements.txt file for sidecar.py (the pip command, package and version are in the Dockerfile)
- don't copy docker into PROJECT_BINARY_DIR
- incorporate latest changes already in master
2021-11-17 16:29:07 -08:00
John Brownlee 01c37a053a
Merge pull request #5993 from brownleej/new-image-fixes
Updates to fdb-kubernetes-monitor to ease integration with the Kubernetes operator
2021-11-17 11:56:19 -08:00
Lukas Joswiak fc08313925 Use path relative to Python binary 2021-11-16 16:36:44 -08:00
Lukas Joswiak 8d4ec8562d Move generated versions.target file to build directory 2021-11-16 16:36:44 -08:00
John Brownlee 2f2e5219da Move the config file scheme into a separate package so it can be imported by the operator.
Move the argument for the number of servers per pod into a command-line argument so we can use the same config file at different storage server densities.
2021-11-12 11:58:38 -08:00
Yao Xiao 86ea63d1da
Add libsanitizer to fdb image. (#5918) 2021-11-04 23:21:54 -07:00
John Brownlee 45a66f9f75
Merge pull request #5456 from brownleej/fdb-kubernetes-monitor
Create fdb-kubernetes-monitor subproject
2021-10-29 11:29:23 -07:00
Aaron Molitor 504f08a102 consolidate docker stuff, add perf and flamegraph parts to release image 2021-10-29 09:58:55 -07:00
Leonidas Tsampros a4d784a3dc packaging: apt doesn't support >= and fix tini installation 2021-10-29 09:58:55 -07:00
Aaron Molitor 3305fe92f6 fix typo in script 2021-10-28 19:45:48 -07:00
John Brownlee a6b903e7f8 Move the new Kubernetes image to centos 7. 2021-10-28 17:40:05 -07:00
John Brownlee 1a5069a047 Use an write-and-rename pattern when copying files for atomicity.
Restructure the usage of the mutex in the monitor class.
2021-10-28 17:40:05 -07:00
John Brownlee c7858d2441 Add the init and sidecar modes for fdb-kubernetes-monitor.
Add support for using a special binary path during upgrades in fdb-kubernetes-monitor.
2021-10-28 17:40:05 -07:00
John Brownlee 7c36123cf8 Adds structured logging in fdb-kubernetes-monitor.
Adds a backoff window when restarting processes in fdb-kubernetes-monitor.
2021-10-28 17:40:05 -07:00
John Brownlee 95ad5854be Add a mechanism to post updates from fdb-kubernetes-monitor to pod annotations.
Remove some of the local test data for fdb-kubernetes-monitor in favor of testing through a Kuberentes statefulset.
2021-10-28 17:40:05 -07:00
John Brownlee 0f173edb47 Add a dockerfile for fdb-kubernetes-monitor. 2021-10-28 17:40:05 -07:00
Aaron Molitor e9091f91c9 make build-ycsb-docker.sh executalbe 2021-10-18 14:55:39 -07:00
Aaron Molitor 7129c2b528 update packaging to align across branches 2021-10-18 14:31:46 -07:00
Aaron Molitor 82bdd03268 add ycsb docker build script 2021-10-18 13:57:39 -07:00
Aaron Molitor 73525085cf cleanup docker build scripts 2021-10-18 13:57:39 -07:00
Aaron Molitor 0e4a6cc921 add ycsb Dockerfile 2021-10-15 00:27:20 -07:00
Johannes M. Scheuermann a597b87af9 Fix typo for None 2021-09-21 10:33:11 +01:00
Johannes M. Scheuermann e091951b8e Fix kubernetes sidecar 2021-09-21 10:33:11 +01:00
Johannes M. Scheuermann 33928904ec Update sidecar to match latest changes in operator 2021-09-21 10:33:11 +01:00
Markus Pilman a2b8812e63 fix permissions again 2021-09-16 15:15:06 -07:00
Markus Pilman d46c195444 fix directory permissions in postinst script 2021-09-16 15:15:06 -07:00
A.J. Beamon 94c3cb3086 Create the logs directory for FDB processes in the correct place 2021-08-27 10:58:32 -07:00
Andrew Noyes 3b4fed4f18
Merge pull request #4818 from sfc-gh-anoyes/anoyes/pkg_tester
Add pkg_tester
2021-08-24 12:22:50 -07:00
Vishesh Yadav 42556a3081
Merge pull request #5373 from falsandtru/samples/go
Fix download addresses
2021-08-20 18:52:21 -07:00
Andrew Noyes 82d0ef705d Tests pass for versioned packages 2021-08-19 16:32:22 +00:00
Andrew Noyes 8bbcfca8a0 Run all tests for versioned packages 2021-08-19 16:32:22 +00:00
Andrew Noyes 505ba2fc42 Works for ubuntu 2021-08-19 16:32:22 +00:00
Markus Pilman 2e8a469b27 Incomplete implementation 2021-08-19 16:32:22 +00:00
Mohamed Oulmahdi deaf302987 Remove deprecated Action parameter for Windows Installer 2021-08-18 18:06:36 +02:00
falsandtru 0527cccdab Fix Golang sample 2021-08-13 02:18:21 +09:00