Compare commits

...

2 Commits

Author SHA1 Message Date
Dandelion 5bfcaea252
fix(chore): remove zgc in dockerfile for ARM env (#2421) (#2427)
* remove zgc

* Apply suggestions from code review



* add comment for hugegraph-server.sh

* fix enable-auth.sh

* init store in entrypoint

* use flag file to skip re-init

* delete tar.gz

* simply dockerfile

* mvn optimize

* simply dockerfile

* add init log in docker

---------

Co-authored-by: imbajin <jin@apache.org>
2024-01-29 16:33:26 +08:00
Dandelion 1123e8507f
chore(docker): cherry-pick commits from master for fix some error when using docker image for 1.2.0 as #2403 (#2417)
- allow user to set env for docker to set auth mode
- download keystore when package
- fix a curl error (also use curl first in `function` download)

---------

Co-authored-by: imbajin <jin@apache.org>
2024-01-17 11:11:29 +08:00
16 changed files with 250 additions and 67 deletions

View File

@ -96,7 +96,6 @@ header: # `header` section is configurations for source codes license header.
- '**/util/StringEncoding.java' - '**/util/StringEncoding.java'
- 'hugegraph-server/hugegraph-api/src/main/java/org/apache/hugegraph/opencypher/CypherOpProcessor.java' - 'hugegraph-server/hugegraph-api/src/main/java/org/apache/hugegraph/opencypher/CypherOpProcessor.java'
- 'hugegraph-server/hugegraph-api/src/main/java/org/apache/hugegraph/opencypher/CypherPlugin.java' - 'hugegraph-server/hugegraph-api/src/main/java/org/apache/hugegraph/opencypher/CypherPlugin.java'
- 'hugegraph-server/hugegraph-dist/src/assembly/static/bin/wait-storage.sh'
comment: on-failure # on what condition license-eye will comment on the pull request, `on-failure`, `always`, `never`. comment: on-failure # on what condition license-eye will comment on the pull request, `on-failure`, `always`, `never`.
# license-location-threshold specifies the index threshold where the license header can be located, # license-location-threshold specifies the index threshold where the license header can be located,

View File

@ -214,6 +214,5 @@ hugegraph-core/src/main/java/org/apache/hugegraph/traversal/optimize/HugeScriptT
hugegraph-core/src/main/java/org/apache/hugegraph/type/Nameable.java from https://github.com/JanusGraph/janusgraph hugegraph-core/src/main/java/org/apache/hugegraph/type/Nameable.java from https://github.com/JanusGraph/janusgraph
hugegraph-core/src/main/java/org/apache/hugegraph/type/define/Cardinality.java from https://github.com/JanusGraph/janusgraph hugegraph-core/src/main/java/org/apache/hugegraph/type/define/Cardinality.java from https://github.com/JanusGraph/janusgraph
hugegraph-core/src/main/java/org/apache/hugegraph/util/StringEncoding.java from https://github.com/JanusGraph/janusgraph hugegraph-core/src/main/java/org/apache/hugegraph/util/StringEncoding.java from https://github.com/JanusGraph/janusgraph
hugegraph-dist/src/assembly/static/bin/wait-storage.sh from https://github.com/JanusGraph/janusgraph
hugegraph-api/src/main/java/org/apache/hugegraph/opencypher/CypherOpProcessor.java from https://github.com/opencypher/cypher-for-gremlin hugegraph-api/src/main/java/org/apache/hugegraph/opencypher/CypherOpProcessor.java from https://github.com/opencypher/cypher-for-gremlin
hugegraph-api/src/main/java/org/apache/hugegraph/opencypher/CypherPlugin.java from https://github.com/opencypher/cypher-for-gremlin hugegraph-api/src/main/java/org/apache/hugegraph/opencypher/CypherPlugin.java from https://github.com/opencypher/cypher-for-gremlin

View File

@ -30,12 +30,24 @@ Billions of vertices and edges can be easily stored into and queried from HugeGr
## Quick Start ## Quick Start
### 1. Download Way ### 1. Docker Way (Convenient for Test)
We can use `docker run -itd --name=graph -p 8080:8080 hugegraph/hugegraph` to quickly start an inner
HugeGraph server with `RocksDB` (in backgrounds) for **test/dev**.
You can visit [doc page](https://hugegraph.apache.org/docs/quickstart/hugegraph-server/#3-deploy) or the [README](hugegraph-server/hugegraph-dist/docker/READEME.md) for more details.
> Note:
>
> 1. The docker image of hugegraph is a convenience release, but not **official distribution** artifacts. You can find more details from [ASF Release Distribution Policy](https://infra.apache.org/release-distribution.html#dockerhub).
>
> 2. Recommand to use `release tag`(like `1.2.0`) for the stable version. Use `latest` tag to experience the newest functions in development.
### 2. Download Way
Visit [Download Page](https://hugegraph.apache.org/docs/download/download/) and refer the [doc](https://hugegraph.apache.org/docs/quickstart/hugegraph-server/#32-download-the-binary-tar-tarball) Visit [Download Page](https://hugegraph.apache.org/docs/download/download/) and refer the [doc](https://hugegraph.apache.org/docs/quickstart/hugegraph-server/#32-download-the-binary-tar-tarball)
to download the latest release package and start the server. to download the latest release package and start the server.
### 2. Source Building Way ### 3. Source Building Way
Visit [Source Building Page](https://hugegraph.apache.org/docs/quickstart/hugegraph-server/#33-source-code-compilation) and follow the Visit [Source Building Page](https://hugegraph.apache.org/docs/quickstart/hugegraph-server/#33-source-code-compilation) and follow the
steps to build the source code and start the server. steps to build the source code and start the server.
@ -49,17 +61,7 @@ And here are links of other **HugeGraph** component/repositories:
3. [hugegraph-commons](https://github.com/apache/incubator-hugegraph-commons) (**common & rpc** libs) 3. [hugegraph-commons](https://github.com/apache/incubator-hugegraph-commons) (**common & rpc** libs)
4. [hugegraph-website](https://github.com/apache/incubator-hugegraph-doc) (**doc & website** code) 4. [hugegraph-website](https://github.com/apache/incubator-hugegraph-doc) (**doc & website** code)
### 3. Docker Way (Convenient for Test)
We can use `docker run -itd --name=graph -p 8080:8080 hugegraph/hugegraph` to quickly start an inner
HugeGraph server with `RocksDB` (in backgrounds) for **test/dev**.
You can visit [doc page](https://hugegraph.apache.org/docs/quickstart/hugegraph-server/#3-deploy) or the [README](hugegraph-server/hugegraph-dist/docker/READEME.md) for more details.
> Note:
>
> 1. The docker image of hugegraph is a convenience release, but not **official distribution** artifacts. You can find more details from [ASF Release Distribution Policy](https://infra.apache.org/release-distribution.html#dockerhub).
>
> 2. Recommand to use `release tag`(like `1.0.0`) for the stable version. Use `latest` tag to experience the newest functions in development.
## License ## License

View File

@ -23,13 +23,13 @@ COPY . /pkg
WORKDIR /pkg WORKDIR /pkg
ARG MAVEN_ARGS ARG MAVEN_ARGS
RUN mvn package $MAVEN_ARGS -e -B -ntp -DskipTests -Dmaven.javadoc.skip=true && pwd && ls -l RUN mvn package $MAVEN_ARGS -e -B -ntp -DskipTests -Dmaven.javadoc.skip=true && pwd && ls -l && rm ./hugegraph-server/*.tar.gz
# 2nd stage: runtime env # 2nd stage: runtime env
# Note: ZGC (The Z Garbage Collector) is only supported on ARM-Mac with java > 13
FROM openjdk:11-slim FROM openjdk:11-slim
# TODO: get the version from the pom.xml
ENV version=1.2.0 COPY --from=build /pkg/hugegraph-server/apache-hugegraph-incubating-*/ /hugegraph-server/
COPY --from=build /pkg/hugegraph-server/apache-hugegraph-incubating-$version/ /hugegraph-server
LABEL maintainer="HugeGraph Docker Maintainers <dev@hugegraph.apache.org>" LABEL maintainer="HugeGraph Docker Maintainers <dev@hugegraph.apache.org>"
# TODO: use g1gc or zgc as default # TODO: use g1gc or zgc as default
@ -39,7 +39,7 @@ ENV JAVA_OPTS="-XX:+UnlockExperimentalVMOptions -XX:+UseContainerSupport -XX:Max
#COPY . /hugegraph/hugegraph-server #COPY . /hugegraph/hugegraph-server
WORKDIR /hugegraph-server/ WORKDIR /hugegraph-server/
# 1. Install environment # 1. Install environment and init HugeGraph Sever
RUN set -x \ RUN set -x \
&& apt-get -q update \ && apt-get -q update \
&& apt-get -q install -y --no-install-recommends --no-install-suggests \ && apt-get -q install -y --no-install-recommends --no-install-suggests \
@ -48,15 +48,14 @@ RUN set -x \
curl \ curl \
lsof \ lsof \
vim \ vim \
cron \
&& apt-get clean \ && apt-get clean \
&& rm -rf /var/lib/apt/lists/* && rm -rf /var/lib/apt/lists/* \
&& service cron start \
# 2. Init HugeGraph Sever
RUN set -e \
&& pwd && cd /hugegraph-server/ \ && pwd && cd /hugegraph-server/ \
&& sed -i "s/^restserver.url.*$/restserver.url=http:\/\/0.0.0.0:8080/g" ./conf/rest-server.properties && sed -i "s/^restserver.url.*$/restserver.url=http:\/\/0.0.0.0:8080/g" ./conf/rest-server.properties
# 3. Init docker script # 2. Init docker script
COPY hugegraph-server/hugegraph-dist/docker/scripts/remote-connect.groovy ./scripts COPY hugegraph-server/hugegraph-dist/docker/scripts/remote-connect.groovy ./scripts
COPY hugegraph-server/hugegraph-dist/docker/scripts/detect-storage.groovy ./scripts COPY hugegraph-server/hugegraph-dist/docker/scripts/detect-storage.groovy ./scripts
COPY hugegraph-server/hugegraph-dist/docker/docker-entrypoint.sh . COPY hugegraph-server/hugegraph-dist/docker/docker-entrypoint.sh .

View File

@ -4,7 +4,7 @@
> >
> 1. The docker image of hugegraph is a convenience release, not official distribution artifacts from ASF. You can find more details from [ASF Release Distribution Policy](https://infra.apache.org/release-distribution.html#dockerhub). > 1. The docker image of hugegraph is a convenience release, not official distribution artifacts from ASF. You can find more details from [ASF Release Distribution Policy](https://infra.apache.org/release-distribution.html#dockerhub).
> >
> 2. Recommand to use `release tag`(like `1.0.0`) for the stable version. Use `latest` tag to experience the newest functions in development. > 2. Recommand to use `release tag`(like `1.2.0`) for the stable version. Use `latest` tag to experience the newest functions in development.
## 1. Deploy ## 1. Deploy
@ -12,7 +12,7 @@ We can use docker to quickly start an inner HugeGraph server with RocksDB in bac
1. Using docker run 1. Using docker run
Use `docker run -itd --name=graph -p 18080:8080 hugegraph/hugegraph` to start hugegraph server. Use `docker run -itd --name=graph -p 8080:8080 hugegraph/hugegraph` to start hugegraph server.
2. Using docker compose 2. Using docker compose
@ -35,7 +35,7 @@ If you want to customize the pre-loaded data, please mount the the groovy script
1. Using docker run 1. Using docker run
Use `docker run -itd --name=graph -p 18080:8080 -e PRELOAD=true -v /path/to/yourScript:/hugegraph/scripts/example.groovy hugegraph/hugegraph` Use `docker run -itd --name=graph -p 8080:8080 -e PRELOAD=true -v /path/to/yourScript:/hugegraph/scripts/example.groovy hugegraph/hugegraph`
to start hugegraph server. to start hugegraph server.
2. Using docker compose 2. Using docker compose
@ -57,4 +57,27 @@ If you want to customize the pre-loaded data, please mount the the groovy script
3. Using start-hugegraph.sh 3. Using start-hugegraph.sh
If you deploy HugeGraph server without docker, you can also pass arguments using `-p`, like this: `bin/start-hugegraph.sh -p true`. If you deploy HugeGraph server without docker, you can also pass arguments using `-p`, like this: `bin/start-hugegraph.sh -p true`.
## 3. Enable Authentication
1. Using docker run
Use `docker run -itd --name=graph -p 8080:8080 -e AUTH=true -e PASSWORD=123456 hugegraph/hugegraph` to enable the authentication and set the password with `-e AUTH=true -e PASSWORD=123456`.
2. Using docker compose
Similarly, we can set the envionment variables in the docker-compose.yaml:
```yaml
version: '3'
services:
server:
image: hugegraph/hugegraph
container_name: graph
ports:
- 8080:8080
environment:
- AUTH=true
- PASSWORD=123456
```

View File

@ -16,11 +16,31 @@
# under the License. # under the License.
# #
# create a folder to save the docker-related file
DOCKER_FOLDER='./docker'
mkdir -p $DOCKER_FOLDER
./bin/wait-storage.sh INIT_FLAG_FILE="init_complete"
./bin/init-store.sh if [ ! -f "${DOCKER_FOLDER}/${INIT_FLAG_FILE}" ]; then
# wait for storage backend
./bin/wait-storage.sh
if [ -z "$PASSWORD" ]; then
echo "init hugegraph with non-auth mode"
./bin/init-store.sh
else
echo "init hugegraph with auth mode"
./bin/enable-auth.sh
echo "$PASSWORD" | ./bin/init-store.sh
fi
# create a flag file to avoid re-init when restarting
touch ${DOCKER_FOLDER}/${INIT_FLAG_FILE}
else
echo "Hugegraph Initialization already done. Skipping re-init..."
fi
./bin/start-hugegraph.sh -j "$JAVA_OPTS" -g zgc # start hugegraph
# remove "-g zgc" now, which is only available on ARM-Mac with java > 13
./bin/start-hugegraph.sh -j "$JAVA_OPTS"
tail -f /dev/null tail -f /dev/null

View File

@ -22,7 +22,7 @@ services:
image: hugegraph/hugegraph image: hugegraph/hugegraph
container_name: cas-graph container_name: cas-graph
ports: ports:
- 18080:8080 - 8080:8080
environment: environment:
hugegraph.backend: cassandra hugegraph.backend: cassandra
hugegraph.serializer: cassandra hugegraph.serializer: cassandra

View File

@ -16,9 +16,20 @@
# under the License. # under the License.
# #
curl --version >/dev/null 2>&1 ||
{
echo 'ERROR: Please install `curl` first if you need `hugegraph-server.keystore`'
exit
}
./bin/wait-storage.sh # TODO: perhaps it's necessary verify the checksum before reusing the existing keystore
if [[ ! -f hugegraph-server.keystore ]]; then
curl -s -S -L -o hugegraph-server.keystore \
https://github.com/apache/hugegraph-doc/raw/binary-1.0/dist/server/hugegraph-server.keystore ||
{
echo 'ERROR: Download `hugegraph-server.keystore` from GitHub failed, please check your network connection'
exit
}
fi
./bin/init-store.sh echo 'INFO: Successfully download `hugegraph-server.keystore`'
./bin/start-hugegraph.sh -d false -j "$JAVA_OPTS" -g zgc

View File

@ -187,7 +187,7 @@
<exec executable="${shell-executable}" <exec executable="${shell-executable}"
dir="${project.basedir}" dir="${project.basedir}"
failonerror="false"> failonerror="false">
<arg line="./dist.sh"/> <arg line="./download_swagger_ui.sh"/>
</exec> </exec>
</target> </target>
</configuration> </configuration>
@ -216,6 +216,45 @@
</target> </target>
</configuration> </configuration>
</execution> </execution>
<execution>
<id>download-keystore</id>
<phase>prepare-package</phase>
<goals>
<goal>run</goal>
</goals>
<configuration>
<target>
<exec executable="${shell-executable}"
dir="${project.basedir}"
failonerror="false">
<arg line="./download_keystore.sh"/>
</exec>
</target>
</configuration>
</execution>
<execution>
<id>cp-keystore</id>
<phase>package</phase>
<goals>
<goal>run</goal>
</goals>
<configuration>
<target>
<exec executable="cp"
dir="${project.basedir}"
failonerror="false">
<arg value="hugegraph-server.keystore"/>
<arg value="../${final.name}/conf/hugegraph-server.keystore"/>
</exec>
<exec executable="rm"
dir="${project.basedir}"
failonerror="false">
<arg value="-rf"/>
<arg value="hugegraph-server.keystore"/>
</exec>
</target>
</configuration>
</execution>
</executions> </executions>
</plugin> </plugin>
</plugins> </plugins>

View File

@ -220,7 +220,6 @@ The text of each license is the standard Apache 2.0 license.
hugegraph-core/src/main/java/org/apache/hugegraph/type/Nameable.java from https://github.com/JanusGraph/janusgraph hugegraph-core/src/main/java/org/apache/hugegraph/type/Nameable.java from https://github.com/JanusGraph/janusgraph
hugegraph-core/src/main/java/org/apache/hugegraph/type/define/Cardinality.java from https://github.com/JanusGraph/janusgraph hugegraph-core/src/main/java/org/apache/hugegraph/type/define/Cardinality.java from https://github.com/JanusGraph/janusgraph
hugegraph-core/src/main/java/org/apache/hugegraph/util/StringEncoding.java from https://github.com/JanusGraph/janusgraph hugegraph-core/src/main/java/org/apache/hugegraph/util/StringEncoding.java from https://github.com/JanusGraph/janusgraph
hugegraph-dist/src/assembly/static/bin/wait-storage.sh from https://github.com/JanusGraph/janusgraph
hugegraph-core/src/main/java/org/apache/hugegraph/traversal/optimize/HugeScriptTraversal.java from https://github.com/apache/tinkerpop hugegraph-core/src/main/java/org/apache/hugegraph/traversal/optimize/HugeScriptTraversal.java from https://github.com/apache/tinkerpop
hugegraph-test/src/main/java/org/apache/hugegraph/tinkerpop/ProcessBasicSuite.java from https://github.com/apache/tinkerpop hugegraph-test/src/main/java/org/apache/hugegraph/tinkerpop/ProcessBasicSuite.java from https://github.com/apache/tinkerpop
hugegraph-test/src/main/java/org/apache/hugegraph/tinkerpop/StructureBasicSuite.java from https://github.com/apache/tinkerpop hugegraph-test/src/main/java/org/apache/hugegraph/tinkerpop/StructureBasicSuite.java from https://github.com/apache/tinkerpop

View File

@ -0,0 +1,56 @@
#!/bin/bash
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with this
# work for additional information regarding copyright ownership. The ASF
# licenses this file to You under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
# License for the specific language governing permissions and limitations
# under the License.
#
function abs_path() {
SOURCE="${BASH_SOURCE[0]}"
while [[ -h "$SOURCE" ]]; do
DIR="$(cd -P "$(dirname "$SOURCE")" && pwd)"
SOURCE="$(readlink "$SOURCE")"
[[ $SOURCE != /* ]] && SOURCE="$DIR/$SOURCE"
done
cd -P "$(dirname "$SOURCE")" && pwd
}
BIN=$(abs_path)
TOP="$(cd "${BIN}"/../ && pwd)"
CONF="$TOP/conf"
GREMLIN_SERVER_CONF="gremlin-server.yaml"
REST_SERVER_CONF="rest-server.properties"
GRAPH_CONF="hugegraph.properties"
# make a backup
BAK_CONF="$TOP/conf-bak"
if [ ! -d "$BAK_CONF" ]; then
mkdir -p "$BAK_CONF"
cp "${CONF}/${GREMLIN_SERVER_CONF}" "${BAK_CONF}/${GREMLIN_SERVER_CONF}.bak"
cp "${CONF}/${REST_SERVER_CONF}" "${BAK_CONF}/${REST_SERVER_CONF}.bak"
cp "${CONF}/graphs/${GRAPH_CONF}" "${BAK_CONF}/${GRAPH_CONF}.bak"
sed -i -e '$a\authentication: {' \
-e '$a\ authenticator: org.apache.hugegraph.auth.StandardAuthenticator,' \
-e '$a\ authenticationHandler: org.apache.hugegraph.auth.WsAndHttpBasicAuthHandler,' \
-e '$a\ config: {tokens: conf/rest-server.properties}' \
-e '$a\}' ${CONF}/${GREMLIN_SERVER_CONF}
sed -i -e '$a\auth.authenticator=org.apache.hugegraph.auth.StandardAuthenticator' \
-e '$a\auth.graph_store=hugegraph' ${CONF}/${REST_SERVER_CONF}
sed -i 's/gremlin.graph=org.apache.hugegraph.HugeFactory/gremlin.graph=org.apache.hugegraph.auth.HugeFactoryAuthProxy/g' ${CONF}/graphs/${GRAPH_CONF}
fi

View File

@ -109,7 +109,7 @@ if [ -z "${HADOOP_GREMLIN_LIBS:-}" ]; then
fi fi
if [ -z "${JAVA_OPTIONS:-}" ]; then if [ -z "${JAVA_OPTIONS:-}" ]; then
JAVA_OPTIONS="-Dtinkerpop.ext=$EXT -Dlog4j.configurationFile=conf/log4j2.xml -Dgremlin.log4j.level=$GREMLIN_LOG_LEVEL -javaagent:$LIB/jamm-0.3.0.jar" JAVA_OPTIONS="-Dtinkerpop.ext=$EXT -Dlog4j.configurationFile=conf/log4j2.xml -Dgremlin.log4j.level=$GREMLIN_LOG_LEVEL -javaagent:$LIB/jamm-0.3.2.jar"
fi fi
if [ "$PROFILING_ENABLED" = true ]; then if [ "$PROFILING_ENABLED" = true ]; then

View File

@ -127,6 +127,7 @@ if [[ $JAVA_VERSION -gt 9 ]]; then
fi fi
# Using G1GC as the default garbage collector (Recommended for large memory machines) # Using G1GC as the default garbage collector (Recommended for large memory machines)
# mention: zgc is only available on ARM-Mac with java > 13
case "$GC_OPTION" in case "$GC_OPTION" in
g1|G1|g1gc) g1|G1|g1gc)
echo "Using G1GC as the default garbage collector" echo "Using G1GC as the default garbage collector"

View File

@ -17,10 +17,10 @@
# #
function command_available() { function command_available() {
local cmd=$1 local cmd=$1
if [ "$(command -v "$cmd" >/dev/null 2>&1)" ]; then if [[ -x "$(command -v "$cmd")" ]]; then
return 1
else
return 0 return 0
else
return 1
fi fi
} }
@ -131,6 +131,7 @@ function wait_for_startup() {
local stop_s=$((now_s + timeout_s)) local stop_s=$((now_s + timeout_s))
local status local status
local error_file_name="startup_error.txt"
echo -n "Connecting to $server_name ($server_url)" echo -n "Connecting to $server_name ($server_url)"
while [ "$now_s" -le $stop_s ]; do while [ "$now_s" -le $stop_s ]; do
@ -138,19 +139,28 @@ function wait_for_startup() {
process_status "$server_name" "$pid" >/dev/null process_status "$server_name" "$pid" >/dev/null
if [ $? -eq 1 ]; then if [ $? -eq 1 ]; then
echo "Starting $server_name failed" echo "Starting $server_name failed"
if [ -e "$error_file_name" ]; then
rm "$error_file_name"
fi
return 1 return 1
fi fi
status=$(curl -I -s -k -w "%{http_code}" -o /dev/null "$server_url") status=$(curl -I -sS -k -w "%{http_code}" -o /dev/null "$server_url" 2> "$error_file_name")
if [[ $status -eq 200 || $status -eq 401 ]]; then if [[ $status -eq 200 || $status -eq 401 ]]; then
echo "OK" echo "OK"
echo "Started [pid $pid]" echo "Started [pid $pid]"
if [ -e "$error_file_name" ]; then
rm "$error_file_name"
fi
return 0 return 0
fi fi
sleep 2 sleep 2
now_s=$(date '+%s') now_s=$(date '+%s')
done done
echo ""
cat "$error_file_name"
rm "$error_file_name"
echo "The operation timed out(${timeout_s}s) when attempting to connect to $server_url" >&2 echo "The operation timed out(${timeout_s}s) when attempting to connect to $server_url" >&2
return 1 return 1
} }
@ -267,15 +277,20 @@ function get_ip() {
function download() { function download() {
local path=$1 local path=$1
local link_url=$2 local download_url=$2
if command_available "curl"; then
if command_available "wget"; then if [ ! -d "$path" ]; then
mkdir -p "$path" || {
echo "Failed to create directory: $path"
exit 1
}
fi
curl -L "${download_url}" -o "${path}/$(basename "${download_url}")"
elif command_available "wget"; then
wget --help | grep -q '\--show-progress' && progress_opt="-q --show-progress" || progress_opt="" wget --help | grep -q '\--show-progress' && progress_opt="-q --show-progress" || progress_opt=""
wget "${link_url}" -P "${path}" $progress_opt wget "${download_url}" -P "${path}" $progress_opt
elif command_available "curl"; then
curl "${link_url}" -o "${path}"/"${link_url}"
else else
echo "Required wget or curl but they are unavailable" echo "Required curl or wget but they are unavailable"
exit 1 exit 1
fi fi
} }

View File

@ -1,18 +1,19 @@
#!/bin/bash #!/bin/bash
# #
# Copyright 2023 JanusGraph Authors # Licensed to the Apache Software Foundation (ASF) under one or more
# # contributor license agreements. See the NOTICE file distributed with this
# Licensed under the Apache License, Version 2.0 (the "License"); # work for additional information regarding copyright ownership. The ASF
# you may not use this file except in compliance with the License. # licenses this file to You under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance with the License.
# You may obtain a copy of the License at # You may obtain a copy of the License at
# #
# http://www.apache.org/licenses/LICENSE-2.0 # http://www.apache.org/licenses/LICENSE-2.0
# #
# Unless required by applicable law or agreed to in writing, software # Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS, # distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
# See the License for the specific language governing permissions and # License for the specific language governing permissions and limitations
# limitations under the License. # under the License.
# #
function abs_path() { function abs_path() {
@ -33,24 +34,43 @@ DETECT_STORAGE="$TOP/scripts/detect-storage.groovy"
. "$BIN"/util.sh . "$BIN"/util.sh
function key_exists {
local key=$1
local file_name=$2
grep -q -E "^\s*${key}\s*=\.*" ${file_name}
}
function update_key {
local key=$1
local val=$2
local file_name=$3
sed -ri "s#^(\s*${key}\s*=).*#\\1${val}#" ${file_name}
}
function add_key {
local key=$1
local val=$2
local file_name=$3
echo "${key}=${val}" >> ${file_name}
}
# apply config from env # apply config from env
while IFS=' ' read -r envvar_key envvar_val; do while IFS=' ' read -r envvar_key envvar_val; do
if [[ "${envvar_key}" =~ hugegraph\. ]] && [[ ! -z ${envvar_val} ]]; then if [[ "${envvar_key}" =~ hugegraph\. ]] && [[ -n ${envvar_val} ]]; then
envvar_key=${envvar_key#"hugegraph."} envvar_key=${envvar_key#"hugegraph."}
if grep -q -E "^\s*${envvar_key}\s*=\.*" ${GRAPH_CONF}; then if key_exists ${envvar_key} ${GRAPH_CONF}; then
sed -ri "s#^(\s*${envvar_key}\s*=).*#\\1${envvar_val}#" ${GRAPH_CONF} update_key ${envvar_key} ${envvar_val} ${GRAPH_CONF}
else else
echo "${envvar_key}=${envvar_val}" >> ${GRAPH_CONF} add_key ${envvar_key} ${envvar_val} ${GRAPH_CONF}
fi fi
else
continue
fi fi
done < <(env | sort -r | awk -F= '{ st = index($0, "="); print $1 " " substr($0, st+1) }') done < <(env | sort -r | awk -F= '{ st = index($0, "="); print $1 " " substr($0, st+1) }')
# wait for storage # wait for storage
if env | grep '^hugegraph\.' > /dev/null; then if env | grep '^hugegraph\.' > /dev/null; then
if ! [ -z "${WAIT_STORAGE_TIMEOUT_S:-}" ]; then if [ -n "${WAIT_STORAGE_TIMEOUT_S:-}" ]; then
timeout "${WAIT_STORAGE_TIMEOUT_S}s" bash -c \ timeout "${WAIT_STORAGE_TIMEOUT_S}s" bash -c \
"until bin/gremlin-console.sh -- -e $DETECT_STORAGE > /dev/null 2>&1; do echo \"waiting for storage...\"; sleep 5; done" "until bin/gremlin-console.sh -- -e $DETECT_STORAGE > /dev/null 2>&1; do echo \"Hugegraph server are waiting for storage backend...\"; sleep 5; done"
fi fi
fi fi