Go to file
Sergii Tkachenko d41d325ccb
buildscripts: simplify PSM interop Kokoro buildscripts (#11121) (#11164)
Integrates the new features of the the Kokoro PSM Interop install library introduced in grpc/psm-interop#73.

Nearly all common functionality was moved from per-language/per-branch PSM Interop build scripts to [psm_interop_kokoro_lib.sh](https://github.com/grpc/psm-interop/blob/main/.kokoro/psm_interop_kokoro_lib.sh):
1. The list of tests in the each test suite 
2. Per-test-suite flag customization
3. `run_test` methods
4. `build_docker_images_if_needed` methods
5. Generic `build_test_app_docker_images` methods (simple docker build + docker push + docker tag). grpc-java is one exception, as it doesn't run docker directly, but a cloudbuild flow.

Now all PSM Interop jobs share the same buildscripts by all test suites:
1.  buildscript that invokes the test: `psm-interop-test-{language}.sh` (configured as `build_file` in the build cfg)
2. buildscript that builds the xDS test client/server and publishes them as a Docker image: `psm-interop-build-{language}.sh` (conventional name called from `psm_interop_kokoro_lib.sh`)

`psm-interop-test-{language}.sh`:
1. Sets `GRPC_LANGUAGE`, `BUILD_SCRIPT_DIR` environment variables.
2. Downloads the shared `psm_interop_kokoro_lib.sh` from the main branch of the psm-interop repo.
3. Sources `psm-interop-build-{language}.sh`
4. Calls `psm::run "${PSM_TEST_SUITE}"` (`PSM_TEST_SUITE` configured in the cfg file).

`psm-interop-build-{language}.sh`:
1. Defines `psm::lang::build_docker_images` which is called from `psm_interop_kokoro_lib.sh`.
2. Invokes any repo-specific logic.
3. May use `psm::build::docker_images_generic` for generic Docker build, tag, push, or provide implement its own build/publish method.

References:
- b/288578634
- See the full list of the new features at grpc/psm-interop#73.
- Additional fixes to the shared lib: grpc/psm-interop#78, grpc/psm-interop#79
2024-05-06 16:11:15 -07:00
.github .github: Use checkout@v3 for Bazel 2023-08-03 07:28:22 -07:00
all Mark MultiChildLoadBalancer as Internal. (#10481) 2023-08-15 17:33:23 -07:00
alts all: generate automatic module name in the manifest (#10413) 2023-07-25 09:00:11 -07:00
android android: Min SDK level to 21 (#10505) 2023-08-22 10:47:31 -07:00
android-interop-testing android: Min SDK level to 21 (#10505) 2023-08-22 10:47:31 -07:00
api stablize ServerBuilder.handshakeTimeout (#10499) 2023-08-18 10:13:34 -07:00
auth all: generate automatic module name in the manifest (#10413) 2023-07-25 09:00:11 -07:00
authz Remove unneeded dependency excludes 2023-06-23 11:18:10 -07:00
benchmarks Upgrade to Gradle 8.2.1 and upgrade plugins 2023-08-02 13:29:44 -07:00
binder android: Min SDK level to 21 (#10505) 2023-08-22 10:47:31 -07:00
bom Revert "bom: Remove protoc-gen-grpc-java" 2022-05-09 10:28:32 -07:00
buildscripts buildscripts: simplify PSM interop Kokoro buildscripts (#11121) (#11164) 2024-05-06 16:11:15 -07:00
census all: generate automatic module name in the manifest (#10413) 2023-07-25 09:00:11 -07:00
compiler Bump version to 1.58.2-SNAPSHOT 2023-12-12 18:26:25 -08:00
context api, context: fix bazel build: export api from context and remove context dep from api (#10326) 2023-06-29 13:51:13 -07:00
core Bump version to 1.58.2-SNAPSHOT 2023-12-12 18:26:25 -08:00
cronet android: Min SDK level to 21 (#10505) 2023-08-22 10:47:31 -07:00
documentation Avoid repeating grpc version in Android documentation 2023-04-14 15:06:53 -07:00
examples Bump version to 1.58.2-SNAPSHOT 2023-12-12 18:26:25 -08:00
gae-interop-testing interop-testing: Correctly expose API types to dependents 2023-08-21 07:38:17 -07:00
gcp-observability all: generate automatic module name in the manifest (#10413) 2023-07-25 09:00:11 -07:00
googleapis all: generate automatic module name in the manifest (#10413) 2023-07-25 09:00:11 -07:00
gradle Upgrade to Gradle 8.3 2023-08-18 09:59:57 -07:00
grpclb Exclude Internal classes from javadoc 2023-08-16 15:38:30 -07:00
inprocess all: generate automatic module name in the manifest (#10413) 2023-07-25 09:00:11 -07:00
interop-testing interop-testing: Correctly expose API types to dependents 2023-08-21 07:38:17 -07:00
istio-interop-testing compiler: Use fully qualified String in codegen (#10321) 2023-06-29 10:50:13 -07:00
netty Exclude Internal classes from javadoc 2023-08-16 15:38:30 -07:00
okhttp okhttp: okhttp client and server transport should use padded length for flow control (#10422) 2023-08-16 15:12:19 -07:00
protobuf all: generate automatic module name in the manifest (#10413) 2023-07-25 09:00:11 -07:00
protobuf-lite all: generate automatic module name in the manifest (#10413) 2023-07-25 09:00:11 -07:00
rls Exclude Internal classes from javadoc 2023-08-16 15:38:30 -07:00
services Exclude Internal classes from javadoc 2023-08-16 15:38:30 -07:00
servlet servlet: Support configuration avoidance in build 2023-08-17 10:19:20 -07:00
stub Remove ThreadlessExecutor from BlockingServerStream (#10496) 2023-08-18 10:16:43 -07:00
testing testing: Stabilize GrpcCleanupRule, GrpcServerRule (#10494) 2023-08-16 18:33:58 -07:00
testing-proto all: generate automatic module name in the manifest (#10413) 2023-07-25 09:00:11 -07:00
util Exclude Internal classes from javadoc 2023-08-16 15:38:30 -07:00
xds xds: In tests, verify WRR static stride does not iterate too many times 2023-08-18 09:59:33 -07:00
.bazelignore bazel: ignore examples/ from root WORKSPACE 2018-12-18 14:54:57 -07:00
.bazelrc Upgrade Protobuf Java to 3.22.3 (aka 22.3) 2023-04-17 13:16:20 -07:00
.gitattributes gitattributes: Show diffs for golden generated code 2021-07-02 22:11:40 -07:00
.gitignore Port from Travis-CI to GitHub Actions 2021-06-17 13:32:56 -07:00
AUTHORS all: update to Apache 2 licence 2017-05-31 13:29:01 -07:00
BUILD.bazel bazel: Include `@Generated` dep for autovalue 2022-12-19 19:51:29 -05:00
CODE-OF-CONDUCT.md Update governance, contributing, code of conduct docs (#6171) 2019-09-20 16:28:42 -07:00
COMPILING.md COMPILING.md: Fix protobuf version number to 21.7 2022-10-10 16:06:52 -07:00
CONTRIBUTING.md CONTRIBUTING.md: Fix out-of-date CLA documentation 2020-12-09 14:32:57 -08:00
GOVERNANCE.md Update governance, contributing, code of conduct docs (#6171) 2019-09-20 16:28:42 -07:00
LICENSE fix LICENSE file (#3107) 2017-06-20 08:52:39 +02:00
MAINTAINERS.md MAINTAINERS.md: Add Binder maintainers 2022-11-29 13:01:53 -08:00
NOTICE.txt xds: rollback PGV dependency from using maven artifact to importing proto source 2020-03-27 17:09:27 -07:00
README.md README.md: Correct gradle protobuf reference from 3.22.3 to 3.24.0 (#10772) (#10790) 2024-01-02 14:42:57 -08:00
RELEASING.md RELEASING.md: Prefix grpc/grpc commit with [interop] 2023-08-14 10:55:49 -07:00
SECURITY.md Downgrade Netty to 4.1.93-Final 2023-07-21 17:41:41 -07:00
WORKSPACE all: Update netty to 4.1.77.Final and netty_tcnative to 2.0.53.Final (#9027) 2022-06-24 10:47:27 -07:00
build.gradle Bump version to 1.58.2-SNAPSHOT 2023-12-12 18:26:25 -08:00
codecov.yml Disable codecov comment and changes status 2016-05-01 22:39:12 -07:00
gradlew Bump to Gradle 7.3.3 2022-01-10 10:28:42 -08:00
gradlew.bat Bump to Gradle 7.3.3 2022-01-10 10:28:42 -08:00
java_grpc_library.bzl java_grpc_library.bzl: Allow toolchain to use annotation processors 2023-08-14 12:51:18 -07:00
repositories.bzl Upgrade protobuf-java and protoc to 3.24.0 2023-08-14 09:20:39 -07:00
run-test-client.sh Avoid interop build instructions when already built 2018-10-11 17:17:13 -07:00
run-test-server.sh Avoid interop build instructions when already built 2018-10-11 17:17:13 -07:00
settings.gradle Upgrade to Gradle 8.2.1 and upgrade plugins 2023-08-02 13:29:44 -07:00

README.md

gRPC-Java - An RPC library and framework

Homepage: grpc.io
Mailing List: grpc-io@googlegroups.com

Join the chat at https://gitter.im/grpc/grpc Build Status Line Coverage Status Branch-adjusted Line Coverage Status

Supported Platforms

gRPC-Java supports Java 8 and later. Android minSdkVersion 21 (Lollipop) and later are supported with Java 8 language desugaring.

TLS usage on Android typically requires Play Services Dynamic Security Provider. Please see the Security Readme.

Older Java versions are not directly supported, but a branch remains available for fixes and releases. See gRFC P5 JDK Version Support Policy.

Java version gRPC Branch
7 1.41.x

Getting Started

For a guided tour, take a look at the quick start guide or the more explanatory gRPC basics.

The examples and the Android example are standalone projects that showcase the usage of gRPC.

Download

Download the JARs. Or for Maven with non-Android, add to your pom.xml:

<dependency>
  <groupId>io.grpc</groupId>
  <artifactId>grpc-netty-shaded</artifactId>
  <version>1.58.1</version>
  <scope>runtime</scope>
</dependency>
<dependency>
  <groupId>io.grpc</groupId>
  <artifactId>grpc-protobuf</artifactId>
  <version>1.58.1</version>
</dependency>
<dependency>
  <groupId>io.grpc</groupId>
  <artifactId>grpc-stub</artifactId>
  <version>1.58.1</version>
</dependency>
<dependency> <!-- necessary for Java 9+ -->
  <groupId>org.apache.tomcat</groupId>
  <artifactId>annotations-api</artifactId>
  <version>6.0.53</version>
  <scope>provided</scope>
</dependency>

Or for Gradle with non-Android, add to your dependencies:

runtimeOnly 'io.grpc:grpc-netty-shaded:1.58.1'
implementation 'io.grpc:grpc-protobuf:1.58.1'
implementation 'io.grpc:grpc-stub:1.58.1'
compileOnly 'org.apache.tomcat:annotations-api:6.0.53' // necessary for Java 9+

For Android client, use grpc-okhttp instead of grpc-netty-shaded and grpc-protobuf-lite instead of grpc-protobuf:

implementation 'io.grpc:grpc-okhttp:1.58.1'
implementation 'io.grpc:grpc-protobuf-lite:1.58.1'
implementation 'io.grpc:grpc-stub:1.58.1'
compileOnly 'org.apache.tomcat:annotations-api:6.0.53' // necessary for Java 9+

For Bazel, you can either use Maven (with the GAVs from above), or use @io_grpc_grpc_java//api et al (see below).

Development snapshots are available in Sonatypes's snapshot repository.

Generated Code

For protobuf-based codegen, you can put your proto files in the src/main/proto and src/test/proto directories along with an appropriate plugin.

For protobuf-based codegen integrated with the Maven build system, you can use protobuf-maven-plugin (Eclipse and NetBeans users should also look at os-maven-plugin's IDE documentation):

<build>
  <extensions>
    <extension>
      <groupId>kr.motd.maven</groupId>
      <artifactId>os-maven-plugin</artifactId>
      <version>1.7.1</version>
    </extension>
  </extensions>
  <plugins>
    <plugin>
      <groupId>org.xolstice.maven.plugins</groupId>
      <artifactId>protobuf-maven-plugin</artifactId>
      <version>0.6.1</version>
      <configuration>
        <protocArtifact>com.google.protobuf:protoc:3.24.0:exe:${os.detected.classifier}</protocArtifact>
        <pluginId>grpc-java</pluginId>
        <pluginArtifact>io.grpc:protoc-gen-grpc-java:1.58.1:exe:${os.detected.classifier}</pluginArtifact>
      </configuration>
      <executions>
        <execution>
          <goals>
            <goal>compile</goal>
            <goal>compile-custom</goal>
          </goals>
        </execution>
      </executions>
    </plugin>
  </plugins>
</build>

For non-Android protobuf-based codegen integrated with the Gradle build system, you can use protobuf-gradle-plugin:

plugins {
    id 'com.google.protobuf' version '0.9.4'
}

protobuf {
  protoc {
    artifact = "com.google.protobuf:protoc:3.24.0"
  }
  plugins {
    grpc {
      artifact = 'io.grpc:protoc-gen-grpc-java:1.58.1'
    }
  }
  generateProtoTasks {
    all()*.plugins {
      grpc {}
    }
  }
}

The prebuilt protoc-gen-grpc-java binary uses glibc on Linux. If you are compiling on Alpine Linux, you may want to use the Alpine grpc-java package which uses musl instead.

For Android protobuf-based codegen integrated with the Gradle build system, also use protobuf-gradle-plugin but specify the 'lite' options:

plugins {
    id 'com.google.protobuf' version '0.9.4'
}

protobuf {
  protoc {
    artifact = "com.google.protobuf:protoc:3.24.0"
  }
  plugins {
    grpc {
      artifact = 'io.grpc:protoc-gen-grpc-java:1.58.1'
    }
  }
  generateProtoTasks {
    all().each { task ->
      task.builtins {
        java { option 'lite' }
      }
      task.plugins {
        grpc { option 'lite' }
      }
    }
  }
}

For Bazel, use the proto_library and the java_proto_library (no load() required) and load("@io_grpc_grpc_java//:java_grpc_library.bzl", "java_grpc_library") (from this project), as in this example BUILD.bazel.

API Stability

APIs annotated with @Internal are for internal use by the gRPC library and should not be used by gRPC users. APIs annotated with @ExperimentalApi are subject to change in future releases, and library code that other projects may depend on should not use these APIs.

We recommend using the grpc-java-api-checker (an Error Prone plugin) to check for usages of @ExperimentalApi and @Internal in any library code that depends on gRPC. It may also be used to check for @Internal usage or unintended @ExperimentalApi consumption in non-library code.

How to Build

If you are making changes to gRPC-Java, see the compiling instructions.

High-level Components

At a high level there are three distinct layers to the library: Stub, Channel, and Transport.

Stub

The Stub layer is what is exposed to most developers and provides type-safe bindings to whatever datamodel/IDL/interface you are adapting. gRPC comes with a plugin to the protocol-buffers compiler that generates Stub interfaces out of .proto files, but bindings to other datamodel/IDL are easy and encouraged.

Channel

The Channel layer is an abstraction over Transport handling that is suitable for interception/decoration and exposes more behavior to the application than the Stub layer. It is intended to be easy for application frameworks to use this layer to address cross-cutting concerns such as logging, monitoring, auth, etc.

Transport

The Transport layer does the heavy lifting of putting and taking bytes off the wire. The interfaces to it are abstract just enough to allow plugging in of different implementations. Note the transport layer API is considered internal to gRPC and has weaker API guarantees than the core API under package io.grpc.

gRPC comes with multiple Transport implementations:

  1. The Netty-based HTTP/2 transport is the main transport implementation based on Netty. It is not officially supported on Android.
  2. The OkHttp-based HTTP/2 transport is a lightweight transport based on Okio and forked low-level parts of OkHttp. It is mainly for use on Android.
  3. The in-process transport is for when a server is in the same process as the client. It is used frequently for testing, while also being safe for production use.
  4. The Binder transport is for Android cross-process communication on a single device.