Go to file
Tom Leach b9d1bb8b8b core: initialize round robin load balancer picker to random index (#4462)
RoundRobinLoadBalancerFactory creates a new Picker instance every time the set of provided address groups changes or the connection state of subchannels associated with existing address groups changes. In certain scenarios, such as deployment/replacement of the target service cluster, this can lead to high churn of Picker objects. Given that each new Picker's subchannel index is initialized to zero, in these scenarios requests can end up getting disproportionately routed through subchannels (and hence server nodes) which are earlier in the list of address groups.

At Netflix we have measured that some service nodes end up taking 3-4x the load that of other nodes during deployment.

This commit randomizes the start index of the RoundRobinLoadBalancerFactory.Picker which eliminates this behavior.
2018-08-01 13:15:17 -07:00
.github all: update github issue template 2017-11-16 18:43:19 -08:00
all all: add gradle format checker 2018-06-11 18:35:18 -07:00
alts alts: add call credential security level attribute (#4657) 2018-07-19 10:55:22 -07:00
android android: include proguard config to keep method names (#4667) 2018-07-23 15:51:19 -07:00
android-interop-testing gradle: Use config_loc in checkstyle 2018-07-30 10:51:54 -07:00
auth auth: Small improvement to test coverage 2018-07-31 15:13:21 -07:00
benchmarks compiler,stub: update RpcMethod docs and usage 2018-07-12 17:01:47 -07:00
buildscripts gradle: Use config_loc in checkstyle 2018-07-30 10:51:54 -07:00
compiler Start 1.15.0 development cycle (#4650) 2018-07-18 10:48:04 -07:00
context context: Avoid deprecated Truth API 2018-07-20 14:48:44 -07:00
core core: initialize round robin load balancer picker to random index (#4462) 2018-08-01 13:15:17 -07:00
cronet Start 1.15.0 development cycle (#4650) 2018-07-18 10:48:04 -07:00
documentation Start 1.15.0 development cycle (#4650) 2018-07-18 10:48:04 -07:00
examples Upgrade Gradle to 4.9 2018-07-26 13:43:50 -07:00
gae-interop-testing gae-interop-testing: Disable special_status_message 2018-07-30 09:19:47 -07:00
gradle/wrapper Upgrade Gradle to 4.9 2018-07-26 13:43:50 -07:00
grpclb grpclb: remove unnecessary support for lb delegation 2018-07-24 13:00:49 -07:00
interop-testing interop-testing: Add special_status_message test 2018-07-26 14:56:35 -07:00
netty netty: Remove option to pass promise to WriteQueue 2018-07-30 11:34:58 -07:00
okhttp Propagate EquivalentAddressGroup attributes to transports 2018-07-09 13:00:17 -07:00
protobuf all: add tracking issues for all experimental APIs and make it required 2018-07-31 15:28:48 -07:00
protobuf-lite protobuf{,lite,nano}: make more classes final 2018-06-19 15:30:12 -07:00
protobuf-nano protobuf{,lite,nano}: make more classes final 2018-06-19 15:30:12 -07:00
services all: add tracking issues for all experimental APIs and make it required 2018-07-31 15:28:48 -07:00
stub all: add tracking issues for all experimental APIs and make it required 2018-07-31 15:28:48 -07:00
testing Propagate EquivalentAddressGroup attributes to transports 2018-07-09 13:00:17 -07:00
testing-proto compiler,stub: update RpcMethod docs and usage 2018-07-12 17:01:47 -07:00
.gitattributes Add native support for Protobuf Lite 2016-03-22 15:40:51 -07:00
.gitignore Partial fix for fresh Intellij import 2017-12-15 08:42:39 -08:00
.travis.yml travis.yml: Actually trigger coveralls 2018-07-30 12:44:35 -07:00
AUTHORS all: update to Apache 2 licence 2017-05-31 13:29:01 -07:00
BUILD.bazel all: normalize copyright header 2018-05-03 14:55:21 -07:00
COMPILING.md COMPILING.md: Added note for IntelliJ building (#3958) 2018-01-11 13:58:03 -08:00
CONTRIBUTING.md CONTRIBUTING.md: Add reference to COMPILING.md 2018-07-31 13:49:09 -07:00
LICENSE fix LICENSE file (#3107) 2017-06-20 08:52:39 +02:00
NOTICE.txt all: normalize copyright header 2018-05-03 14:55:21 -07:00
README.md all: update readme to point to 1.14 2018-07-31 12:19:20 -07:00
RELEASING.md RELEASING.md: Remove manual artifact documentation 2018-07-12 14:18:11 -07:00
SECURITY.md all: update to netty 4.1.27 and tcnative 2.0.12 2018-07-20 16:36:00 -07:00
WORKSPACE all: rename Bazel workspace to io_grpc_grpc_java 2018-02-22 13:59:45 -08:00
build.gradle gradle: Use config_loc in checkstyle 2018-07-30 10:51:54 -07:00
codecov.yml Disable codecov comment and changes status 2016-05-01 22:39:12 -07:00
gradlew all: update to gradle 4.0.1 2017-07-12 10:07:14 -07:00
gradlew.bat all: update to gradle 3.2 2016-11-23 14:43:18 -08:00
java_grpc_library.bzl Bazel: Fix compilation in Java 9 2018-04-26 14:37:57 -07:00
repositories.bzl bazel: Remove http_file trick for neverlink 2018-07-30 13:23:56 -07:00
run-test-client.sh interop-testing: -PskipCodegen requires =true 2016-11-01 14:45:40 -07:00
run-test-server.sh interop-testing: -PskipCodegen requires =true 2016-11-01 14:45:40 -07:00
settings.gradle all: add gradle format checker 2018-06-11 18:35:18 -07:00

README.md

gRPC-Java - An RPC library and framework

gRPC-Java works with JDK 6. gRPC-Java clients are supported on Android API levels 14 and up (Ice Cream Sandwich and later). Deploying gRPC servers on an Android device is not supported.

TLS usage typically requires using Java 8, or Play Services Dynamic Security Provider on Android. Please see the Security Readme.

Homepage: grpc.io
Mailing List: grpc-io@googlegroups.com

Join the chat at https://gitter.im/grpc/grpc Build Status Coverage Status

Download

Download the JARs. Or for Maven with non-Android, add to your pom.xml:

<dependency>
  <groupId>io.grpc</groupId>
  <artifactId>grpc-netty</artifactId>
  <version>1.14.0</version>
</dependency>
<dependency>
  <groupId>io.grpc</groupId>
  <artifactId>grpc-protobuf</artifactId>
  <version>1.14.0</version>
</dependency>
<dependency>
  <groupId>io.grpc</groupId>
  <artifactId>grpc-stub</artifactId>
  <version>1.14.0</version>
</dependency>

Or for Gradle with non-Android, add to your dependencies:

compile 'io.grpc:grpc-netty:1.14.0'
compile 'io.grpc:grpc-protobuf:1.14.0'
compile 'io.grpc:grpc-stub:1.14.0'

For Android client, use grpc-okhttp instead of grpc-netty and grpc-protobuf-lite or grpc-protobuf-nano instead of grpc-protobuf:

compile 'io.grpc:grpc-okhttp:1.14.0'
compile 'io.grpc:grpc-protobuf-lite:1.14.0'
compile 'io.grpc:grpc-stub:1.14.0'

Development snapshots are available in Sonatypes's snapshot repository.

For protobuf-based codegen, you can put your proto files in the src/main/proto and src/test/proto directories along with an appropriate plugin.

For protobuf-based codegen integrated with the Maven build system, you can use protobuf-maven-plugin (Eclipse and NetBeans users should also look at os-maven-plugin's IDE documentation):

<build>
  <extensions>
    <extension>
      <groupId>kr.motd.maven</groupId>
      <artifactId>os-maven-plugin</artifactId>
      <version>1.5.0.Final</version>
    </extension>
  </extensions>
  <plugins>
    <plugin>
      <groupId>org.xolstice.maven.plugins</groupId>
      <artifactId>protobuf-maven-plugin</artifactId>
      <version>0.5.1</version>
      <configuration>
        <protocArtifact>com.google.protobuf:protoc:3.5.1-1:exe:${os.detected.classifier}</protocArtifact>
        <pluginId>grpc-java</pluginId>
        <pluginArtifact>io.grpc:protoc-gen-grpc-java:1.14.0:exe:${os.detected.classifier}</pluginArtifact>
      </configuration>
      <executions>
        <execution>
          <goals>
            <goal>compile</goal>
            <goal>compile-custom</goal>
          </goals>
        </execution>
      </executions>
    </plugin>
  </plugins>
</build>

For protobuf-based codegen integrated with the Gradle build system, you can use protobuf-gradle-plugin:

apply plugin: 'java'
apply plugin: 'com.google.protobuf'

buildscript {
  repositories {
    mavenCentral()
  }
  dependencies {
    // ASSUMES GRADLE 2.12 OR HIGHER. Use plugin version 0.7.5 with earlier
    // gradle versions
    classpath 'com.google.protobuf:protobuf-gradle-plugin:0.8.3'
  }
}

protobuf {
  protoc {
    artifact = "com.google.protobuf:protoc:3.5.1-1"
  }
  plugins {
    grpc {
      artifact = 'io.grpc:protoc-gen-grpc-java:1.14.0'
    }
  }
  generateProtoTasks {
    all()*.plugins {
      grpc {}
    }
  }
}

How to Build

If you are making changes to gRPC-Java, see the compiling instructions.

Navigating Around the Source

Here's a quick readers' guide to the code to help folks get started. At a high level there are three distinct layers to the library: Stub, Channel & Transport.

Stub

The Stub layer is what is exposed to most developers and provides type-safe bindings to whatever datamodel/IDL/interface you are adapting. gRPC comes with a plugin to the protocol-buffers compiler that generates Stub interfaces out of .proto files, but bindings to other datamodel/IDL should be trivial to add and are welcome.

Key Interfaces

Stream Observer

Channel

The Channel layer is an abstraction over Transport handling that is suitable for interception/decoration and exposes more behavior to the application than the Stub layer. It is intended to be easy for application frameworks to use this layer to address cross-cutting concerns such as logging, monitoring, auth etc. Flow-control is also exposed at this layer to allow more sophisticated applications to interact with it directly.

Common

Client

Server

Transport

The Transport layer does the heavy lifting of putting and taking bytes off the wire. The interfaces to it are abstract just enough to allow plugging in of different implementations. Transports are modeled as Stream factories. The variation in interface between a server Stream and a client Stream exists to codify their differing semantics for cancellation and error reporting.

Note the transport layer API is considered internal to gRPC and has weaker API guarantees than the core API under package io.grpc.

gRPC comes with three Transport implementations:

  1. The Netty-based transport is the main transport implementation based on Netty. It is for both the client and the server.
  2. The OkHttp-based transport is a lightweight transport based on OkHttp. It is mainly for use on Android and is for client only.
  3. The inProcess transport is for when a server is in the same process as the client. It is useful for testing.

Common

Client

Server

Examples

The examples and the Android example are standalone projects that showcase the usage of gRPC.

Tools

APIs annotated with @Internal are for internal use by the gRPC library and should not be used by gRPC users. APIs annotated with @ExperimentalApi are subject to change in future releases, and library code that other projects may depend on should not use these APIs. We recommend using the grpc-java-api-checker (an Error Prone plugin) to check for usages of @ExperimentalApi and @Internal in any library code that depends on gRPC. It may also be used to check for @Internal usage or unintended @ExperimentalApi consumption in non-library code.