Commit Graph

912 Commits

Author SHA1 Message Date
Evan Tschannen c87aa33941 Merge branch 'release-6.2'
# Conflicts:
#	CMakeLists.txt
#	bindings/go/src/fdb/generated.go
#	documentation/sphinx/source/api-common.rst.inc
#	documentation/sphinx/source/api-ruby.rst
#	documentation/sphinx/source/release-notes.rst
#	fdbclient/FailureMonitorClient.actor.cpp
#	fdbclient/NativeAPI.actor.cpp
#	fdbclient/vexillographer/fdb.options
#	fdbrpc/FlowTransport.actor.cpp
#	fdbserver/OldTLogServer_6_0.actor.cpp
#	fdbserver/TLogServer.actor.cpp
#	fdbserver/fdbserver.actor.cpp
#	versions.target
2020-04-23 13:47:53 -07:00
Evan Tschannen 8eef766546 update version to 6.2.21 2020-04-23 13:16:46 -07:00
Markus Pilman f967209ea0 Fix compiler warnings with clang 2020-04-22 14:14:56 -07:00
Markus Pilman 2f55ee12ef suppress Unsafe warning in java bindings
Fixes #3002
2020-04-22 14:14:24 -07:00
Evan Tschannen 1c04aa5f0c
Merge pull request #2958 from AlvinMooreSr/go-getter
Get Go Dependencies Before Installing
2020-04-22 10:38:02 -07:00
A.J. Beamon b6e22b4a63
Merge pull request #2998 from jleach4/2822
Fix #2822: ByteArrayUtil does not use the now standard Unsafe Approach for byte[] comparisons
2020-04-21 14:36:13 -07:00
John Leach 7f75eab32b Fix #2822: ByteArrayUtil does not use the now standard Unsafe Approach for byte[] comparisons. 2020-04-21 12:20:12 -07:00
A.J. Beamon 251e0201a1
Merge pull request #2809 from jleach4/2808
2808: Add caching for jmethodID, jfieldID and jclass for JNI for Java Binding
2020-04-21 11:52:13 -07:00
A.J. Beamon 71c0d52868
Revert "Fix #2822: ByteArrayUtil does not use the now standard Unsafe Approach for byte[] comparisons." 2020-04-21 10:50:33 -07:00
John Leach d41dca5a94 2808: Add caching for jmethodID, jfieldID and jclass for JNI for Java Binding 2020-04-21 10:29:23 -07:00
John Leach 3834d8ecec Fix #2822: ByteArrayUtil does not use the now standard Unsafe Approach for byte[] comparisons. 2020-04-21 10:13:52 -07:00
Vishesh Yadav 841af731c5
go: Rename deprecated fdb_future_get_version to fdb_future_get_int64 2020-04-16 09:58:50 -07:00
Vishesh Yadav b6b9f13016
Merge branch 'master' into ryanworl/remove-finalizers 2020-04-16 01:01:00 -07:00
Alvin Moore d555fbb853 Changed the get to only get the dependencies 2020-04-15 09:07:12 -07:00
Alvin Moore ed8e5bc64f Added support for getting go dependencies before install source 2020-04-15 08:46:37 -07:00
Alvin Moore 54813e2d46 Added support for copying fdb java tests to package directory 2020-04-13 17:20:25 -07:00
Markus Pilman d4542dbb5a Delete old build system 2020-04-07 11:03:45 -07:00
A.J. Beamon c11b9d0721 Including port in addresses option is deprecated in 630 rather than 700. Includes other latent generated go changes to the documentation. 2020-04-07 08:51:15 -07:00
Markus Pilman cb8d5d9b41 fixed flow bindings includes 2020-04-06 10:34:26 -07:00
Markus Pilman 8b5780c36c don't include source and binary dir
This forces users to use include paths from the sources root.

So `#include "Arena.h"` won't work anymore, only
`#include "flow/Arena.h"` will.
2020-04-06 10:13:49 -07:00
Balachandar Namasivayam 6d570cd865 Change version from 7.0 to 6.3 2020-04-03 21:38:58 -07:00
Markus Pilman bbd2fe62cc Merge branch 'master' of github.com:apple/foundationdb into features/boost70 2020-04-02 09:21:01 -07:00
Jingyu Zhou ae480c14a3 Add documentation of get_approximate_size for Python, Ruby, and Go
This was missed from original PR #1756, where only C API was documented.
2020-03-31 13:42:02 -07:00
Meng Xu 60f6edc3b5
Merge pull request #2860 from zjuLcg/report-conflicting-key-roll-forward
Report conflicting key roll forward
2020-03-30 17:33:56 -07:00
Markus Pilman 28cd38913d Merge branch 'master' of github.com:apple/foundationdb into features/boost70 2020-03-27 13:44:10 -07:00
Markus Pilman ac9f79116e Build bindingtester 2020-03-26 16:01:58 -07:00
Xin Dong 353fcb2096 Update Go binding documentations for the new API to be consistent with others 2020-03-25 10:02:38 -07:00
Andrew Noyes 289487559d Revert "Revert "Merge pull request #2257 from zjuLcg/report-conflicting-key""
This reverts commit 804fe1b22e.
2020-03-24 18:11:15 -07:00
Xin Dong 5876d694cb Use snake case to be consistent with conventions 2020-03-24 13:26:59 -07:00
Xin Dong 69b572cc86 Added specs for the new tests. 2020-03-24 09:59:40 -07:00
Xin Dong 338c62b176 Moved up the new test cases to comply the convention there. 2020-03-24 09:53:52 -07:00
Xin Dong 527686ffe0 Added a test in API tests for the new API(getEstimagedRangeSize). 2020-03-24 09:26:56 -07:00
Meng Xu 980037f3a8
Merge pull request #2835 from bnamasivayam/revert-report-conflicting-keys
Revert report conflicting keys
2020-03-20 10:33:26 -07:00
Xin Dong f293666028 Added back unnecessary changes. 2020-03-20 10:12:37 -07:00
Xin Dong 851ee20c1a Disable Ruby tests for the moment. 2020-03-20 10:05:14 -07:00
Balachandar Namasivayam 804fe1b22e Revert "Merge pull request #2257 from zjuLcg/report-conflicting-key"
This reverts commit 648dc4a933, reversing
changes made to 487d131b38.
2020-03-19 21:34:28 -07:00
chaoguang 698198a09e Merge remote-tracking branch 'upstream/master' into report-conflicting-key 2020-03-09 10:50:33 -07:00
Evan Tschannen 303df197cf Merge branch 'release-6.2'
# Conflicts:
#	CMakeLists.txt
#	bindings/c/test/mako/mako.c
#	documentation/sphinx/source/release-notes.rst
#	fdbbackup/backup.actor.cpp
#	fdbclient/NativeAPI.actor.cpp
#	fdbclient/NativeAPI.actor.h
#	fdbserver/DataDistributionQueue.actor.cpp
#	fdbserver/Knobs.cpp
#	fdbserver/Knobs.h
#	fdbserver/LogRouter.actor.cpp
#	fdbserver/SkipList.cpp
#	fdbserver/fdbserver.actor.cpp
#	flow/CMakeLists.txt
#	flow/Knobs.cpp
#	flow/Knobs.h
#	flow/flow.vcxproj
#	flow/flow.vcxproj.filters
#	versions.target
2020-03-06 18:22:46 -08:00
Alex Miller f657ca069e Fix bindings build breakage, because I hadn't built bindings. 2020-03-04 23:51:21 -08:00
Alex Miller 9b5ef3416e Refactor TLSParams into TLSConfig + LoadedTLSConfig
The idea being that we keep around a TLSConfig that the configuration
that the user has provided, and then when we want to intialize an SSL
context, we ask the TLSConfig to load all certificates and return us a
LoadedTLSConfig that is a concrete set of certificate bytes in memory.

initTLS now just takes the in-memory bytes and applies them to the ssl
context.

This is a large refactor to lead up into certificate refeshing, where we
will periodically check for changes to the certificates, and then
re-load them and apply them to a new SSL context.
2020-03-04 20:14:47 -08:00
chaoguang 7a76e9556d Merge remote-tracking branch 'upstream/master' into report-conflicting-key 2020-03-04 11:24:39 -08:00
Evan Tschannen 6054c05963 Merge branch 'release-6.2'
# Conflicts:
#	CMakeLists.txt
#	documentation/sphinx/source/release-notes.rst
#	fdbserver/fdbserver.actor.cpp
#	versions.target
2020-02-28 12:11:05 -08:00
Andrew Noyes fd180e242d Fix heap buffer overflow in mako 2020-02-28 11:10:42 -08:00
A.J. Beamon 93655c92e8 Add missing semicolon 2020-02-26 16:36:22 -08:00
A.J. Beamon 0f5c999d4b Better containment of boost errors related to TLS. 2020-02-26 12:26:43 -08:00
Alvin Moore 0f64505d0b Merge branch 'release-6.2' of github.com:apple/foundationdb
Needed to pull in changes to build docker
2020-02-23 23:27:53 -08:00
Evan Tschannen 96258b9809 Merge branch 'release-6.2'
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
#	fdbcli/fdbcli.actor.cpp
#	fdbclient/ManagementAPI.actor.cpp
#	fdbrpc/FlowTransport.actor.cpp
#	fdbserver/ClusterController.actor.cpp
#	fdbserver/DataDistribution.actor.cpp
#	fdbserver/DataDistribution.actor.h
#	fdbserver/DataDistributionQueue.actor.cpp
#	fdbserver/KeyValueStoreMemory.actor.cpp
#	fdbserver/MasterProxyServer.actor.cpp
#	fdbserver/QuietDatabase.actor.cpp
#	fdbserver/SkipList.cpp
#	fdbserver/StorageMetrics.actor.h
#	fdbserver/TLogServer.actor.cpp
#	fdbserver/fdbserver.actor.cpp
#	fdbserver/storageserver.actor.cpp
#	fdbserver/workloads/KVStoreTest.actor.cpp
#	flow/CMakeLists.txt
#	flow/Knobs.cpp
#	flow/Knobs.h
#	flow/genericactors.actor.cpp
#	flow/serialize.h
2020-02-21 19:09:16 -08:00
A.J. Beamon 7eed0f11b9
Update bindings/java/src/main/com/apple/foundationdb/directory/DirectoryLayer.java
Fix conversion of byte to long.
2020-02-21 16:27:12 -08:00
A.J. Beamon 7fbdd4e4fe Fix: directory layer was unpacking little endian numbers without properly handling signs. 2020-02-21 15:42:34 -08:00
Evan Tschannen f04e311a1e Merge commit 'b46d6e25e24993ab5a5f04091fd3235050b7cd09' into feature-boost-ssl
# Conflicts:
#	fdbserver/SimulatedCluster.actor.cpp
#	flow/Net2.actor.cpp
2020-02-20 17:36:38 -08:00
Alex Miller 927cff3317 Report errors on TLS misconfigurations ... or at least try to. 2020-02-20 16:57:29 -08:00
A.J. Beamon d1f050690a
Merge pull request #2454 from ajbeamon/document-range-read-efficiency
Document efficiency of reverse range reads
2020-02-20 15:25:38 -08:00
Evan Tschannen 761da5a059 code cleanup 2020-02-19 17:59:45 -08:00
Alex Miller 3b9c38f40d Fix fdb_flow_tester linker error 2020-02-19 14:32:20 -08:00
Andrew Noyes 40c9e2f3d8 Add -no_weak_exports 2020-02-18 10:49:43 -08:00
A.J. Beamon a3ba22b8a2
Merge pull request #2635 from daniilguit/master
Java Binding: add option to not close network thread on shutdown hook
2020-02-15 10:43:18 -08:00
A.J. Beamon 649fc6ba94
Merge pull request #2329 from davisp/trace-clock-source-network-option
Add network option for the trace clock source
2020-02-15 10:43:00 -08:00
Paul J. Davis 32e285a761 Add network option for the trace clock source
This option allows clients to select the clock source for trace events
similar to the `--traceclock` command line parameter for `fdbserver`.
Using the `realtime` clock sources makes loading event data into
OpenTracing systems like Jaeger more useful.
2020-02-15 11:30:43 -06:00
Daniil GItelson f6a282223c Java Binding: FDB.shutdownHook documentation update 2020-02-15 20:18:14 +03:00
Markus Pilman ccf590e193 Merge branch 'master' of github.com:apple/foundationdb into features/boost70 2020-02-14 22:05:51 -08:00
mpilman 3a1e878a9b Upgrade to boost 1.72 2020-02-14 18:10:13 -08:00
A.J. Beamon d8e8d13269
Merge pull request #2620 from sevki/mac-linking
bindings/go: explicit CFLAGS and LDFLAGS for macOS and windows
2020-02-14 14:04:10 -08:00
Andrew Noyes e1f279ac98 Use the cmake LINKER feature
Described here: https://cmake.org/cmake/help/latest/command/add_link_options.html
2020-02-13 16:50:17 -08:00
Andrew Noyes aeba8f5caf Fix symbolify.py 2020-02-13 16:50:17 -08:00
Andrew Noyes f1357fd482 Control exported symbols on osx for cmake 2020-02-13 16:50:17 -08:00
Andrew Noyes b1b57aae05 Port ld arguments from Makefile 2020-02-13 16:50:17 -08:00
Xin Dong f43a5d614a Removed unnecessary codes in Java bindings. Cleaned up Go bindings a bit. 2020-02-12 14:57:40 -08:00
Xin Dong 6534539733 Fix the Go bindings build failure. 2020-02-12 14:57:40 -08:00
Xin Dong 2e1d03cbe7 Addressed AJ's review comments 2020-02-12 14:57:40 -08:00
Xin Dong bd19dd278e Apply suggestions from code review
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
2020-02-12 14:57:40 -08:00
Xin Dong d20ce99774 Resolved the review comment and renamed the functions 2020-02-12 14:57:40 -08:00
Xin Dong 5d30296db8 Alright this time fix the go build for real. 2020-02-12 14:57:40 -08:00
Xin Dong 3777b099ef Fix Go bindings build failure 2020-02-12 14:57:40 -08:00
Xin Dong 85c10d13a5 Exposed the byte sample function to the following bindings:
- Flow
- Java
- Go [ needs verify ]
- Python [ needs verify ]
- Ruby [ needs verify ]
2020-02-12 14:57:40 -08:00
Xin Dong 0c16d43c2f Added necessary plumbings to expose byte sample collected by storage servers to fdb_c library 2020-02-12 14:57:40 -08:00
mpilman 5a9d420cb7 Merge remote-tracking branch 'upstream/release-6.2' into release-merges/20200210 2020-02-10 10:02:05 -08:00
Markus Pilman e71fe44ee3
Merge branch 'master' into features/icc 2020-02-08 21:33:02 -08:00
Evan Tschannen 38d8d0d675 fixed simulation 2020-02-06 19:29:31 -08:00
Alex Miller 986905f3dd
Update bindings/python/tests/tester.py
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
2020-02-06 16:57:14 -08:00
Evan Tschannen 8449badb3e
Merge pull request #1868 from dongxinEric/fix/1827/error_instead_of_timeout
Send error back before put the GRV request with PRIORITY_BATCH into t…
2020-02-04 14:32:47 -08:00
Daniil GItelson 00a1d2c17c Java Binding: introduce FDB.disableShutdownHook 2020-02-04 23:19:36 +03:00
Daniil GItelson 25304e3587 Merge with official repository master 2020-02-04 21:53:05 +03:00
mpilman d09e07f1f5 Merge remote-tracking branch 'upstream/master' into features/icc 2020-02-04 10:26:18 -08:00
Vishesh Yadav becc01923a
Merge pull request #2626 from ajbeamon/update-api-version-to-700
Update API version to 700
2020-02-03 09:49:24 -08:00
Daniil GItelson a38827b4e6 Java Binding: add option to not close network thread on shutdown hook 2020-02-02 21:10:23 +03:00
Xin Dong e21426d12a Send error back to the GRV requests with batch priority when the cluster is saturated, instead of blindly enqueue the requests and let the client timeout. 2020-01-30 14:13:56 -08:00
A.J. Beamon 72f92626e4 Update API version to 700 2020-01-30 09:26:27 -08:00
sevki 53e388b993 bindings/go: explicit CFLAGS and LDFLAGS for windows
Added a windows specific version of this too.

Fixes:  #2299
2020-01-30 17:23:58 +00:00
A.J. Beamon 35b54672b7 Change FDBKeyValue's key and value members to have type uint8_t*. 2020-01-30 08:49:23 -08:00
sevki f35b586052 bindings/go: explicit CFLAGS and LDFLAGS for macOS
When applied these changes will tell the CGO toolchain on macOS
the default installation location for the headers and libs.

I've recently started playing around with FDB go bindings on my mac.
I've followed the tutorial to set everything up but whilst doing so
I've started getting some error messages like so:

     /Users/sevki/go/pkg/mod/github.com/apple/foundationdb/bindings/go@v0.0.0-20200125010749-6945a6ea0141/src/fdb/cluster.go:26:11: fatal error: 'foundationdb/fdb_c.h' file not found
      #include <foundationdb/fdb_c.h>
                ^~~~~~~~~~~~~~~~~~~~~~

These errors are most probably caused by me unsetting LDFLAGS, CFLAGS
globally as the installer installs the header files and the libraries
to sane default locations.

However, I believe explicitly telling the CGO toolchain here is a
better experience for using this library. While unsetting LDFLAGS
and CFLAGS is not a very smart thing to do, some IDEs and other build
tools make it very hard to pass environment variables to set in this
context.
2020-01-30 13:54:54 +00:00
Xin Dong 68f6e7be97 Added some java docs and changed some texts in fdboptions for further comparision and clarification around .asList() and .iterator() 2020-01-29 14:01:54 -08:00
Vishesh Yadav bfcdf6bc88
Merge pull request #2243 from canardleteer/go-pack-with-versionstamp
Add PackWithVersionstamp to Go Subpace & Directory bindings.
2020-01-27 08:34:20 -08:00
Alex Miller 4ceae8c83a Ban generators in 7.0.0 2020-01-23 16:40:14 -08:00
Vishesh Yadav b5c1c8cdd0
Merge pull request #2560 from ajbeamon/java-bindingtester-error-retry
Add retry loop to Java binding tester instruction reader
2020-01-23 09:54:43 -08:00
Alex Miller 62baf6d121 Merge remote-tracking branch 'upstream/master' into pyfdbgenerators 2020-01-22 18:05:05 -08:00
Sam Gwydir 7662273cd8 clang-format mako 2020-01-17 14:43:02 -08:00
A.J. Beamon 389ea1ca64
Merge pull request #2514 from kaomakino/kaomakino/mako
Add periodical debug transaction tracing
2020-01-17 13:28:19 -08:00
A.J. Beamon 341e74eaf2 Add retry loop to Java binding tester instruction reader 2020-01-17 11:59:44 -08:00
Kao Makino c5908a2adb Add periodical debug transaction tracing and parameterize trace format 2020-01-17 10:33:09 -08:00
Alex Miller 8a44c5e08d
Merge pull request #2469 from vishesh/task/documentation
godoc: How to check for non-existing keys from Go bindings
2020-01-16 14:55:52 -08:00