Commit Graph

1279 Commits

Author SHA1 Message Date
Chaoguang Lin 20f0a5a1f2 Disable multiprocess fdbcli tests while debugging flakiness 2021-08-02 21:55:07 +00:00
Andrew Noyes 353efe7db2
Merge pull request #5264 from sfc-gh-tclinkenbeard/fix-more-clang-warnings
Enable more warnings for `clang`
2021-07-29 15:43:54 -07:00
Chaoguang Lin 9eec9376bd
Merge pull request #5285 from sfc-gh-clin/refactor-throttle-command
Refactor throttle command
2021-07-28 13:43:15 -07:00
sfc-gh-tclinkenbeard 94a65865d9 Merge remote-tracking branch 'origin/master' into fix-clang-warnings 2021-07-28 12:29:27 -07:00
sfc-gh-tclinkenbeard c74047c665 Merge remote-tracking branch 'origin/master' into fix-more-clang-warnings 2021-07-28 11:51:02 -07:00
A.J. Beamon 9f571255bd
Merge pull request #5271 from sfc-gh-ajbeamon/do-not-reset-committed-transaction
Do not partially reset a transaction when it is committed or fails to commit with an error
2021-07-28 09:02:54 -07:00
Russell Sears 82603ff764
Merge pull request #5211 from hfu5/repeat-m
Add RepeatableReadMultiThreadClientTest
2021-07-27 18:57:22 -07:00
QA Hoang aae3305a55 added retry txn for FDB_ERROR_RETRY 2021-07-27 18:09:47 -07:00
Chaoguang Lin e5933dee7e Add test coverage for throttle 2021-07-27 17:28:59 +00:00
QA Hoang 7f76a434f7 added transaction retry to mako populate mode 2021-07-26 21:18:56 -07:00
QA Hoang e0513a55f8 added transaction retry to mako clean mode 2021-07-26 20:57:58 -07:00
A.J. Beamon 34f82e7a15 Do not partially reset a transaction when it is committed or fails to commit with an error. 2021-07-26 09:51:44 -07:00
sfc-gh-tclinkenbeard 36703decee Merge remote-tracking branch 'origin/master' into fix-clang-warnings 2021-07-26 09:32:29 -07:00
Clement Pang 9af401b205 Add comments to orEqual() 2021-07-24 09:10:46 +08:00
sfc-gh-tclinkenbeard b9a22a61ef Fix many -Wreorder-ctor warnings 2021-07-23 17:33:18 -07:00
Clement Pang 9496e12861 Make orEquals() public.
Addresses the easy issue for https://github.com/apple/foundationdb/issues/5190
2021-07-23 12:03:17 +08:00
sfc-gh-tclinkenbeard e62e6503ac Fix most delete-non-virtual-dtor clang warnings 2021-07-21 23:32:44 -07:00
Chaoguang Lin 6bf5df6cc5 Update comments in fdbcli_tests.py 2021-07-21 18:38:13 +00:00
Chaoguang Lin 0b6d43fa6f Fix exclude test and re-enable it in ctest 2021-07-21 18:36:05 +00:00
Markus Pilman 4fcdd298b4 Merge remote-tracking branch 'sfc/bugfixes/macos-literal-string' into bugfixes/macos-literal-string 2021-07-20 16:28:28 -06:00
Markus Pilman 01bad1f84d Merge remote-tracking branch 'origin/master' into bugfixes/macos-literal-string 2021-07-20 16:24:52 -06:00
Chaoguang Lin e5dc677f00
Merge pull request #5238 from sfc-gh-clin/extend-fdbclient-test-for-multiple-processes
Disable test for exclude for now which can time out sometime
2021-07-20 14:18:38 -07:00
Chaoguang Lin f48a2b52f1 Disable test for exclude for now which can time out sometime 2021-07-20 20:44:46 +00:00
Markus Pilman b760087d5f
Update bindings/c/test/mako/mako.c 2021-07-20 13:27:40 -06:00
Markus Pilman 8f6b048e22 fix macOS build 2021-07-20 11:52:57 -06:00
hao fu e8f0c3c98a Add RepeatableReadMultiThreadClientTest
Add RepeatableReadMultiThreadClientTest to verify transactions
have repeatable read.
2021-07-17 18:02:44 -07:00
hao fu 492722b719 Setup cycleTest in the same txn
In order to have multiple threads running against same cluster, this has to be done.
2021-07-16 17:23:25 -07:00
Hao Fu d003e3e5aa
Merge pull request #5197 from hfu5/sb-master
Add SidebandMultiThreadClientTest
2021-07-16 11:41:53 -07:00
hao fu ba3e6ecb8c Add SidebandMultiThreadClientTest
This test validates causal consistency for multi-threaded client
2021-07-16 09:45:49 -07:00
Chaoguang Lin c8e18f99f0
Merge pull request #5185 from sfc-gh-clin/extend-fdbclient-test-for-multiple-processes
Extend cmake fdbclient_test for multiple processes
2021-07-15 14:34:04 -07:00
Chaoguang Lin 3552080266 Update some comments of the change 2021-07-15 16:38:04 +00:00
Chaoguang Lin 4659c028f5 Add test coverage for coordinators command 2021-07-15 08:18:37 +00:00
Chaoguang Lin 07882d809d Add test coverage for exclude command 2021-07-15 07:19:25 +00:00
Chaoguang Lin 932058e64b Add tests for fdbcli commands running against multi-process cluster 2021-07-14 22:37:07 +00:00
Hao Fu 19d86efa7a Cherry pick 871b098e95 from 6.3
Change the version to 710.

Add CycleMultiClientIntegrationTest
2021-07-14 15:36:53 -04:00
Russell Sears c42815f15f
Merge pull request #5127 from vishesh/cherrypick
Making it possible to run a multiple-cluster Java integration test (cherry-pick of #4456 from 6.3)
2021-07-13 09:14:20 -07:00
Scott Fines d1db0d4013 Making it possible to run a multiple-cluster Java integration test 2021-07-07 10:15:18 -07:00
sfc-gh-tclinkenbeard 9c1e154481 Merge remote-tracking branch 'origin/master' into remove-boost-dependencies 2021-06-28 13:54:39 -07:00
Chaoguang Lin 3d438dfe6d Update suspend test to avoid flaky results 2021-06-25 01:09:44 +00:00
Chaoguang Lin cd594be0f8 Update setclass' test to have random class type and use the specific network address 2021-06-23 23:40:34 +00:00
sfc-gh-tclinkenbeard a424abe5c2 Remove some boost dependencies 2021-06-21 13:46:04 -07:00
Chaoguang Lin c4c78410ed update comments 2021-06-17 18:36:33 +00:00
Chaoguang Lin ecff680b47 Merge branch 'master' of github.com:apple/foundationdb into add-fdbcli-tests 2021-06-17 00:29:41 +00:00
Chaoguang Lin 9a4bfd48aa Add test coverage for consistencycheck, cache_range, datadistribution, lock, unlock, setclass, suspend and all transaction related fdbcli commands 2021-06-17 00:28:07 +00:00
A.J. Beamon a370776e9b
Merge pull request #4930 from apple/anoyes/external-clients-in-fdb-java
Add exportLibrary for exporting external clients from jar
2021-06-15 15:36:08 -07:00
Sam Gwydir dd0d99ab10 FDBCORE-617: Allocate mako prefix on stack 2021-06-10 14:25:04 -07:00
Sam Gwydir 127fc6c09c FDBCORE-617: Add mako option to prepend padding 2021-06-09 17:13:02 -07:00
Andrew Noyes b92b930b93 Add exportLibrary for exporting external clients from jar
After this change, users would be able to add all fdb shared libraries
they need in the jar itself with something like `jar uf`.
2021-06-08 17:23:02 -07:00
Jingyu Zhou e34df983ee
Merge pull request #4800 from sfc-gh-tclinkenbeard/remove-extra-copies
Remove unnecessary temporary objects while growing objects of type std::vector<std::pair<A, B>>
2021-06-07 13:23:50 -07:00
sfc-gh-tclinkenbeard 371a38e6e5 Merge remote-tracking branch 'origin/master' into remove-extra-copies 2021-06-07 10:26:06 -07:00
Andrew Noyes 5d2d4622f6
Update bindings/c/test/unit/unit_tests_version_510.cpp 2021-06-07 09:40:26 -07:00
Andrew Noyes 0beb548e99
Improve comments 2021-06-05 17:10:41 -07:00
Andrew Noyes cd5c0481cc Use linker script for external workloads
This fixes an issue on Arm with lld:

ld.lld: error: relocation R_AARCH64_PREL64 cannot be used against symbol OPENSSL_armcap_P; recompile with -fPIC

I think the problem was that lld thought that the shared object might
need to interpose OPENSSL_armcap_P at runtime, although honestly I'm not
too sure about all this linker stuff.
2021-06-05 14:43:50 -07:00
Andrew Noyes 311da4b07a Explain requirements for fdb_c.g.S implementations 2021-06-05 14:43:50 -07:00
Andrew Noyes 34529c353c Try to fix arm build on clang 2021-06-05 14:42:30 -07:00
Chaoguang Lin a5e69c269a remove unused header, fix the CMake rule 2021-06-04 20:44:49 +00:00
Chaoguang Lin b57ed906c4 Update comments 2021-06-04 01:36:03 +00:00
Chaoguang Lin 4cc90fb0e9 Update comments, fix typos 2021-06-04 01:17:09 +00:00
Chaoguang Lin 6eff38ebf7 Remove some unnecessary code 2021-06-04 00:58:23 +00:00
Chaoguang Lin e6ff1d75eb Add interactive tests for fdbcli commands using a python script 2021-06-04 00:37:25 +00:00
Andrew Noyes 7cdd43c352 Handle retriable errors better in fdb_c_unit_tests 2021-05-25 16:45:24 +00:00
Andrew Noyes e892ca00e4 Use proper string equality 2021-05-14 00:03:03 +00:00
Andrew Noyes 4163270c02 Put aarch64 libfdb_java in the right place for fat jar 2021-05-13 23:13:14 +00:00
sfc-gh-tclinkenbeard f28ac955c3 Remove unnecessary temporary objects while growing objects of type std::vector<std::pair<A, B>> 2021-05-10 16:32:50 -07:00
Edwin Zhang 3d9619790d Fix OPEN_FOR_IDE option for cmake 2021-05-07 17:54:59 -04:00
Jingyu Zhou 3ce31cb347 Upgrade api version from 700 to 710 2021-05-05 21:15:00 -07:00
Sam Gwydir 45c79ecc17 Mako should be able to set loggroup 2021-05-03 21:18:07 -07:00
A.J. Beamon 823873a9aa Address review comments:
Use nullptr instead of NULL
Use const& for a parameter
Add some comments
2021-04-26 14:39:27 -07:00
A.J. Beamon a794fca932 Support 5.0 (and earlier) client versions by adding GRV probing for old versions. Update the C bindings implementation of get_server_protocol to convert the ProtocolVersion object into a uint64_t. Rename a misleading protocol version alias. 2021-04-23 15:00:21 -07:00
A.J. Beamon eaaae2e16d Merge branch master into 'feature-mvc-monitor-protocol-version' 2021-04-20 15:07:02 -07:00
A.J. Beamon 4a1a55f270 Remove fdb_get_server_protocol from the Python bindings. This C function this was using recently moved and changed signature, so it no longer works in Python. 2021-04-16 13:48:44 -07:00
A.J. Beamon b2d6930103 The multi-version client monitors the cluster's protocol version and only activates the client library that can connect. 2021-04-15 11:45:14 -07:00
A.J. Beamon d3b6a543ab Update comment in unit test 2021-04-14 13:23:06 -07:00
A.J. Beamon bc8568d4bb Use the correct pointer in the unit test for fdb_database_get_server_protocol 2021-04-14 12:58:59 -07:00
A.J. Beamon 3ed0d614d2 Move fdb_get_server_protocol to be a function on the database object. Add an argument for expected_version that can be used to signal that the function shouldn't return unless the protocol version is different. 2021-04-14 12:50:30 -07:00
A.J. Beamon b2ee928a15
Merge pull request #4564 from sfc-gh-nwijetunga/network_busyness_java_api
Network Busyness Java API
2021-04-12 14:38:01 -07:00
Vishesh Yadav 8627fa1f16
Merge pull request #4597 from scottfines/no_string_format
Removing String.format from ByteArrayUtil.printable.
2021-04-09 10:59:28 -07:00
Scott Fines 275e650a80 Disabling tests that don't really work in the ctest development environment. They aren't important tests anyway 2021-04-02 11:09:08 -05:00
Scott Fines ef1b924f07 Removing String.format from ByteArrayUtil.printable.
String.format can be potentially expensive, and if using `printable()`
within a hot loop that can be a performance penalty. Admittedly, it
doesn't seem like a good idea to call printable() from within a hot
loop, but if you have to, it's good for it to perform well.
2021-03-31 09:31:38 -05:00
Nim Wijetunga bdccf8bc80 fix formatting issues 2021-03-25 00:11:11 +00:00
Nim Wijetunga a84592df7e add test for network busyness 2021-03-24 23:59:40 +00:00
Nim Wijetunga 21f1e1d5de add comment 2021-03-24 23:38:42 +00:00
Nim Wijetunga b5412b355e Add Java API for network busyness 2021-03-24 23:34:34 +00:00
A.J. Beamon ed811008ca
Merge pull request #4504 from sfc-gh-nwijetunga/network_busyness
Monitor Network Thread Busyness
2021-03-24 09:44:09 -07:00
Nim Wijetunga de1c354b12 address pr comments 2021-03-23 20:56:37 +00:00
Andrew Noyes 0acd2a1e13 Work around fdbmonitor/tsan problem
I don't fully understand what's going on here, but I want to run with tsan enabled
2021-03-18 23:21:46 +00:00
Nim Wijetunga 0afacf4997 Merge branch 'master' of github.com:sfc-gh-nwijetunga/foundationdb into network_busyness
* 'master' of github.com:sfc-gh-nwijetunga/foundationdb:
  Update example Dockerfile (#4488)
  Add aarch64 support in CentOS7 Dockerfile (#4483)
  Add a comment back
  Port lost PR #4166 back
  change macro and format file
2021-03-18 19:03:06 +00:00
Nim Wijetunga 73571ad52e Merge branch 'master' of github.com:sfc-gh-nwijetunga/foundationdb into network_busyness
* 'master' of github.com:sfc-gh-nwijetunga/foundationdb: (55 commits)
  Port lost changes from #4004
  Fix markdown
  Factor our refreshTransaction gadget
  Align FastAllocator memory to 4096 for size >= 4096
  Fix heap-use-after-free's
  Disable lsan in joshua
  Manually apply changes made to BackupContainer.actor.cpp on release-6.3 to the new files where that code is located.
  add release branch instructions
  Fix PR number in release note link
  fixed a simulation bug where a process on an unreliable machine would be considered reliable by the simulator
  Add tini as PID 1 to docker image (#4363)
  Fix typo
  Fix broken_promise bug
  Explain FastAllocator<4096> special case
  Inform LSAN that we have unaligned pointers
  apply clang-format to flow/Platform.h
  Fix typos
  Address review comments
  Change the macro that forbids exit() calls to be a static assertion
  Add versionstamp serialization information
  ...
2021-03-18 18:58:43 +00:00
Andrew Noyes fbe5c81b33 Block until future is ready in test 2021-03-18 18:24:12 +00:00
Andrew Noyes 0919eff187 Fix data race in fdb_get_server_protocol 2021-03-18 18:24:12 +00:00
A.J. Beamon ee2584b520
Merge pull request #4498 from sfc-gh-mpilman/bugfix/format-fdbc
Fix clang-format issue with fdb_c.h
2021-03-18 09:16:18 -07:00
Nim Wijetunga ea922aa648 address pr comments 2021-03-17 18:16:18 +00:00
Nim Wijetunga bf5f83d2bf address pr comments 2021-03-16 21:49:36 +00:00
Nim Wijetunga 5f079904d4 add unit test 2021-03-16 18:30:39 +00:00
Nim Wijetunga f0d79b3d86 Inital implementation of network busyness 2021-03-15 23:23:56 +00:00
Markus Pilman ebcc69f512 change macro and format file 2021-03-15 15:17:22 -06:00
Andrew Noyes a76c7b9754 Fix several memory leaks and a thread leak 2021-03-11 23:58:32 +00:00
Vishesh Yadav 2cd3f45fd6 Merge remote-tracking branch 'apple/release-6.3' into master-format-final
release-6.3 was recently merged, and there were two PRs which were
merged in between and got those changes in here. Hence, since all the
changes were in, discarded the incoming changes and accepted all
current.
2021-03-10 16:50:44 -08:00
FDB Formatster df90cc89de apply clang-format to *.c, *.cpp, *.h, *.hpp files 2021-03-10 10:18:07 -08:00
Vishesh Yadav 2bb4f2e59f Merge branch 'release-6.3-pre-format' into master-format
This merges release-6.3 branch right before it was fully formatted.
There were quite a few conflicts that are resolved here. CoroFlow had
a check for OOM errors introduced in 6.3, but didn't seem applicable in
the new implmentation which seems to use boost.
2021-03-10 09:37:41 -08:00