Commit Graph

42 Commits

Author SHA1 Message Date
Jingyu Zhou cfcf0f152c Merge branch 'main-4a085fc84' into vv
Fix Conflicts:
	fdbclient/NativeAPI.actor.cpp
	fdbserver/ClusterRecovery.actor.cpp
	fdbserver/MasterInterface.h
	fdbserver/masterserver.actor.cpp
	flow/error_definitions.h
2022-03-30 22:28:06 -07:00
sfc-gh-tclinkenbeard a71099471b Update copyright header dates 2022-03-21 13:36:23 -07:00
Jingyu Zhou fe0c137975 Add version vector microbenchmark
This one measures cost of "getDelta" calls:

flowbench --benchmark_filter=bench_vv
2022-03-08T22:01:42+00:00
Running ./cbuild_output/bin/flowbench
Run on (32 X 1789.72 MHz CPU s)
CPU Caches:
  L1 Data 32 KiB (x16)
  L1 Instruction 32 KiB (x16)
  L2 Unified 1024 KiB (x16)
  L3 Unified 36608 KiB (x1)
Load Average: 0.33, 0.51, 1.05
--------------------------------------------------------------------------------------
Benchmark                            Time             CPU   Iterations UserCounters...
--------------------------------------------------------------------------------------
bench_vv_getdelta/16/1            33.9 ns         33.9 ns     20604111 Tags=16 getDeltaTimes=1 items_per_second=29.514M/s
bench_vv_getdelta/64/1            33.5 ns         33.5 ns     20989482 Tags=64 getDeltaTimes=1 items_per_second=29.8637M/s
bench_vv_getdelta/512/1           36.5 ns         36.5 ns     19703013 Tags=512 getDeltaTimes=1 items_per_second=27.3722M/s
bench_vv_getdelta/1024/1          35.2 ns         35.2 ns     19945561 Tags=1024 getDeltaTimes=1 items_per_second=28.4083M/s
bench_vv_getdelta/16/8            6340 ns         6340 ns       110117 Tags=16 getDeltaTimes=8 items_per_second=1.26184M/s
bench_vv_getdelta/64/8            7257 ns         7257 ns        96336 Tags=64 getDeltaTimes=8 items_per_second=1.10235M/s
bench_vv_getdelta/512/8          13844 ns        13844 ns        51522 Tags=512 getDeltaTimes=8 items_per_second=577.871k/s
bench_vv_getdelta/1024/8         34612 ns        34612 ns        20470 Tags=1024 getDeltaTimes=8 items_per_second=231.137k/s
bench_vv_getdelta/16/64         200514 ns       200513 ns         3498 Tags=16 getDeltaTimes=64 items_per_second=319.182k/s
bench_vv_getdelta/64/64         500066 ns       500057 ns         1000 Tags=64 getDeltaTimes=64 items_per_second=127.985k/s
bench_vv_getdelta/512/64        570166 ns       570131 ns         1222 Tags=512 getDeltaTimes=64 items_per_second=112.255k/s
bench_vv_getdelta/1024/64       747168 ns       747156 ns          939 Tags=1024 getDeltaTimes=64 items_per_second=85.6581k/s
bench_vv_getdelta/16/512       1749315 ns      1749305 ns          401 Tags=16 getDeltaTimes=512 items_per_second=292.688k/s
bench_vv_getdelta/64/512       6656289 ns      6656249 ns          105 Tags=64 getDeltaTimes=512 items_per_second=76.9202k/s
bench_vv_getdelta/512/512     36588584 ns     36588013 ns           19 Tags=512 getDeltaTimes=512 items_per_second=13.9937k/s
bench_vv_getdelta/1024/512    37691398 ns     37691154 ns           19 Tags=1024 getDeltaTimes=512 items_per_second=13.5841k/s
bench_vv_getdelta/16/1024      3616253 ns      3616233 ns          193 Tags=16 getDeltaTimes=1024 items_per_second=283.168k/s
bench_vv_getdelta/64/1024     13715322 ns     13715233 ns           51 Tags=64 getDeltaTimes=1024 items_per_second=74.6615k/s
bench_vv_getdelta/512/1024   112346008 ns    112344280 ns            6 Tags=512 getDeltaTimes=1024 items_per_second=9.11484k/s
bench_vv_getdelta/1024/1024  157170467 ns    157169544 ns            4 Tags=1024 getDeltaTimes=1024 items_per_second=6.51526k/s
2022-03-08 15:36:32 -08:00
sfc-gh-tclinkenbeard a32547cbbe Merge remote-tracking branch 'origin/main' into flow-enhancements 2022-02-15 15:56:42 -08:00
Ata E Husain Bohra 591ef57857
Upgrade AES 128 GCM -> AES 256, StreamCipher code refactor (#6314)
* Upgrade AES 128 GCM -> AES 256, StreamCipher code refactor

Major changes proposed are:
1. Refactor StreamCipher code to enable instantiation of
   multiple encryption keys. However, code still retains
   a globalEncryption key semantics used in Backup file
   encryption usecase.
2. Enhance StreamCipher to provide HMAC signature digest
   generation. Further, the class implements HMAC encryption
   key derivation function.
3. Upgrade StreamCipher to use AES 256 GCM mode from currently
   supported AES 128 GCM mode.
   Note: The code changes the encryption key size, however, the
         feature is NOT currently in use, hence, should be OK.
3. Add EncryptionOps validation and benchmark toml supported
   workload, it does the following:
   a. Allow user to configure encrypt-decrypt of a fixed size
      buffer or variable size buffer [100, 512K]
   b. Allow user to configure number of interactions of the runs,
      in each iteration: generate random data, derive an encryption
      key using HMAC SHA256 method, encrypt data and
      then decrypt data. It collects following metrics:
    i) time taken to derive encryption key.
    ii) time taken to encrypt the buffer.
    iii) time taken to decrypt the buffer.
    iv) total bytes encrypted and/or decrypted
   c. Along with stats it basic basic validations on the encrypted
      and decrypted buffer
   d. On completion for test, records the above mentioned metrics
      in trace files.
2022-01-31 19:52:44 -06:00
sfc-gh-tclinkenbeard c834778d3d Apply clang-format to BenchNet2.actor.cpp 2022-01-23 23:49:58 -08:00
Jon Fu 476aaa73c6 modify benchmark to avoid threadsleep and change runloop to process IO properly 2021-12-16 16:20:22 -05:00
Jon Fu 169838cec3 stub changes for IO queue and attempt at new benchmark 2021-12-16 13:28:38 -05:00
sfc-gh-tclinkenbeard a2bb14762a Some cleanup of BenchCallback.actor.cpp 2021-12-12 20:17:15 -08:00
sfc-gh-tclinkenbeard c1b480bedd Add bench_net2 benchmark to flowbench 2021-12-12 20:17:15 -08:00
sfc-gh-tclinkenbeard cde26d2d4f Add bench_callback to flowbench 2021-12-12 20:17:15 -08:00
Andrew Noyes 5b167729d2 Upgrade google benchmark to v1.6.0
This fixes a compile error with clang 13
2021-12-02 16:06:40 -08:00
Aaron Molitor a930039952 remove (cmake version and git detached head) warnings from build logs 2021-11-29 15:11:20 -08:00
sfc-gh-tclinkenbeard dbf7f9b047 Add some includes to BenchMem.cpp 2021-10-28 10:22:50 -07:00
sfc-gh-tclinkenbeard 628317b3b5 Separate out memory benchmarks in flowbench 2021-10-27 15:51:21 -07:00
FDB Formatster 2c788c233d apply clang-format to *.c, *.cpp, *.h, *.hpp files 2021-08-27 17:07:47 -07:00
Andrew Noyes 05853b97c5
Merge pull request #4920 from apple/anoyes/aarch64-memcmp
Use custom mem{cmp,cpy} impl on Arm
2021-08-26 14:30:05 -07:00
sfc-gh-tclinkenbeard 078d67d5fb Fix flowbench build 2021-06-26 20:19:22 -07:00
sfc-gh-tclinkenbeard 81b8292094 Merge remote-tracking branch 'origin' into encrypt-backup-files 2021-06-25 12:21:12 -07:00
Andrew Noyes 16e05fad9d Add custom memcpy for aarch64 2021-06-16 14:35:04 +00:00
Andrew Noyes b3d83e1b2e Use custom memcmp impl on Arm 2021-06-16 14:35:04 +00:00
sfc-gh-tclinkenbeard d038e5c9c0 Add include to BenchMetadataCheck.cpp 2021-06-02 21:28:37 -07:00
sfc-gh-tclinkenbeard e5d6c5ed17 Merge remote-tracking branch 'origin/master' into encrypt-backup-files 2021-05-03 14:46:19 -07:00
Andrew Noyes 656c9a6c47 Add benchmark and document entities touched 2021-04-26 17:46:35 +00:00
sfc-gh-tclinkenbeard a0c49234b2 Merge remote-tracking branch 'origin/master' into encrypt-backup-files 2021-03-19 20:47:53 -07:00
FDB Formatster df90cc89de apply clang-format to *.c, *.cpp, *.h, *.hpp files 2021-03-10 10:18:07 -08:00
sfc-gh-tclinkenbeard 0516b3823d Fix flowbench build 2021-02-05 00:08:08 -08:00
sfc-gh-tclinkenbeard 06e495737c Added BenchEncrypt 2021-01-25 13:44:55 -08:00
sfc-gh-tclinkenbeard e1ae23db34 Remove duplicate code from BenchHash.cpp 2020-11-21 19:50:44 -08:00
sfc-gh-tclinkenbeard 156a617ed8 Replace xxhash64 with xxhash3
The goal here is to improve performance
2020-11-21 18:25:35 -08:00
sfc-gh-tclinkenbeard bcda617b80 Benchmark hashing algorithms in flowbench 2020-11-17 23:14:55 -08:00
sfc-gh-tclinkenbeard 4669f837fa Add uses of makeReference 2020-11-07 22:10:18 -08:00
Andrew Noyes 21534a2867 Disable benchmark testing 2020-10-21 22:45:51 +00:00
Markus Pilman 5f1ee16706
Merge pull request #3890 from sfc-gh-tclinkenbeard/exclude-flowbench-from-all
Exclude flowbench target from all
2020-10-15 11:22:30 -06:00
sfc-gh-tclinkenbeard 4cbff14fcc Removed unnecessary comment 2020-10-13 10:43:57 -07:00
sfc-gh-tclinkenbeard 7ddbd1847d Exclude flowbench target from all 2020-10-10 15:03:53 -07:00
sfc-gh-tclinkenbeard cf5337daa0 Improve performance of metadata check in applyMetadataMutations 2020-10-10 14:45:04 -07:00
sfc-gh-tclinkenbeard 459a0e87ae Added BenchMetadataCheck.cpp 2020-10-10 14:45:00 -07:00
sfc-gh-tclinkenbeard a3c19bdf1b Added flowbench/README.md 2020-08-04 14:53:46 -07:00
sfc-gh-tclinkenbeard f79fbd0df6 Added bench_timer benchmark 2020-08-03 15:46:00 -07:00
sfc-gh-tclinkenbeard 39ebb2eeff Added bench_random benchmark 2020-08-03 15:45:53 -07:00
sfc-gh-tclinkenbeard 273d34be1a Renamed fdbbench to flowbench 2020-08-03 15:45:47 -07:00