wbtiger
/
foundationdb
mirror of https://github.com/apple/foundationdb.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
foundationdb/tests/fast
History
Ata E Husain Bohra 9c649d7880
EaR: Configurable encryption framework (#9271) 
* EaR: Configurable encryption framework

Description

EaR implementation only supports fixed size on-disk encryption header format.
One drawback of the scheme is, introducing a newer encryption scheme as well
as updating header format in future may incur data migration restrictions.
Major changes proposed in the patch includes:
1. Flexible Encryption header format allowing the following:
 1.1. Header flags (metadata) can evolve separately from the encryption algorithm
 1.2. Specific encryption algorithm header to allow future extensions.
2. Update the BlobCipher encryption/decryption util classes to work with newer
encryption header format.
3. Continue supporting multiple encryption authentication schemes such as:
HMAC-SHA and AES-CMAC; also, supports no encryption-authentication schemes.
4. Refactor BlobCipher unit test to enable testing of new format.
5. Configuration knobs to control encryption header flags and algorithm
versions.

Note: 
The on-disk header storage footprint savings due to the newer scheme is as follows:
1. No encryption authentication: 54% smaller compared to existing implementation.
3. AES-CMAC: 16% smaller compared to existing implementation.
3. HMAC-SHA encryption authentication: almost same size.


Testing

BlobCipherTest
EncryptionOpsTest
 		2023-02-08 22:51:05 -08:00
..
AtomicBackupCorrectness.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
AtomicBackupToDBCorrectness.toml Apply suggestions from code review 2023-01-10 16:57:54 -08:00
AtomicOps.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
AtomicOpsApiCorrectness.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
AuthzSecurity.toml Minimize the risk of TracedTooManyLines in simulation 2023-02-06 21:50:39 +01:00
AutomaticIdempotency.toml Automatically clean old idempotency ids (#9039) 2022-12-14 14:24:24 -08:00
BackupAzureBlobCorrectness.toml implemented testClass and testPriority 2022-08-22 09:57:44 -06:00
BackupCorrectness.toml implemented testClass and testPriority 2022-08-22 09:57:44 -06:00
BackupCorrectnessClean.toml implemented testClass and testPriority 2022-08-22 09:57:44 -06:00
BackupCorrectnessWithEKPKeyFetchFailures.toml Handle EKP Tenant Not Found Errors (#9261) 2023-02-01 19:15:38 -08:00
BackupCorrectnessWithTenantDeletion.toml Snapshot Backup Tenant Deletion Support (#9145) 2023-01-26 17:46:14 -08:00
BackupS3BlobCorrectness.toml implemented testClass and testPriority 2022-08-22 09:57:44 -06:00
BackupToDBCorrectness.toml toml file format 2023-01-10 23:13:55 -08:00
BackupToDBCorrectnessClean.toml toml file format 2023-01-10 23:13:55 -08:00
BlobCipherUnitTest.toml EaR: Configurable encryption framework (#9271) 2023-02-08 22:51:05 -08:00
BlobGranuleMoveVerifyCycle.toml implemented testClass and testPriority 2022-08-22 09:57:44 -06:00
BlobGranuleVerifyAtomicOps.toml implemented testClass and testPriority 2022-08-22 09:57:44 -06:00
BlobGranuleVerifyCycle.toml implemented testClass and testPriority 2022-08-22 09:57:44 -06:00
BlobGranuleVerifySmall.toml implemented testClass and testPriority 2022-08-22 09:57:44 -06:00
BlobGranuleVerifySmallClean.toml implemented testClass and testPriority 2022-08-22 09:57:44 -06:00
BlobRestoreBasic.toml Add data verification at the end of BlobRestoreBasic.toml 2023-01-10 13:26:36 -08:00
BlobRestoreLarge.toml Add correct test for blob restore with large workload 2023-01-18 09:27:48 -08:00
CacheTest.toml Significantly lower the expected rate in the cache test 2022-03-16 15:26:43 -07:00
ChangeFeedOperations.toml scaling back ChangeFeedOperationsMove to avoid TraceTooManyLines (#7958) 2022-08-29 15:30:22 -05:00
ChangeFeedOperationsMove.toml scaling back ChangeFeedOperationsMove to avoid TraceTooManyLines (#7958) 2022-08-29 15:30:22 -05:00
ChangeFeeds.toml implemented testClass and testPriority 2022-08-22 09:57:44 -06:00
CloggedSideband.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
CompressionUtilsUnit.toml BlobFile Encryption and compression support 2022-07-14 17:04:14 -07:00
ConfigIncrement.toml Add workload to test coordinator changes with dynamic knobs 2022-09-13 16:53:54 -07:00
ConfigIncrementChangeCoordinators.toml Add workload to test coordinator changes with dynamic knobs 2022-09-13 16:53:54 -07:00
ConfigIncrementWithKills.toml Add workload to test coordinator changes with dynamic knobs 2022-09-13 16:53:54 -07:00
ConfigureLocked.toml allow simulation properties to be overwritten 2021-05-20 13:48:41 -06:00
ConstrainedRandomSelector.toml Make sure only uppercase characters follow underscore in test titles 2020-11-08 14:30:55 -08:00
CycleAndLock.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
CycleTest.toml Addressed review comments, added test 2022-03-15 16:57:26 +01:00
DataLossRecovery.toml Lower ASAN memory usage (#9216) 2023-01-24 13:04:47 -08:00
EncryptKeyProxyTest.toml Commit Proxy uses Encryption DB Config (#8911) 2022-12-12 21:23:55 -08:00
EncryptedBackupCorrectness.toml Handle EKP Tenant Not Found Errors (#9261) 2023-02-01 19:15:38 -08:00
EncryptionOps.toml EaR: Configurable encryption framework (#9271) 2023-02-08 22:51:05 -08:00
FuzzApiCorrectness.toml change tenantModes option to accept array of string 2022-10-20 11:44:03 -07:00
FuzzApiCorrectnessClean.toml change tenantModes option to accept array of string 2022-10-20 11:44:03 -07:00
GetEstimatedRangeSize.toml change tenantModes option to accept array of string 2022-10-20 11:44:03 -07:00
GetMappedRange.toml GetMappedRange support serializable & check RYW & continuation (#6181) 2022-03-10 10:05:44 -08:00
IDDTxnProcessorMoveKeys.toml wait on lock take 2022-11-09 11:34:47 -08:00
IDDTxnProcessorRawStartMovement.toml wait on lock take 2022-11-09 11:34:47 -08:00
IncrementTest.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
IncrementalBackup.toml change test spec 2020-10-12 15:28:21 -04:00
IncrementalBackupWithEKPKeyFetchFailures.toml Handle EKP Tenant Not Found Errors (#9261) 2023-02-01 19:15:38 -08:00
IncrementalBackupWithTenantDeletion.toml Tenant Deletion Support for Backup Mutation Log (#9103) 2023-01-18 15:11:58 -08:00
InventoryTestAlmostReadOnly.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
InventoryTestSomeWrites.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
KillRegionCycle.toml allow simulation properties to be overwritten 2021-05-20 13:48:41 -06:00
LocalRatekeeper.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
LongStackWriteDuringRead.toml allow simulation properties to be overwritten 2021-05-20 13:48:41 -06:00
LowLatency.toml allow simulation properties to be overwritten 2021-05-20 13:48:41 -06:00
LowLatencySingleClog.toml Increase max latency for LowLatencySingleClog test 2021-07-19 22:34:27 -07:00
MemoryLifetime.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
MoveKeysCycle.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
MutationLogReaderCorrectness.toml Check in the prototype of MutationLogReader. 2021-08-18 14:59:50 -07:00
PerpetualWiggleStats.toml finish workload PerpetualWiggleStatsWorkload 2022-11-08 08:14:21 -08:00
PhysicalShardMove.toml Disable shard aware (#8072) 2022-09-02 09:07:34 -07:00
PrivateEndpoints.toml Addressed review comments, added test 2022-03-15 16:57:26 +01:00
ProtocolVersion.toml allow simulation properties to be overwritten 2021-05-20 13:48:41 -06:00
RESTKmsConnectorUnit.toml REST KmsConnector implementation (#6994) 2022-05-07 13:18:35 -07:00
RESTUtilsUnit.toml REST KmsConnector implementation (#6994) 2022-05-07 13:18:35 -07:00
RandomSelector.toml Make sure only uppercase characters follow underscore in test titles 2020-11-08 14:30:55 -08:00
RandomUnitTests.toml Run 10 unit tests within RandomUnitTests.toml 2022-09-11 00:36:18 -07:00
RawTenantAccessClean.toml set clearAfterTest=false in RawTenantAccessClean test 2023-02-02 13:26:56 -08:00
ReadHotDetectionCorrectness.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
ReportConflictingKeys.toml allow simulation properties to be overwritten 2021-05-20 13:48:41 -06:00
SelectorCorrectness.toml Make sure only uppercase characters follow underscore in test titles 2020-11-08 14:30:55 -08:00
Sideband.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
SidebandSingle.toml Clone sideband workload to check consistency of cache 2021-12-02 14:17:59 -05:00
SidebandWithStatus.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
SimpleAtomicAdd.toml fix spacing and newlines at ends of files 2020-09-28 16:32:20 -04:00
SpecialKeySpaceCorrectness.toml change tenantModes option to accept array of string 2022-10-20 11:44:03 -07:00
SpecialKeySpaceRobustness.toml Add a new robustness workload for testing special keys (#8957) 2022-12-05 14:05:26 -08:00
StorageServerCheckpointRestore.toml Ss shard management (#7340) 2022-07-22 09:30:44 -07:00
StreamingRangeRead.toml rename test file 2021-09-20 13:58:05 -07:00
SwizzledRollbackSideband.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
SystemRebootTestCycle.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
TaskBucketCorrectness.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
TenantCycle.toml Minimize the risk of TracedTooManyLines in simulation 2023-02-06 21:50:39 +01:00
TenantCycleTokenless.toml Minimize the risk of TracedTooManyLines in simulation 2023-02-06 21:50:39 +01:00
TenantEntryCache.toml change tenantModes option to accept array of string 2022-10-20 11:44:03 -07:00
TimeKeeperCorrectness.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
TxnStateStoreCycleTest.toml When clearing the database between tests, check that clearing the tenant left the entire normal key-space empty. Update the configuration of some tests. Disable a special key-space test that is invoking broken behavior. 2022-04-14 11:39:02 -07:00
UDP.toml minor bug fixes 2020-08-06 16:56:38 -06:00
Unreadable.toml Rewrite most .txt tests into (pretty) .toml files. 2020-07-12 14:47:40 -07:00
ValidateStorage.toml Validate Storage part II (#8471) 2023-01-15 21:46:14 -08:00
VersionStamp.toml fixed conflicts with tests 2020-08-31 21:18:49 -07:00
Watches.toml resolve pr comments 2021-02-09 17:56:30 -05:00
WriteDuringRead.toml allow simulation properties to be overwritten 2021-05-20 13:48:41 -06:00
WriteDuringReadClean.toml allow simulation properties to be overwritten 2021-05-20 13:48:41 -06:00