Performance summary
We have tested different environments to capture performance metrics for the CipherTrust Cloud Key Manager (CCKM) SAP HYOK integration. The performance results provided in this document demonstrate the effects of deployment choices on throughput for SAP HYOK key encrypt operations for a single key. This information can help you plan your CipherTrust Manager deployment to meet your performance needs for SAP HYOK integration.
All environments used an open source k6.io tool as the REST client to simulate decrypt requests from SAP HYOK keystores.
Note
Actual performance numbers in your environment may vary. Results can be affected by factors such as how and where CipherTrust Manager is deployed, CipherTrust Manager resources, the location of the cloud KMS, the chosen key source, network connectivity between CipherTrust Manager, the SAP HYOK cloud, and the key source, as well as traffic load balancing.
This document, may at times, abbreviate CipherTrust Manager as CM.
Tested environments
The following deployments were tested:
The following CipherTrust Manager release version was employed in the tested deployments:
Description | Value |
---|---|
Release version | 2.19 |
Test process
The test involved initiating a specified number of virtual users to execute decrypt operations on the SAP HYOK key. Each user simulated a separate thred. The overall test duration was 40 seconds for each measurement.
SAP HYOK deployment results
Ciphertrust Manager and K6 client are on-premises
8 CPU and 32 GB of RAM
AES 256
Here are the details of this deployment:
CM details
CM location | Instance type | CM configuration | K6 configuration | Source |
---|---|---|---|---|
SanJose lab | Single instance | 8 CPU and 32 GB of RAM | 8 CPU, 64 GB of RAM, and 50 GB of HDD | CipherTrust Manager |
Results
Virtual users | Run time (seconds) | Operations/seconds | Time taken (P90) (seconds) |
---|---|---|---|
50 | 258261 | 6456.403302/s | 11.72ms |
100 | 274106 | 6852.293799/s | 23.29ms |
500 | 290678 | 7266.610219/s | 132.08ms |
1000 | 224596 | 5614.615807/s | 374.35ms |
1500 | 181726 | 4542.750677/s | 616.21ms |
2000 | 142906 | 3572.175774/s | 901.43ms |
2500 | 140123 | 3502.709969/s | 1.39s |
3000 | 129907 | 3247.410589/s | 1.41s |
3500 | 134380 | 3256.95097/s | 1.99s |
4000 | 130210 | 3254.810601/s | 2.18s |
4500 | 125323 | 3132.726926/s | 3.24s |
5000 | 118720 | 2967.116548/s | 3.13s |
RSA 3072
Here are the details of this deployment:
CM details
CM location | Instance type | CM configuration | K6 configuration | Source |
---|---|---|---|---|
SanJose lab | Single instance | 8 CPU and 32 GB of RAM | 8 CPU, 64 GB of RAM, and 50 GB of HDD | CipherTrust Manager |
Results
Virtual users | Run time (seconds) | Operations/seconds | Time taken (P90) (seconds) |
---|---|---|---|
50 | 156528 | 3913.040581/s | 20.6ms |
100 | 152526 | 3812.714006/s | 49.08ms |
500 | 150716 | 3767.640616/s | 337.02ms |
1000 | 150426 | 3760.349458/s | 664.3ms |
1500 | 147588 | 3689.546761/s | 900.07ms |
2000 | 147604 | 3689.767328/s | 1.17s |
2500 | 143257 | 3581.039336/s | 1.5s |
3000 | 143555 | 3588.491304/s | 1.72s |
3500 | 141136 | 3527.709941/s | 2.03s |
4000 | 133552 | 3338.011651/s | 2.45s |
4500 | 139536 | 3487.773784/s | 2.55s |
5000 | 139462 | 3485.846827/s | 2.78s |
5500 | 137031 | 3425.280997/s | 3.13s |
6000 | 135121 | 3370.446977/s | 3.38s |
6500 | 113849 | 2841.926664/s | 3.88s |
7000 | 77689 | 1941.661116/s | 5.25s |
7500 | 69600 | 1634.4521/s | 6.57 |
8000 | 58343 | 1276.353584/s | 10.09s |
16 CPU and 32 GB of RAM
AES 256
Here are the details of this deployment:
CM details
CM location | Instance type | CM configuration | K6 configuration | Source |
---|---|---|---|---|
SanJose lab | Single instance | 16 CPU and 32 GB of RAM | 8 CPU, 64 GB of RAM, and 50 GB of HDD | CipherTrust Manager |
Results
Virtual users | Run time (seconds) | Operations/seconds | Time taken (P90) (seconds) |
---|---|---|---|
50 | 217259 | 5431.33299/s | 12.87ms |
100 | 268323 | 6707.796539/s | 21.26ms |
500 | 286282 | 7156.852227/s | 127.3ms |
1000 | 200998 | 5024.60733/s | 502.76ms |
1500 | 179857 | 4495.42505/s | 769.97ms |
2000 | 154400 | 3859.338574/s | 1.36s |
2500 | 143565 | 3588.734/s | 1.75s |
3000 | 148423 | 3709.989953/s | 2.01s |
3500 | 137609 | 3439.595273/s | 2.61s |
4000 | 141371 | 3533.704276/s | 2.77s |
RSA 3072
Here are the details of this deployment:
CM details
CM location | Instance type | CM configuration | K6 configuration | Source |
---|---|---|---|---|
SanJose lab | Single instance | 16 CPU and 32 GB of RAM | 8 CPU, 64 GB of RAM, and 50 GB of HDD | CipherTrust Manager |
Results
Virtual users | Run time (seconds) | Operations/seconds | Time taken (P90) (seconds) |
---|---|---|---|
50 | 271916 | 6797.700845/s | 11.19ms |
100 | 133881 | 6644.027184/s | 45.34ms |
500 | 280298 | 7038.788747/s | 398.47.ms |
1000 | 154827 | 3870.292993/s | 408.2ms |
2000 | 273828 | 6844.539846/s | 1.67s |
3000 | 193588 | 4839.315571/s | 5.49ms |
4000 | 237243 | 5930.963685/s | 7.25ms |
5000 | 142016 | 3549.93136/s | 3.48s |
6000 | 257272 | 6431.639269/s | 11.92ms |
AES 256, Enable success audit events
Here are the details of this deployment:
CM details
CM location | Instance type | CM configuration | K6 configuration | Source |
---|---|---|---|---|
SanJose lab | Single instance | 16 CPU and 32 GB of RAM | 8 CPU, 64 GB of RAM, and 50 GB of HDD | CipherTrust Manager |
Results
Virtual users | Run time (seconds) | Operations/seconds | Time taken (P90) (seconds) |
---|---|---|---|
50 | 142580 | 3564.118546/s | 19.71ms |
100 | 156539 | 3913.356442/s | 37.71ms |
500 | 116756 | 2918.51705/s | 292.06ms |
1000 | 120895 | 3021.70154/s | 480.14ms |
1500 | 116275 | 2906.571097/s | 731.43ms |
2000 | 117077 | 2926.39078/s | 960.69ms |
2500 | 110577 | 2763.808288/s | 1.23s |
3000 | 107620 | 2690.143502/s | 1.63s |
3500 | 95776 | 2393.854873/s | 1.82s |
4000 | 94482 | 2344.96546/s | 2.6s |
4500 | 103549 | 2588.086671/s | 2.8s |
5000 | 94089 | 2323.381969/s | 3.47s |
5500 | 71984 | 1795.161082/s | 5.05s |
6000 | 81403 | 2034.587003/s | 5.17s |
AES 256, disable success audit events
Here are the details of this deployment:
CM details
CM location | Instance type | CM configuration | K6 configuration | Source |
---|---|---|---|---|
SanJose lab | Single instance | 16 CPU and 32 GB of RAM | 8 CPU, 64 GB of RAM, and 50 GB of HDD | CipherTrust Manager |
Results
Virtual users | Run time (seconds) | Operations/seconds | Time taken (P90) (seconds) |
---|---|---|---|
50 | 217259 | 5431.33299/s | 12.87ms |
100 | 268323 | 6707.796539/s | 21.26ms |
500 | 286282 | 7156.852227/s | 127.3ms |
1000 | 200998 | 5024.60733/s | 502.76ms |
1500 | 179857 | 4495.42505/s | 769.97ms |
2000 | 154400 | 3859.338574/s | 1.36s |
2500 | 143565 | 3588.734/s | 1.75s |
3000 | 148423 | 3709.989953/s | 2.01s |
3500 | 137609 | 3439.595273/s | 2.61s |
4000 | 141371 | 3533.704276/s | 2.77s |
Two node clusters of Ciphertrust Manager behind load balancer are on-premises and K6 client is also on-premises
16 CPU and 32 GB of RAM
Here are the details of this deployment:
CM details
CM location | Instance type | CM configuration | K6 configuration | Source |
---|---|---|---|---|
SanJose lab | Single instance | 16 CPU and 32 GB of RAM | 8 CPU, 64 GB of RAM, and 50 GB of HDD | CipherTrust Manager |
Results
Virtual users | Run time (seconds) | Operations/seconds | Time taken (P90) (seconds) |
---|---|---|---|
50 | 281071 | 7026.229607/s | 8.97ms |
100 | 378662 | 9465.82768/s | 14.63ms |
500 | 525526 | 13137.221485/s | 60.77ms |
1000 | 420844 | 10520.470685/s | 165.61ms |
1500 | 379148 | 9477.712357/s | 299.2ms |
2000 | 335813 | 8394.109008/s | 499.97ms |
2500 | 316024 | 7899.208216/s | 674.69ms |
3000 | 313591 | 7838.058786/s | 793.76ms |
3500 | 295171 | 7378.248556/s | 991.36ms |
4000 | 274506 | 6860.58453/s | 1.25s |
4500 | 273180 | 6827.267927/s | 1.45s |
5000 | 279261 | 6979.776071/s | 1.51s |
32 CPU and 64 GB of RAM
Here are the details of this deployment:
CM details
CM location | Instance type | CM configuration | K6 configuration | Source |
---|---|---|---|---|
SanJose lab | Single instance | 32 CPU and 64 GB of RAM | 8 CPU, 64 GB of RAM, and 50 GB of HDD | CipherTrust Manager |
Results
Virtual users | Run time (seconds) | Operations/seconds | Time taken (P90) (seconds) |
---|---|---|---|
50 | 304072 | 7601.67745/s | 8.01ms |
100 | 393165 | 9828.678428/s | 14.22ms |
500 | 566423 | 14159.981913/s | 50.63ms |
1000 | 394500 | 9862.201022/s | 161.71ms |
1500 | 346202 | 8654.589461/s | 368.02ms |
2000 | 332488 | 8311.207163/s | 477.74ms |
2500 | 298444 | 7459.627745/s | 725.21ms |
3000 | 293701 | 7341.47043/s | 890.95ms |
3500 | 297744 | 7439.814009/s | 1.01s |
4000 | 266974 | 6672.6223742/s | 1.47s |
4500 | 279733 | 6991.902713/s | 1.38s |
5000 | 295107 | 7376.458011/s | 1.35s |
Ciphertrust Manager is on AWS and K6 client is on GCP
8 CPU and 32 GB of RAM
Here are the details of this deployment:
CM details
CM location | Instance type | CM configuration | K6 configuration | Source |
---|---|---|---|---|
SanJose lab | Single instance | 8 CPU and 32 GB of RAM | 8 CPU, 64 GB of RAM, and 50 GB of HDD | CipherTrust Manager |
Results
Virtual users | Run time (seconds) | Operations/seconds | Time taken (P90) (seconds) |
---|---|---|---|
100 | 114209 | 2853.65 | 33.62ms |
200 | 181528 | 4534.88 | 47.61ms |
300 | 189037 | 4725.00 | 82.05ms |
400 | 195428 | 4883.24 | 122.84ms |
500 | 191080 | 4774.52 | 172.78ms |
1000 | 159205 | 3978.34 | 485.72ms |
2000 | 130055 | 3250.21 | 1.15s |
3000 | 120092 | 2910.68 | 1.83s |
4000 | 103737 | 2591.68 | 3.47s |
5000 | 99471 | 2441.33 | 3.95s |
6000 | 93474 | 2118.54 | 5.25s |
7000 | 115037 | 2869.57 | 4.49s |
16 CPU and 32 GB of RAM
Here are the details of this deployment:
CM details
CM location | Instance type | CM configuration | K6 configuration | Source |
---|---|---|---|---|
SanJose lab | Single instance | 16 CPU and 32 GB of RAM | 8 CPU, 64 GB of RAM, and 50 GB of HDD | CipherTrust Manager |
Results
Virtual users | Run time (seconds) | Operations/seconds | Time taken (P90) (seconds) |
---|---|---|---|
100 | 121501 | 3035.97 | 30.03ms |
500 | 403483 | 10085.53 | 47.14ms |
600 | 359124 | 8976.06 | 142.65ms |
700 | 243727 | 6091.76 | 284.62ms |
800 | 214294 | 5355.68 | 300.33ms |
900 | 192871 | 4819.07 | 390.03ms |
1000 | 189644 | 4739.45 | 447.17ms |
2000 | 140693 | 3501.76 | 1.03s |
3000 | 144397 | 3413.92 | 1.58s |
4000 | 135754 | 3733.98 | 1.96s |
5000 | 143013 | 2246.75 | 1.73s |
Conclusion
Increasing CipherTrust Manager RAM and CPU increases performance.
Increasing the number of nodes enhances performance.
The performance is better when the server and client are geographically close compared to when they are far apart.
Performance improves when success audit events are disabled compared to when they are enabled.
The performance is better with the AES key type compared to the RSA key type.