Your suggested change has been received. Thank you.

close
Thales Logo

All

  • All
  • CipherTrust Manager
  • CipherTrust Application Data Protection (CADP)
  • CipherTrust Application Key Management (CAKM)
  • CipherTrust Batch Data Transformation (BDT)
  • CipherTrust Cloud Key Management (CCKM)
  • CipherTrust Data Discovery and Classification (DDC)
  • CipherTrust Data Protection Gateway (DPG)
  • CipherTrust Database Protection (CDP)
  • CipherTrust Intelligent Protection (CIP)
  • CipherTrust Integrations
  • CipherTrust Migrations
  • CipherTrust RESTful Data Protection (CRDP)
  • CipherTrust Transparent Encryption (CTE)
  • CipherTrust Transparent Encryption Userspace (CTE-U)
  • CipherTrust Secrets Management (CSM)
  • CipherTrust Vaulted Tokenization (CT-V)
  • CipherTrust Vaultless Tokenization (CT-VL)
  • CTE-Linux
  • CTE-Windows
  • CTE-AIX
  • CTE-K8s
  • CTE-U
  • Crypto Command Center
  • Data Protection on Demand
  • Luna Cloud HSM
  • Luna Network HSM
  • Luna PCIe HSM
  • Luna USB HSM
  • OneWelcome Identity Platform
  • ProtectApp LUKS
  • ProtectServer 2 HSM
  • ProtectServer 3 HSM
  • SafeNet Trusted Access (STA)
  • SafeNet MobilePASS+
  • SafeNet MobilePASS+ for Android
  • SafeNet MobilePASS+ for Chrome
  • SafeNet MobilePASS+ for macOS
  • SafeNet MobilePASS+ for iOS
  • SafeNet MobilePASS+ for WatchOS
  • SafeNet MobilePASS+ for Windows
  • SafeNet Synchronization Agent
  • SafeNet Logging Agent
  • SafeNet Agent for FreeRADIUS
  • SafeNet Agent for NPS
  • SafeNet Agent for Windows Logon
  • SafeNet Authentication Service Private Cloud Edition (SAS PCE)
  • SafeNet Remote Logging Agent
  • SafeNet Keycloak Agent
  • SafeNet IDPrime Virtual (IDPV)
  • SafeNet FIDO Key Manager
  • SafeNet FIDO Key Manager for Android
  • SafeNet FIDO Key Manager for iOS
  • SafeNet FIDO Key Manager for Windows
back

Google Cloud Resources

Performance Summary

search

Please Note:

printsuggest an editpdf paneldownload

Performance Summary

This section provides metrics and results of GCP performance testing.

copy link to clipboardTest Setup

Test Runner
Operating SystemUbuntu 18.4
RAM8 GB
Core4
Appliance
Build2.11.0.8177
RAM16 GB

copy link to clipboardProcess

Scripts are written on top of the Locust Framework for load and stress testing. The testing is done for create, read, update, and delete (CRUD) key operations with respect to different numbers of virtual users (VUS) over parallel connections, one for every virtual user.

copy link to clipboardCRUD Operations

Expand the headings below to view performance numbers.

copy link to clipboardResponse with request coverage in percentile (10 VUS, 180 seconds)

Click the tabs to view performance numbers.

Table 1

MethodName# Requests# FailsAverage (ms)Min (ms)Max (ms)Average size (bytes)RPSFailures/s
POST/cckm/google/
upload-key		207085021306142816301.20.0
AggregatedAggregated207085021306142816301.20.0

Table 2

MethodName50%ile (ms)60%ile (ms)70%ile (ms)80%ile (ms)90%ile (ms)95%ile (ms)99%ile (ms)100%ile (ms)
POST/cckm/google/
upload-key		72008700100001200013000130001400014000
AggregatedAggregated72008700100001200013000130001400014000

Click the tabs to view performance numbers.

Table 1

MethodName# Requests# FailsAverage (ms)Min (ms)Max (ms)Average size (bytes)RPSFailures/s
GET/cckm/google/
keys/[id]		2850609741561127510341.60.0
AggregatedAggregated2850609741561127510341.60.0

Table 2

MethodName50%ile (ms)60%ile (ms)70%ile (ms)80%ile (ms)90%ile (ms)95%ile (ms)99%ile (ms)100%ile (ms)
GET/cckm/google/
keys/[id]		5000590072008500940099001100011000
AggregatedAggregated5000590072008500940099001100011000

Click the tabs to view performance numbers.

Table 1

MethodName# Requests# FailsAverage (ms)Min (ms)Max (ms)Average size (bytes)RPSFailures/s
PATCH/cckm/google/
keys/[id]		246070354482117859691.40.0
AggregatedAggregated246070354482117859691.40.0

Table 2

MethodName50%ile (ms)60%ile (ms)70%ile (ms)80%ile (ms)90%ile (ms)95%ile (ms)99%ile (ms)100%ile (ms)
PATCH/cckm/google/
keys/[id]		590066008100950011000110001200012000
AggregatedAggregated590066008100950011000110001200012000

Click the tabs to view performance numbers.

Table 1

MethodName# Requests# FailsAverage (ms)Min (ms)Max (ms)Average size (bytes)RPSFailures/s
GET/cckm/google/
keys/[id]/
versions		2250672840801445614811.30.0
POST/cckm/google/
keys/[id]/versions/
[versionID]/
schedule-destroy		223200112397816017241.21.1
AggregatedAggregated44820039389781445611042.51.1

Table 2

MethodName50%ile (ms)60%ile (ms)70%ile (ms)80%ile (ms)90%ile (ms)95%ile (ms)99%ile (ms)100%ile (ms)
GET/cckm/google/
keys/[id]/
versions		530063008100970011000110001400014000
POST/cckm/google/
keys/[id]/versions/
[versionID]/
schedule-destroy		11001100120012001300140016001600
AggregatedAggregated41004500490063009700110001200014000

Here, X% percentile indicates that X percent requests are completed before this time.

In the graph above:

  • X-axis represents X% (percentile) of request time. It means, X% requests have taken time less than or equal to Y-axis value at X%.

  • Y-axis represents the time taken by a virtual user to perform any CRUD operation.

  • All the virtual users are spawned parallely at the same time to perform each of these CRUD operations for the given duration.

copy link to clipboardResponse with request coverage in percentile (30 VUS, 180 seconds)

Click the tabs to view performance numbers.

Table 1

MethodName# Requests# FailsAverage (ms)Min (ms)Max (ms)Average size (bytes)RPSFailures/s
POST/cckm/google/
upload-key		2070236592793295056301.20.0
AggregatedAggregated2070236592793295056301.20.0

Table 2

MethodName50%ile (ms)60%ile (ms)70%ile (ms)80%ile (ms)90%ile (ms)95%ile (ms)99%ile (ms)100%ile (ms)
POST/cckm/google/
upload-key		2500027000280002900029000290002900030000
AggregatedAggregated2500027000280002900029000290002900030000

Click the tabs to view performance numbers.

Table 1

MethodName# Requests# FailsAverage (ms)Min (ms)Max (ms)Average size (bytes)RPSFailures/s
GET/cckm/google/
keys/[id]		270018602129073552410341.50.0
AggregatedAggregated270018602129073552410341.50.0

Table 2

MethodName50%ile (ms)60%ile (ms)70%ile (ms)80%ile (ms)90%ile (ms)95%ile (ms)99%ile (ms)100%ile (ms)
GET/cckm/google/
keys/[id]		1900020000220002300023000250003400036000
AggregatedAggregated1900020000220002300023000250003400036000

Click the tabs to view performance numbers.

Table 1

MethodName# Requests# FailsAverage (ms)Min (ms)Max (ms)Average size (bytes)RPSFailures/s
PATCH/cckm/google/
keys/[id]		22102267515652379189691.20.0
AggregatedAggregated22102267515652379189691.20.0

Table 2

MethodName50%ile (ms)60%ile (ms)70%ile (ms)80%ile (ms)90%ile (ms)95%ile (ms)99%ile (ms)100%ile (ms)
PATCH/cckm/google/
keys/[id]		2300024000250002500027000290003600038000
AggregatedAggregated2300024000250002500027000290003600038000

Click the tabs to view performance numbers.

Table 1

MethodName# Requests# FailsAverage (ms)Min (ms)Max (ms)Average size (bytes)RPSFailures/s
GET/cckm/google/
keys/[id]/
versions		202024001167043982614941.10.0
POST/cckm/google/
keys/[id]/
versions/[versionID]/
schedule-destroy		2011944503008106691.11.1
AggregatedAggregated403194122553003982610822.21.1

Table 2

MethodName50%ile (ms)60%ile (ms)70%ile (ms)80%ile (ms)90%ile (ms)95%ile (ms)99%ile (ms)100%ile (ms)
GET/cckm/google/
keys/[id]/
versions		2400026000260002700029000350003900040000
POST/cckm/google/
keys/[id]/
versions/[versionID]/
schedule-destroy		390420520550580620740810
AggregatedAggregated1700019000220002600027000290003800040000

Here, X% percentile indicates that X percent requests are completed before this time.

In the graph above:

  • X-axis represents X% (percentile) of request time. It means, X% requests have taken time less than or equal to Y-axis value at X%.

  • Y-axis represents the time taken by a virtual user to perform any CRUD operation.

  • All the virtual users are spawned parallely at the same time to perform each of these CRUD operations for the given duration.

copy link to clipboardResponse with request coverage in percentile (50 VUS, 180 seconds)

Click the tabs to view performance numbers.

Table 1

MethodName# Requests# FailsAverage (ms)Min (ms)Max (ms)Average size (bytes)RPSFailures/s
POST/cckm/google/
upload-key		2030378899291473106301.10.0
AggregatedAggregated2030378899291473106301.10.0

Table 2

MethodName50%ile (ms)60%ile (ms)70%ile (ms)80%ile (ms)90%ile (ms)95%ile (ms)99%ile (ms)100%ile (ms)
POST/cckm/google/
upload-key		4200042000430004400045000460004600047000
AggregatedAggregated4200042000430004400045000460004600047000

Click the tabs to view performance numbers.

Table 1

MethodName# Requests# FailsAverage (ms)Min (ms)Max (ms)Average size (bytes)RPSFailures/s
GET/cckm/google/
keys/[id]		239033494253066168510341.30.0
AggregatedAggregated239033494253066168510341.30.0

Table 2

MethodName50%ile (ms)60%ile (ms)70%ile (ms)80%ile (ms)90%ile (ms)95%ile (ms)99%ile (ms)100%ile (ms)
GET/cckm/google/
keys/[id]		3200032000320003500045000550006100062000
AggregatedAggregated3200032000320003500045000550006100062000

Click the tabs to view performance numbers.

Table 1

MethodName# Requests# FailsAverage (ms)Min (ms)Max (ms)Average size (bytes)RPSFailures/s
PATCH/cckm/google/
keys/[id]		20203855433081655349691.10.0
AggregatedAggregated20203855433081655349691.10.0

Table 2

MethodName50%ile (ms)60%ile (ms)70%ile (ms)80%ile (ms)90%ile (ms)95%ile (ms)99%ile (ms)100%ile (ms)
PATCH/cckm/google/
keys/[id]		3600037000370003900047000540006300066000
AggregatedAggregated3600037000370003900047000540006300066000

Click the tabs to view performance numbers.

Table 1

MethodName# Requests# FailsAverage (ms)Min (ms)Max (ms)Average size (bytes)RPSFailures/s
GET/cckm/google/
keys/[id]/
versions		197039153302306198614941.10.0
POST/cckm/google/
keys/[id]/
versions/[versionID]/
schedule-destroy		196192100735517486571.11.1
AggregatedAggregated393192201283556198610772.21.1

Table 2

MethodName50%ile (ms)60%ile (ms)70%ile (ms)80%ile (ms)90%ile (ms)95%ile (ms)99%ile (ms)100%ile (ms)
GET/cckm/google/
keys/[id]/
versions		3700037000380003900048000530006100062000
POST/cckm/google/
keys/[id]/
versions/[versionID]/
schedule-destroy		10001100110012001300150016001700
AggregatedAggregated3000037000370003700039000480005900062000

Here, X% percentile indicates that X percent requests are completed before this time.

In the graph above:

  • X-axis represents X% (percentile) of request time. It means, X% requests have taken time less than or equal to Y-axis value at X%.

  • Y-axis represents the time taken by a virtual user to perform any CRUD operation.

  • All the virtual users are spawned parallely at the same time to perform each of these CRUD operations for the given duration.

Note

The delete operation includes listing key version(s) and schedule destroy. When multiple virtual users are executing the delete operation, more than 90% Bad request failures are observed with the status code 400. As the operation is synchronous, the behavior might be due a bottleneck on the GCP side when the requests are sent.

On this page