From d90e8c501f99afbb621f543e7c4e0190fe06e647 Mon Sep 17 00:00:00 2001 From: Mauro Servienti Date: Wed, 2 Apr 2025 15:47:40 +0200 Subject: [PATCH 1/2] Update testing-scenarios adding more load testing options --- docs/testing-scenarios.md | 9 +++++++-- 1 file changed, 7 insertions(+), 2 deletions(-) diff --git a/docs/testing-scenarios.md b/docs/testing-scenarios.md index 07ee727dd5..37e65d1020 100644 --- a/docs/testing-scenarios.md +++ b/docs/testing-scenarios.md @@ -60,13 +60,18 @@ Try to break ServiceControl instances by gracefully (CTRL+C) and ungracefully (k - [ ] Gracefully stop (CTRL+C) processes - [ ] Ungracefully (kill) processes -## Performance / load testing +## Performance/Load testing Test the new version against the previous version. - [ ] Test performance with a clean database - [ ] Test performance with a moderate database that exceeds the RAM of the machine -- [ ] Test performance of a large database that exceeds +- [ ] Test performance of a large database that exceeds 500 GB +- [ ] Test stability by: + - [ ] Rebooting the machine and verifying that ServiceControl instances start in a reasonable amount of time and behave correctly + - [ ] Stopping ServiceControl Windows services, verifying they stop as expected, and subsequently start in a reasonable amount of time and behave correctly + - [ ] Killing the hosting virtual machine from the Azure portal and verifying instances behave correctly after the reboot + - [ ] Trying to upgrade instances to newer versions while ingestion runs at full speed under load, and verify the upgrade is successful Review CPU/RAM utilization and disk IO. From b388a7826a976ed926bf44c4187620da36d59610 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Andreas=20=C3=96hlund?= Date: Wed, 2 Apr 2025 19:12:56 +0200 Subject: [PATCH 2/2] Tweaks --- docs/testing-scenarios.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/testing-scenarios.md b/docs/testing-scenarios.md index 37e65d1020..ef307b159e 100644 --- a/docs/testing-scenarios.md +++ b/docs/testing-scenarios.md @@ -53,10 +53,10 @@ A long (though not exhaustive) list, although not every change will merit runnin Try to break ServiceControl instances by gracefully (CTRL+C) and ungracefully (kill) processes to validate if both storage and logic behavior correctly. This type of testing is very difficult to automate. -- [ ] Ingestion, have the smoketest tool or the load generator generator create a large number of messsages: +- [ ] Ingestion, have the smoketest tool or the load generator generator create a large number of messages: - [ ] Gracefully stop (CTRL+C) processes - [ ] Ungracefully (kill) processes -- [ ] Retry groups, create a large retry group and interrup these: +- [ ] Retry groups, create a large retry group and interrupt these: - [ ] Gracefully stop (CTRL+C) processes - [ ] Ungracefully (kill) processes @@ -71,7 +71,7 @@ Test the new version against the previous version. - [ ] Rebooting the machine and verifying that ServiceControl instances start in a reasonable amount of time and behave correctly - [ ] Stopping ServiceControl Windows services, verifying they stop as expected, and subsequently start in a reasonable amount of time and behave correctly - [ ] Killing the hosting virtual machine from the Azure portal and verifying instances behave correctly after the reboot - - [ ] Trying to upgrade instances to newer versions while ingestion runs at full speed under load, and verify the upgrade is successful + - [ ] Trying to upgrade instances to newer versions while ingestion runs at full speed under load and verify the upgrade is successful Review CPU/RAM utilization and disk IO.