{"id":156,"date":"2019-12-24T06:23:09","date_gmt":"2019-12-24T06:23:09","guid":{"rendered":"https:\/\/stagsoftware.com\/hbtcentral\/?p=156"},"modified":"2022-09-22T12:28:05","modified_gmt":"2022-09-22T06:58:05","slug":"test-case-potency","status":"publish","type":"post","link":"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/","title":{"rendered":"Test case potency"},"content":{"rendered":"\n<p>We know that the objective of good testing is to uncover those faults that have the potential to cause severe failures. The big question is \u201chow good are the test cases to detect these faults?\u201d i.e. How \u201cpotent\u201d are they? Traditionally, this is seen as requiring deep domain knowledge. Further, Requirements trace-ability, code coverage are used as \u2018crutches\u2019 for assessment, sadly these are weak.<\/p>\n\n\n\n<p>Potency is the \u201cleast number of test cases &nbsp;with the ability to target the specific types of defects in specific areas to ensure clean software\u201d. We could assess potency by examining fours aspects:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Strength of test case<\/li><li>Area targeted<\/li><li>Target bug \u2013 potential defect type<\/li><li>Immunity<\/li><\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img fetchpriority=\"high\" decoding=\"async\" width=\"917\" height=\"583\" src=\"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2022\/09\/tc_potency.001-1.jpeg\" alt=\"\" class=\"wp-image-382\" srcset=\"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2022\/09\/tc_potency.001-1.jpeg 917w, https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2022\/09\/tc_potency.001-1-300x191.jpeg 300w, https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2022\/09\/tc_potency.001-1-768x488.jpeg 768w\" sizes=\"(max-width: 917px) 100vw, 917px\" \/><\/figure>\n\n\n\n<p><strong>Strength of test case<\/strong><\/p>\n\n\n\n<p>Are the test cases sufficient? Assess the property of count-ability. What is this? If the behavior of an element under test is described as a set of conditions (i.e. a behavioral model) then an optimal combination of these conditions would result in ?countable scenarios i.e. irrespective of who designs, the number of scenarios is indeed the same. Instantiating each scenario with optimal combinations of inputs would result in test cases. The key element to note is that the number of test cases can be logically assessed for sufficiency. The second measure is the distribution of test cases that are conformance\/robustness (+\/-). This is a function of #inputs and values for each input. Note that inputs can be discerned from the conditions in the behavioral model and the values for each input mechanically generated based on the input specification. Hence this measure can allow us to ascertain if our distribution is indeed good enough. Finally segregation of test cases into quality levels enables test cases to be purposeful and enables a clear targeting of what type of defect a test case is targeting.<\/p>\n\n\n\n<p><strong>&nbsp;Area targeted<\/strong><\/p>\n\n\n\n<p>This is about examining if we are indeed covering the entire area well enough. Measuring how much external area is ?Requirements coverage\/traceability whilst measuring the internal area covered is what ?Code coverage? focuses on. Note that these are the typical measures that we use. These measures describe the area that we cover, but not the types of defects we are looking for in that area.<\/p>\n\n\n\n<p><strong>Target bug \u2013 potential defect type<\/strong><\/p>\n\n\n\n<p>Tracing the test cases to the potential types of defects that they can uncover enables the test cases to be purposeful i.e. what issues am I interested in uncovering? So examining the properties\/measures of Countability, Conformance: Robustness, Test case distribution of test cases by quality levels and Requirements\/Code\/Fault coverage can allow a scientific assessment of potency of test cases.<\/p>\n\n\n\n<p><strong>Immunity<\/strong><\/p>\n\n\n\n<p>Examining the yield of test case over time will give an indication of the ?resistance or immunity. Hence tracking the outcome of each test case ?defect yield(i.e. did they result in a defect) every time we run it is key to understanding this property.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>We know that the objective of good testing is to uncover those faults that have the potential to cause severe failures. The big question is \u201chow good are the test cases to detect these faults?\u201d i.e. How \u201cpotent\u201d are they? Traditionally, this is seen as requiring deep domain knowledge. Further, Requirements trace-ability, code coverage are [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[10],"tags":[],"class_list":["post-156","post","type-post","status-publish","format-standard","hentry","category-robust-test-design"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v24.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Test case potency - HyBIST Central<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Test case potency - HyBIST Central\" \/>\n<meta property=\"og:description\" content=\"We know that the objective of good testing is to uncover those faults that have the potential to cause severe failures. The big question is \u201chow good are the test cases to detect these faults?\u201d i.e. How \u201cpotent\u201d are they? Traditionally, this is seen as requiring deep domain knowledge. Further, Requirements trace-ability, code coverage are [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/\" \/>\n<meta property=\"og:site_name\" content=\"HyBIST Central\" \/>\n<meta property=\"article:published_time\" content=\"2019-12-24T06:23:09+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-09-22T06:58:05+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2022\/09\/tc_potency.001-1.jpeg\" \/>\n<meta name=\"author\" content=\"STAG Software\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"STAG Software\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/\"},\"author\":{\"name\":\"STAG Software\",\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/#\/schema\/person\/2cf4a7a21b9573577750f1cba91e2db8\"},\"headline\":\"Test case potency\",\"datePublished\":\"2019-12-24T06:23:09+00:00\",\"dateModified\":\"2022-09-22T06:58:05+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/\"},\"wordCount\":487,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/#organization\"},\"image\":{\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2022\/09\/tc_potency.001-1.jpeg\",\"articleSection\":[\"08. Robust test design\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/\",\"url\":\"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/\",\"name\":\"Test case potency - HyBIST Central\",\"isPartOf\":{\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2022\/09\/tc_potency.001-1.jpeg\",\"datePublished\":\"2019-12-24T06:23:09+00:00\",\"dateModified\":\"2022-09-22T06:58:05+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#primaryimage\",\"url\":\"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2022\/09\/tc_potency.001-1.jpeg\",\"contentUrl\":\"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2022\/09\/tc_potency.001-1.jpeg\",\"width\":917,\"height\":583},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/stagsoftware.com\/hbtcentral\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Test case potency\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/#website\",\"url\":\"https:\/\/stagsoftware.com\/hbtcentral\/\",\"name\":\"HyBIST Central\",\"description\":\"All about Hypothesis Based Immersive Session Testing\",\"publisher\":{\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/stagsoftware.com\/hbtcentral\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/#organization\",\"name\":\"HyBIST Central\",\"url\":\"https:\/\/stagsoftware.com\/hbtcentral\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2021\/08\/150-30.png\",\"contentUrl\":\"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2021\/08\/150-30.png\",\"width\":150,\"height\":30,\"caption\":\"HyBIST Central\"},\"image\":{\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/#\/schema\/person\/2cf4a7a21b9573577750f1cba91e2db8\",\"name\":\"STAG Software\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/stagsoftware.com\/hbtcentral\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/55a1bf61b42fef94c642ef3988a962bc?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/55a1bf61b42fef94c642ef3988a962bc?s=96&d=mm&r=g\",\"caption\":\"STAG Software\"},\"url\":\"https:\/\/stagsoftware.com\/hbtcentral\/author\/hiya\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Test case potency - HyBIST Central","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/","og_locale":"en_US","og_type":"article","og_title":"Test case potency - HyBIST Central","og_description":"We know that the objective of good testing is to uncover those faults that have the potential to cause severe failures. The big question is \u201chow good are the test cases to detect these faults?\u201d i.e. How \u201cpotent\u201d are they? Traditionally, this is seen as requiring deep domain knowledge. Further, Requirements trace-ability, code coverage are [&hellip;]","og_url":"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/","og_site_name":"HyBIST Central","article_published_time":"2019-12-24T06:23:09+00:00","article_modified_time":"2022-09-22T06:58:05+00:00","og_image":[{"url":"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2022\/09\/tc_potency.001-1.jpeg","type":"","width":"","height":""}],"author":"STAG Software","twitter_card":"summary_large_image","twitter_misc":{"Written by":"STAG Software","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#article","isPartOf":{"@id":"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/"},"author":{"name":"STAG Software","@id":"https:\/\/stagsoftware.com\/hbtcentral\/#\/schema\/person\/2cf4a7a21b9573577750f1cba91e2db8"},"headline":"Test case potency","datePublished":"2019-12-24T06:23:09+00:00","dateModified":"2022-09-22T06:58:05+00:00","mainEntityOfPage":{"@id":"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/"},"wordCount":487,"commentCount":0,"publisher":{"@id":"https:\/\/stagsoftware.com\/hbtcentral\/#organization"},"image":{"@id":"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#primaryimage"},"thumbnailUrl":"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2022\/09\/tc_potency.001-1.jpeg","articleSection":["08. Robust test design"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/","url":"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/","name":"Test case potency - HyBIST Central","isPartOf":{"@id":"https:\/\/stagsoftware.com\/hbtcentral\/#website"},"primaryImageOfPage":{"@id":"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#primaryimage"},"image":{"@id":"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#primaryimage"},"thumbnailUrl":"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2022\/09\/tc_potency.001-1.jpeg","datePublished":"2019-12-24T06:23:09+00:00","dateModified":"2022-09-22T06:58:05+00:00","breadcrumb":{"@id":"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#primaryimage","url":"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2022\/09\/tc_potency.001-1.jpeg","contentUrl":"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2022\/09\/tc_potency.001-1.jpeg","width":917,"height":583},{"@type":"BreadcrumbList","@id":"https:\/\/stagsoftware.com\/hbtcentral\/test-case-potency\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/stagsoftware.com\/hbtcentral\/"},{"@type":"ListItem","position":2,"name":"Test case potency"}]},{"@type":"WebSite","@id":"https:\/\/stagsoftware.com\/hbtcentral\/#website","url":"https:\/\/stagsoftware.com\/hbtcentral\/","name":"HyBIST Central","description":"All about Hypothesis Based Immersive Session Testing","publisher":{"@id":"https:\/\/stagsoftware.com\/hbtcentral\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/stagsoftware.com\/hbtcentral\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/stagsoftware.com\/hbtcentral\/#organization","name":"HyBIST Central","url":"https:\/\/stagsoftware.com\/hbtcentral\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/stagsoftware.com\/hbtcentral\/#\/schema\/logo\/image\/","url":"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2021\/08\/150-30.png","contentUrl":"https:\/\/stagsoftware.com\/hbtcentral\/wp-content\/uploads\/sites\/3\/2021\/08\/150-30.png","width":150,"height":30,"caption":"HyBIST Central"},"image":{"@id":"https:\/\/stagsoftware.com\/hbtcentral\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/stagsoftware.com\/hbtcentral\/#\/schema\/person\/2cf4a7a21b9573577750f1cba91e2db8","name":"STAG Software","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/stagsoftware.com\/hbtcentral\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/55a1bf61b42fef94c642ef3988a962bc?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/55a1bf61b42fef94c642ef3988a962bc?s=96&d=mm&r=g","caption":"STAG Software"},"url":"https:\/\/stagsoftware.com\/hbtcentral\/author\/hiya\/"}]}},"_links":{"self":[{"href":"https:\/\/stagsoftware.com\/hbtcentral\/wp-json\/wp\/v2\/posts\/156","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/stagsoftware.com\/hbtcentral\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/stagsoftware.com\/hbtcentral\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/stagsoftware.com\/hbtcentral\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/stagsoftware.com\/hbtcentral\/wp-json\/wp\/v2\/comments?post=156"}],"version-history":[{"count":3,"href":"https:\/\/stagsoftware.com\/hbtcentral\/wp-json\/wp\/v2\/posts\/156\/revisions"}],"predecessor-version":[{"id":383,"href":"https:\/\/stagsoftware.com\/hbtcentral\/wp-json\/wp\/v2\/posts\/156\/revisions\/383"}],"wp:attachment":[{"href":"https:\/\/stagsoftware.com\/hbtcentral\/wp-json\/wp\/v2\/media?parent=156"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/stagsoftware.com\/hbtcentral\/wp-json\/wp\/v2\/categories?post=156"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/stagsoftware.com\/hbtcentral\/wp-json\/wp\/v2\/tags?post=156"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}