{"id":11712,"date":"2025-01-20T13:13:02","date_gmt":"2025-01-20T21:13:02","guid":{"rendered":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/?post_type=example&p=11712"},"modified":"2025-02-03T09:48:40","modified_gmt":"2025-02-03T17:48:40","slug":"visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do","status":"publish","type":"example","link":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/example\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/","title":{"rendered":"Visual uncertainty highlighting | G2: Make clear how well the system can do what it can do"},"content":{"rendered":"\n\n\n
\"blue<\/figure>\n\n\n\n

Highlighting tokens with high edit probabilities in code-generation scenarios (Vasconcelos et al., 2023<\/a>) set expectations for how well the system can do what it can do (Guideline 2<\/a>) by visually expressing uncertainty in the AI outputs.<\/p>\n\n\n\n

The techniques used in this example have the potential to foster appropriate reliance on AI, by reducing overreliance. Keep in mind that overreliance mitigations can backfire. Be sure to test such mitigations in context, with your AI system\u2019s actual users. Learn more about\u00a0overreliance on AI<\/a> and\u00a0appropriate reliance on generative AI<\/a>.<\/p>\n\n\n\n

\"Highlighting
Image captured in February 2024.<\/em><\/figcaption><\/figure>\n","protected":false},"featured_media":11709,"menu_order":0,"template":"","meta":{"toolkit_pattern_number":"","ep_exclude_from_search":false,"footnotes":""},"application-type":[96,99,56,59],"goal":[114,123],"guideline-term":[4],"product-category":[70,28,63],"class_list":["post-11712","example","type-example","status-publish","has-post-thumbnail","hentry","application-type-gen-ai","application-type-llm","application-type-natural-language-processing-text","application-type-text-generation","goal-appropriate-reliance","goal-transparency","guideline-term-make-clear-how-well-the-system-can-do-what-it-can-do","product-category-chatbot","product-category-productivity","product-category-writing-and-editing"],"yoast_head":"\nVisual uncertainty highlighting | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/example\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Visual uncertainty highlighting | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit\" \/>\n<meta property=\"og:description\" content=\"Highlighting tokens with high edit probabilities in code-generation scenarios (Vasconcelos et al., 2023) set expectations for how well the system can do what it can do (Guideline 2) by visually expressing uncertainty in the AI outputs. The techniques used in this example have the potential to foster appropriate reliance on AI, by reducing overreliance. Keep […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/example\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft HAX Toolkit\" \/>\n<meta property=\"article:modified_time\" content=\"2025-02-03T17:48:40+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/uploads\/prod\/2025\/01\/Visual-uncertainty-expressions-high-edit-probabilities-G2.png\" \/>\n\t<meta property=\"og:image:width\" content=\"2415\" \/>\n\t<meta property=\"og:image:height\" content=\"2438\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n\t<meta name=\"twitter:label2\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data2\" content=\"Shipi Dhanorkar\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/example\\\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/\",\"url\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/example\\\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/\",\"name\":\"Visual uncertainty highlighting | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/example\\\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/example\\\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2025\\\/01\\\/Visual-uncertainty-expressions-high-edit-probabilities-G2.png\",\"datePublished\":\"2025-01-20T21:13:02+00:00\",\"dateModified\":\"2025-02-03T17:48:40+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/example\\\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/example\\\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/example\\\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/#primaryimage\",\"url\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2025\\\/01\\\/Visual-uncertainty-expressions-high-edit-probabilities-G2.png\",\"contentUrl\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2025\\\/01\\\/Visual-uncertainty-expressions-high-edit-probabilities-G2.png\",\"width\":2415,\"height\":2438,\"caption\":\"Highlighting tokens with low generation probabilities (left) vs. highlighting tokens with high edit probabilities (right) for three coding tasks (Vasconcelos et al., 2023; p. 8)\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/example\\\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"G2: Make clear how well the system can do what it can do.\",\"item\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/guideline\\\/make-clear-how-well-the-system-can-do-what-it-can-do\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Visual uncertainty highlighting | G2: Make clear how well the system can do what it can do\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/#website\",\"url\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/\",\"name\":\"Microsoft HAX Toolkit\",\"description\":\"Collaborative tools to help you create more effective and responsible human-AI experiences\",\"publisher\":{\"@id\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/#organization\",\"name\":\"Microsoft Corporation\",\"url\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2022\\\/07\\\/msft-logo.png\",\"contentUrl\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2022\\\/07\\\/msft-logo.png\",\"width\":1536,\"height\":1536,\"caption\":\"Microsoft Corporation\"},\"image\":{\"@id\":\"https:\\\/\\\/newed.any0.dpdns.org\\\/en-us\\\/haxtoolkit\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Visual uncertainty highlighting | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/example\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/","og_locale":"en_US","og_type":"article","og_title":"Visual uncertainty highlighting | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit","og_description":"Highlighting tokens with high edit probabilities in code-generation scenarios (Vasconcelos et al., 2023) set expectations for how well the system can do what it can do (Guideline 2) by visually expressing uncertainty in the AI outputs. The techniques used in this example have the potential to foster appropriate reliance on AI, by reducing overreliance. Keep […]","og_url":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/example\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/","og_site_name":"Microsoft HAX Toolkit","article_modified_time":"2025-02-03T17:48:40+00:00","og_image":[{"width":2415,"height":2438,"url":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/uploads\/prod\/2025\/01\/Visual-uncertainty-expressions-high-edit-probabilities-G2.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes","Written by":"Shipi Dhanorkar"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/example\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/","url":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/example\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/","name":"Visual uncertainty highlighting | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit","isPartOf":{"@id":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/#website"},"primaryImageOfPage":{"@id":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/example\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#primaryimage"},"image":{"@id":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/example\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#primaryimage"},"thumbnailUrl":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/uploads\/2025\/01\/Visual-uncertainty-expressions-high-edit-probabilities-G2.png","datePublished":"2025-01-20T21:13:02+00:00","dateModified":"2025-02-03T17:48:40+00:00","breadcrumb":{"@id":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/example\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/example\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/example\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#primaryimage","url":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/uploads\/2025\/01\/Visual-uncertainty-expressions-high-edit-probabilities-G2.png","contentUrl":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/uploads\/2025\/01\/Visual-uncertainty-expressions-high-edit-probabilities-G2.png","width":2415,"height":2438,"caption":"Highlighting tokens with low generation probabilities (left) vs. highlighting tokens with high edit probabilities (right) for three coding tasks (Vasconcelos et al., 2023; p. 8)"},{"@type":"BreadcrumbList","@id":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/example\/visual-uncertainty-highlighting-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/"},{"@type":"ListItem","position":2,"name":"G2: Make clear how well the system can do what it can do.","item":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/"},{"@type":"ListItem","position":3,"name":"Visual uncertainty highlighting | G2: Make clear how well the system can do what it can do"}]},{"@type":"WebSite","@id":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/#website","url":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/","name":"Microsoft HAX Toolkit","description":"Collaborative tools to help you create more effective and responsible human-AI experiences","publisher":{"@id":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/#organization","name":"Microsoft Corporation","url":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/","url":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/uploads\/2022\/07\/msft-logo.png","contentUrl":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/uploads\/2022\/07\/msft-logo.png","width":1536,"height":1536,"caption":"Microsoft Corporation"},"image":{"@id":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example\/11712","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example"}],"about":[{"href":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/types\/example"}],"version-history":[{"count":2,"href":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example\/11712\/revisions"}],"predecessor-version":[{"id":11799,"href":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example\/11712\/revisions\/11799"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/media\/11709"}],"wp:attachment":[{"href":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/media?parent=11712"}],"wp:term":[{"taxonomy":"application-type","embeddable":true,"href":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/application-type?post=11712"},{"taxonomy":"goal","embeddable":true,"href":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/goal?post=11712"},{"taxonomy":"guideline-term","embeddable":true,"href":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline-term?post=11712"},{"taxonomy":"product-category","embeddable":true,"href":"https:\/\/newed.any0.dpdns.org\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/product-category?post=11712"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}