{"id":205328,"date":"2025-12-16T14:14:38","date_gmt":"2025-12-16T17:14:38","guid":{"rendered":"https:\/\/goias.gov.br\/ligo\/?p=205328"},"modified":"2025-12-17T14:23:32","modified_gmt":"2025-12-17T17:23:32","slug":"concordancia-entre-modelos-de-genai","status":"publish","type":"post","link":"https:\/\/goias.gov.br\/ligo\/concordancia-entre-modelos-de-genai\/","title":{"rendered":"Concord\u00e2ncia entre modelos GenAI"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"205328\" class=\"elementor elementor-205328\">\n\t\t\t\t<div class=\"elementor-element elementor-element-3dab1ea e-con-full e-flex wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"3dab1ea\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-5d638f5 elementor-widget elementor-widget-heading\" data-id=\"5d638f5\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Concord\u00e2ncia entre modelos de linguagem na avalia\u00e7\u00e3o da clareza das respostas<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-1f610c7 elementor-widget elementor-widget-image\" data-id=\"1f610c7\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" src=\"https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/elementor\/thumbs\/corpotexto-rgarmkxek38559gkckp2nugeypek8rpziaydzdhpc8.png\" title=\"corpotexto\" alt=\"corpotexto\" loading=\"lazy\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-2f3dcbd e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"2f3dcbd\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-f372bd6 elementor-widget elementor-widget-text-editor\" data-id=\"f372bd6\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p style=\"text-align: left;\"><span style=\"font-family: verdana, geneva, sans-serif; color: #808080; font-size: 12pt;\">Testamos os modelos LLaMA e Qwen para pontuar a concord\u00e2ncia na clareza de textos relacionados a sa\u00fade, educa\u00e7\u00e3o e seguran\u00e7a.<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-b3ec769 e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"b3ec769\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-048dff6 elementor-widget elementor-widget-heading\" data-id=\"048dff6\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Taxa Concord\u00e2ncia na Resposta<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-05afd97 e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"05afd97\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-5f670ff elementor-widget elementor-widget-text-editor\" data-id=\"5f670ff\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\">A m\u00e9trica concord\u00e2ncia das respostas, utilizamos modelos de linguagem (LLMs) como ju\u00edzes para pontuar o qu\u00e3o claro era o conte\u00fado apresentado. Os textos avaliados pertencem ao contexto governamental, abrangendo os temas de sa\u00fade, educa\u00e7\u00e3o e seguran\u00e7a p\u00fablica. Para essa avalia\u00e7\u00e3o, os modelos receberam um conjunto de crit\u00e9rios: objetividade, linguagem simples, aus\u00eancia de ambiguidade e adequa\u00e7\u00e3o ao contexto. Cada resposta foi pontuada em uma escala de 1 a 5, sendo:<\/span><\/p><p><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\"><!-- \/wp:paragraph --> <!-- wp:list --><\/span><\/p><ul class=\"wp-block-list\"><li style=\"list-style-type: none;\"><ul class=\"wp-block-list\" style=\"list-style-type: square;\"><li style=\"list-style-type: none;\"><ul class=\"wp-block-list\" style=\"list-style-type: square;\"><!-- wp:list-item --><\/ul><\/li><\/ul><ul class=\"wp-block-list\" style=\"list-style-type: square;\"><li><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\">1:\u00a0 nada claro<\/span><\/li><\/ul><\/li><\/ul><p><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\"><!-- \/wp:list-item --> <!-- wp:list-item --><\/span><\/p><ul class=\"wp-block-list\" style=\"list-style-type: square;\"><li style=\"list-style-type: none;\"><ul class=\"wp-block-list\" style=\"list-style-type: square;\"><li><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\">5:\u00a0 perfeitamente claro<\/span><\/li><\/ul><\/li><\/ul><div><span style=\"color: #808080; font-family: verdana, geneva, sans-serif;\">\u00a0<\/span><\/div><div><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\"><strong>Exemplo da estrutura\u00e7\u00e3o das respostas definidas em cinco n\u00edveis de clareza:<\/strong><\/span><\/div><p><!-- \/wp:list-item --><\/p><p><!-- \/wp:list --><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-afb3452 e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"afb3452\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-8824512 elementor-widget elementor-widget-text-editor\" data-id=\"8824512\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<pre><span style=\"color: #008000;\"><code><span style=\"font-family: verdana, geneva, sans-serif;\">[{<\/span><\/code><\/span><br \/><br \/><span style=\"color: #008000;\"><code><span style=\"font-family: verdana, geneva, sans-serif;\">\u00a0 \"texto\": \"Foram pavimentados 14 km na regi\u00e3o norte, conforme relat\u00f3rio t\u00e9cnico n\u00ba 009\/2024.\",<\/span><\/code><\/span><br \/><br \/><span style=\"color: #008000;\"><code><span style=\"font-family: verdana, geneva, sans-serif;\">\u00a0 \u00a0\u00a0\"gabarito\": 5<\/span><\/code><\/span><br \/><br \/><span style=\"color: #008000;\"><code><span style=\"font-family: verdana, geneva, sans-serif;\">\u00a0 },<\/span><\/code><\/span><br \/><br \/><span style=\"color: #008000;\"><code><span style=\"font-family: verdana, geneva, sans-serif;\">\u00a0 {<\/span><\/code><\/span><br \/><br \/><span style=\"color: #008000;\"><code><span style=\"font-family: verdana, geneva, sans-serif;\">\u00a0 \u00a0\u00a0\"texto\": \"A ilumina\u00e7\u00e3o p\u00fablica est\u00e1 sendo cuidada, mas sem mais detalhes.\",<\/span><\/code><\/span><br \/><br \/><span style=\"color: #008000;\"><code><span style=\"font-family: verdana, geneva, sans-serif;\">\u00a0 \u00a0\u00a0\"gabarito\": 1<\/span><\/code><\/span><br \/><br \/><span style=\"color: #008000;\"><code><span style=\"font-family: verdana, geneva, sans-serif;\">\u00a0 },<\/span><\/code><\/span><br \/><br \/><span style=\"color: #008000;\"><code><span style=\"font-family: verdana, geneva, sans-serif;\">{<\/span><\/code><\/span><br \/><br \/><span style=\"color: #008000;\"><code><span style=\"font-family: verdana, geneva, sans-serif;\">\u00a0 \u00a0\u00a0\"texto\": \"O bairro Novo Horizonte conta com rondas di\u00e1rias da Pol\u00edcia Militar.\",<\/span><\/code><\/span><br \/><br \/><span style=\"color: #008000;\"><code><span style=\"font-family: verdana, geneva, sans-serif;\">\u00a0 \u00a0\u00a0\"gabarito\": 4<\/span><\/code><\/span><br \/><br \/><span style=\"color: #008000;\"><code><span style=\"font-family: verdana, geneva, sans-serif;\">\u00a0 }]<\/span><\/code><\/span><\/pre>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-4eb238b e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"4eb238b\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-2d5a8f3 elementor-widget elementor-widget-heading\" data-id=\"2d5a8f3\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Executando o Teste e Coletando Dados<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-f5199f6 e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"f5199f6\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-ec5b9cc elementor-widget elementor-widget-text-editor\" data-id=\"ec5b9cc\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\">Todos os modelos testados receberam as mesmas instru\u00e7\u00f5es para pontuar a clareza da senten\u00e7a informada. Foram registradas todas as respostas juntamente com logs detalhados de cada intera\u00e7\u00e3o e com registro de anomalias e comportamentos n\u00e3o previstos. Para execu\u00e7\u00e3o do teste foi usada a estrutura <em>LangChain<\/em>.<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-02bc72a e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"02bc72a\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-f1df27e elementor-widget elementor-widget-heading\" data-id=\"f1df27e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Avaliamos a concord\u00e2ncia das respostas com LLMs<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-4d8c6c1 e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"4d8c6c1\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-d039a85 elementor-widget elementor-widget-text-editor\" data-id=\"d039a85\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\">Para medir a concord\u00e2ncia das respostas, desenvolvemos uma estrutura program\u00e1tica baseada na biblioteca LangChain, que permite orquestrar intera\u00e7\u00f5es com modelos de linguagem (LLMs). Abaixo, explicamos passo a passo como essa avalia\u00e7\u00e3o foi conduzida:<\/span><\/p><p><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\"><strong>Defini\u00e7\u00e3o da tarefa<\/strong>: Cada modelo recebeu a tarefa de avaliar o qu\u00e3o clara era uma resposta textual, utilizando uma escala Likert de 1 a 5.<\/span><\/p><p><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\"><strong>A clareza foi definida com base nos crit\u00e9rios: <\/strong>objetividade, linguagem simples, aus\u00eancia de ambiguidade e adequa\u00e7\u00e3o ao contexto<\/span><\/p><p><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\"><strong>Constru\u00e7\u00e3o do prompt<\/strong>: Criamos um prompt fixo (do tipo<em> system message<\/em>) que instruiu o modelo a avaliar a clareza da resposta fornecida, sem apresentar justificativas \u2014 apenas retornando um n\u00famero de 1 a 5.<\/span><\/p><p><span style=\"font-family: verdana, geneva, sans-serif; font-size: 12pt; color: #808080;\">Exemplo da instru\u00e7\u00e3o usada:\u200b<\/span><\/p><p><span style=\"font-size: 12pt; font-family: verdana, geneva, sans-serif; color: #808080;\">&#8220;Dada a seguinte resposta, avalie considerando a escala Likert, de 1 a 5 o qu\u00e3o clara ela \u00e9 [&#8230;] Responda apenas com um n\u00famero de 1 a 5.&#8221;<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-86b8b49 e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"86b8b49\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-a18d62a elementor-widget elementor-widget-heading\" data-id=\"a18d62a\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Pipeline de execu\u00e7\u00e3o (cadeia de tarefas)<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-4f919aa e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"4f919aa\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-3b85e3e elementor-widget elementor-widget-text-editor\" data-id=\"3b85e3e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><!-- wp:paragraph --><\/p><p><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\">Com a ajuda da <em>RunnableSequence<\/em>, organizamos a sequ\u00eancia de etapas:<\/span><\/p><p><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\"><!-- \/wp:paragraph --> <!-- wp:list --><\/span><\/p><ul class=\"wp-block-list\"><!-- wp:list-item --><li><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\">A entrada do usu\u00e1rio (o texto a ser avaliado) \u00e9 recebida.<\/span><\/li><!-- \/wp:list-item --> <!-- wp:list-item --><li><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\">O prompt \u00e9 preenchido com esse texto.<\/span><\/li><!-- \/wp:list-item --> <!-- wp:list-item --><li><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\">O modelo de linguagem \u00e9 acionado com o prompt.<\/span><\/li><!-- \/wp:list-item --> <!-- wp:list-item --><li><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\">A resposta do modelo (um n\u00famero de 1 a 5) \u00e9 extra\u00edda como string para ser usada nos resultados.<\/span><\/li><!-- \/wp:list-item --><\/ul><p><span style=\"font-family: verdana, geneva, sans-serif; color: #808080;\"><!-- \/wp:list --><\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-bc16aef e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"bc16aef\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-6046043 elementor-widget elementor-widget-heading\" data-id=\"6046043\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Execu\u00e7\u00e3o da avalia\u00e7\u00e3o<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-4b1c26b e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"4b1c26b\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-c9b23a5 elementor-widget elementor-widget-text-editor\" data-id=\"c9b23a5\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><span style=\"color: #808080; font-family: verdana, geneva, sans-serif;\">Com essa estrutura, v\u00e1rios textos foram avaliados por diferentes modelos (como LLaMA e Qwen). Cada modelo agiu como um &#8220;juiz virtual&#8221;, atribuindo uma pontua\u00e7\u00e3o para a clareza da resposta sem interfer\u00eancia humana.<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-bcf395e e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"bcf395e\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-d4a7a35 elementor-widget elementor-widget-heading\" data-id=\"d4a7a35\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Resultados preliminares\n<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-6ecf52b e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"6ecf52b\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-215dd49 elementor-widget elementor-widget-text-editor\" data-id=\"215dd49\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><span style=\"color: #808080; font-family: verdana, geneva, sans-serif;\">Inicialmente, foram testados os modelos LLaMA 3.1:8B e Qwen 2.5:7B. No contexto governamental, com segmenta\u00e7\u00f5es nas \u00e1reas de sa\u00fade, educa\u00e7\u00e3o, infraestrutura, seguran\u00e7a e administra\u00e7\u00e3o p\u00fablica. O modelo Qwen classificou corretamente 45% das respostas, demonstrando uma performance moderada na identifica\u00e7\u00e3o de textos claros ou pouco claros conforme os crit\u00e9rios estabelecidos. O LLaMA, por sua vez, obteve um \u00edndice de acerto de 30%, indicando maior dificuldade em alinhar suas classifica\u00e7\u00f5es ao gabarito humano de clareza. Esses resultados sugerem que, embora ambos os modelos apresentem potencial para tarefas de avalia\u00e7\u00e3o subjetiva, como a an\u00e1lise de clareza, o Qwen se mostrou mais alinhado \u00e0s percep\u00e7\u00f5es humanas neste est\u00e1gio preliminar do experimento.<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-5b72eb2 e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"5b72eb2\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-63631d7 elementor-widget elementor-widget-text-editor\" data-id=\"63631d7\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><!-- wp:image {\"id\":205322,\"sizeSlug\":\"full\",\"linkDestination\":\"none\"} --> <!-- \/wp:image --><\/p><figure class=\"wp-block-image size-full\"><img fetchpriority=\"high\" decoding=\"async\" width=\"746\" height=\"503\" class=\"wp-image-205322 aligncenter\" src=\"https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/image-5.png\" alt=\"\" srcset=\"https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/image-5.png 746w, https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/image-5-300x202.png 300w\" sizes=\"(max-width: 746px) 100vw, 746px\" \/><\/figure>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-89d0970 elementor-widget elementor-widget-text-editor\" data-id=\"89d0970\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><!-- wp:image {\"id\":205322,\"sizeSlug\":\"full\",\"linkDestination\":\"none\"} --> <!-- \/wp:image --><\/p><figure class=\"wp-block-image size-full\"><\/figure>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-1f14432 e-con-full e-flex wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"1f14432\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t<div class=\"elementor-element elementor-element-0fc0999 e-con-full e-flex wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-child\" data-id=\"0fc0999\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-74f108b elementor-widget__width-initial elementor-widget elementor-widget-image\" data-id=\"74f108b\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"748\" height=\"497\" src=\"https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/image-7.png\" class=\"attachment-large size-large wp-image-205325\" alt=\"\" srcset=\"https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/image-7.png 748w, https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/image-7-300x199.png 300w\" sizes=\"(max-width: 748px) 100vw, 748px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-a89d493 e-con-full e-flex wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-child\" data-id=\"a89d493\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-90c6684 elementor-widget elementor-widget-image\" data-id=\"90c6684\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"752\" height=\"493\" src=\"https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/image-6.png\" class=\"attachment-large size-large wp-image-205324\" alt=\"\" srcset=\"https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/image-6.png 752w, https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/image-6-300x197.png 300w\" sizes=\"(max-width: 752px) 100vw, 752px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-4aa0d00 e-flex e-con-boxed wpr-particle-no wpr-jarallax-no wpr-parallax-no wpr-sticky-section-no e-con e-parent\" data-id=\"4aa0d00\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Testamos os modelos LLaMA e Qwen para pontuar a concord\u00e2ncia na clareza de textos relacionados \u00e0 sa\u00fade, educa\u00e7\u00e3o e seguran\u00e7a.<\/p>\n","protected":false},"author":786,"featured_media":205375,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[55,26],"tags":[],"class_list":["post-205328","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-inteligencia_artificial","category-publicacoes-ligo"],"rttpg_featured_image_url":{"full":["https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/metrica_compreensao.jpg",912,1184,false],"landscape":["https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/metrica_compreensao.jpg",912,1184,false],"portraits":["https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/metrica_compreensao.jpg",912,1184,false],"thumbnail":["https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/metrica_compreensao-150x150.jpg",150,150,true],"medium":["https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/metrica_compreensao-231x300.jpg",231,300,true],"large":["https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/metrica_compreensao-789x1024.jpg",789,1024,true],"1536x1536":["https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/metrica_compreensao.jpg",912,1184,false],"2048x2048":["https:\/\/goias.gov.br\/ligo\/wp-content\/uploads\/sites\/61\/2025\/12\/metrica_compreensao.jpg",912,1184,false]},"rttpg_author":{"display_name":"Hellem Correa","author_link":"https:\/\/goias.gov.br\/ligo\/author\/hellemsantos\/"},"rttpg_comment":0,"rttpg_category":"<a href=\"https:\/\/goias.gov.br\/ligo\/categoria\/publicacoes-ligo\/inteligencia_artificial\/\" rel=\"category tag\">Intelig\u00eancia Artificial<\/a> <a href=\"https:\/\/goias.gov.br\/ligo\/categoria\/publicacoes-ligo\/\" rel=\"category tag\">Publica\u00e7\u00f5es Ligo<\/a>","rttpg_excerpt":"Testamos os modelos LLaMA e Qwen para pontuar a concord\u00e2ncia na clareza de textos relacionados \u00e0 sa\u00fade, educa\u00e7\u00e3o e seguran\u00e7a.","_links":{"self":[{"href":"https:\/\/goias.gov.br\/ligo\/wp-json\/wp\/v2\/posts\/205328","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/goias.gov.br\/ligo\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/goias.gov.br\/ligo\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/goias.gov.br\/ligo\/wp-json\/wp\/v2\/users\/786"}],"replies":[{"embeddable":true,"href":"https:\/\/goias.gov.br\/ligo\/wp-json\/wp\/v2\/comments?post=205328"}],"version-history":[{"count":2,"href":"https:\/\/goias.gov.br\/ligo\/wp-json\/wp\/v2\/posts\/205328\/revisions"}],"predecessor-version":[{"id":205374,"href":"https:\/\/goias.gov.br\/ligo\/wp-json\/wp\/v2\/posts\/205328\/revisions\/205374"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/goias.gov.br\/ligo\/wp-json\/wp\/v2\/media\/205375"}],"wp:attachment":[{"href":"https:\/\/goias.gov.br\/ligo\/wp-json\/wp\/v2\/media?parent=205328"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/goias.gov.br\/ligo\/wp-json\/wp\/v2\/categories?post=205328"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/goias.gov.br\/ligo\/wp-json\/wp\/v2\/tags?post=205328"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}