{"slug": "data-documentation-for-irss-ai-use-cases-is-lacking-watchdog-finds", "title": "Data documentation for IRS’s AI use cases is lacking, watchdog finds", "summary": "The Treasury Inspector General for Tax Administration found that the IRS lacks consistent data documentation for its AI use case inventory, with only 20 percent (1 of 5) of reviewed cases having testing documentation while the remaining 80 percent (4 of 5) had none. TIGTA recommended the IRS develop standardized processes to assess data quality and document data fitness for high-impact AI use cases, warning that missing procedures could produce inaccurate, biased, or unreliable AI outputs. IRS management agreed with the recommendation and said it would complete AI impact assessments for currently deployed high-impact AI use cases as of November 2026.", "body_md": "# Data documentation for IRS’s AI use cases is lacking, watchdog finds\n\nThe IRS needs better and more consistent data documentation for entries in its AI use case inventory, according to a Treasury Inspector General for Tax Administration [report](https://www.oversight.gov/sites/default/files/documents/reports/2026-09/2026208059fr.pdf) published Monday.\n\nIn interviews with IRS program managers and data scientists, TIGTA discovered that the agency has been completing data quality checks for its AI use cases, but documentation for each of those use cases in its AI impact assessments has varied.\n\n“For example, 20 percent (1 of 5) of the cases had documents outlining numerous processes and procedures used in testing,” the report said. “The remaining 80 percent (4 of 5) did not have any testing documentation.”\n\nThe IRS is far from the only agency that has struggled to fully meet Office of Management and Budget requirements for documenting AI use cases. The handling of agency inventories has been marked for years by lists with [missing information](https://fedscoop.com/agency-ai-inventories-not-comprehensive-accurate-gao-reports/), [inaccuracies](https://www.gao.gov/products/gao-24-105980) and general [inconsistencies](https://fedscoop.com/the-government-is-struggling-to-track-its-ai-and-thats-a-problem/).  \n\nAt the IRS, the Research, Applied Analytics and Statistics unit is responsible for overseeing the compliance data warehouse and the production of the agency-wide AI use case inventory. The division reports directly to the chief data and analytics officer.\n\nRAAS management told TIGTA that it has completed data checks for AI use cases and taken steps to determine whether data was the right “fit” — referring to “the quality and appropriateness of the data.”\n\nThe RAAS officials also acknowledged to TIGTA that better documentation of AI use cases — and the repeatability and consistency that comes with it — would likely improve risk management decisions.\n\n“However, they did not prioritize documenting or standardizing baseline procedures or guidelines for evaluating data quality checks before their use in high-impact AI models,” the report noted.\n\nWithout better documentation, data quality for AI use cases could be poor, TIGTA added, leading to potential underperformance in AI projects.\n\n“A lack of formal written procedures or guidelines for assessing the quality and appropriateness of the data used in high-impact AI use cases may result in inaccurate, biased, or unreliable AI outputs that can cause significant financial losses and reputational damage,” it said.\n\nThe watchdog recommended that the IRS develop and adopt standardized processes to assess data quality for AI use cases, in addition to documenting “the fitness of data.” Agency management said they agreed with the recommendation and have implemented the suggestions.\n\nTIGTA also found improvements to be made in how the IRS implements risk management practices for high-impact AI use cases, and recommended that the agency follow [OMB requirements](https://www.whitehouse.gov/wp-content/uploads/2025/02/M-25-21-Accelerating-Federal-Use-of-AI-through-Innovation-Governance-and-Public-Trust.pdf). The IRS agreed and said it would “complete AI impact assessments for currently deployed high-impact AI use cases as of November 2026.”", "url": "https://wpnews.pro/news/data-documentation-for-irss-ai-use-cases-is-lacking-watchdog-finds", "canonical_source": "https://fedscoop.com/irs-ai-use-cases-data-quality-tigta-report/", "published_at": "2026-09-28 20:24:13+00:00", "updated_at": "2026-09-28 20:46:27.329418+00:00", "lang": "en", "topics": ["ai-policy", "artificial-intelligence"], "entities": ["IRS", "Treasury Inspector General for Tax Administration", "Research, Applied Analytics and Statistics", "Office of Management and Budget"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/data-documentation-for-irss-ai-use-cases-is-lacking-watchdog-finds", "markdown": "https://wpnews.pro/news/data-documentation-for-irss-ai-use-cases-is-lacking-watchdog-finds.md", "text": "https://wpnews.pro/news/data-documentation-for-irss-ai-use-cases-is-lacking-watchdog-finds.txt", "jsonld": "https://wpnews.pro/news/data-documentation-for-irss-ai-use-cases-is-lacking-watchdog-finds.jsonld"}}