Logo
Login Sign Up
Current Revision

IEEE 3128-2025

IEEE Recommended Practice for the Evaluation of Artificial Intelligence (AI) Dialogue System Capabilities
Best Price Guarantee
Instant

$63.00

2-5 Days

$79.00

SAVE 10%

$127.80


Sub Total (1 Item(s))

$ 0.00

Estimated Shipping

$ 0.00

Total (Pre-Tax)

$ 0.00


or
Institute of Electrical and Electronics Engineers Logo

IEEE 3128-2025

IEEE Recommended Practice for the Evaluation of Artificial Intelligence (AI) Dialogue System Capabilities

PUBLISH DATE 2025
PAGES 34
IEEE 3128-2025
New IEEE Standard - Active. An evaluation framework for the intelligence capabilities of artificial intelligence (AI) dialogue systems such as chatbots, consulting terminals, or operation interfaces is established in this recommended practice. The recommended practice classifies the intelligence capabilities of an AI dialogue system into three categories—cognitive intelligence, emotional intelligence, and system completeness. For each class, the capabilities are subdivided into five intelligence levels, from the lowest level L1 to the highest level L5, with the performance criteria clarified at each level by an evaluation checklist.
This recommended practice establishes an evaluation framework of the capabilities of artificial intelligence (AI) dialogue systems, such as the chatbots or consulting terminals of AI systems. The recommended practice defines and classifies the intelligence capabilities, as well as subdivides the levels of the capabilities according to a series of checklists. The checklists, given under each class of AI capabilities, describe the behavior and performance as corresponding criteria to which the evaluation is carried out with reference. This document may also be used to design and assess the applications of general AI if the classes and levels of intelligence capabilities defined herein are adopted. Only the performance of the features relating to the intelligence of the system is in the scope of this document. Other features, apart from the intelligence, are not in scope. They should follow the interaction principles and general recommendations of other standards not related to AI in design, operation, and maintenance. NOTE--Ability is referred to as being able to fulfill a task, innately or after-trained. Furthermore, capability includes not only present ability but potential competence as well. For this document, both the existing abilities and future potential are in scope.
This recommended practice provides a framework for the evaluation of AI application to dialogue systems; thus, both the industry and the academia can achieve consensus on the terms and the definitions, sharing a common understanding of the test methods as well. This recommended practice can also be used as the test guide for AI dialogue systems in large-scale usage, such as smart manufacturing and smart city construction.
SDO IEEE: Institute of Electrical and Electronics Engineers
Document Number 3128
Publication Date March 28, 2025
Language en - English
Page Count 34
Revision Level
Supercedes
Committee Artificial Intelligence Standards Committee
Publish Date Document Id Type View
March 28, 2025 3128-2025 Revision