Tree ensemble property verification from a testing perspective

No Thumbnail Available
File version
Author(s)
Wang, B
Hou, Z
Zhang, G
Shi, J
Huang, Y
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
2021
Size
File type(s)
Location

Pittsburgh, Pennsylvania, United States

License
Abstract

With the development of artificial intelligence, machine learning algorithms are currently being used in more and more fields, such as autonomous driving, medical diagnosis, etc. In recent years, much research focuses on property verification of machine learning models. As one of the machine learning models, the tree ensemble model's structure is amicable to formal verification, but large models still prove hard to verify due to the combinatorial path explosion. This paper presents a violation-driven, sound but incomplete method from a testing perspective. We generate an explanation model of the original model and verify it formally. After a narrowed search space is obtained, we verify the original model by a testing-based method. A counterexample is then proof that the original model violates the property. We elaborate our method through a case study in detail. And we have developed our method into a tool called TEPV (Tree Ensemble Property Verification) and tested it on datasets of various sizes. The experiment demonstrates that our approach is scalable and works well on large tree ensemble models.

Journal Title
Conference Title

Proceedings of the International Conference on Software Engineering and Knowledge Engineering, SEKE

Book Title
Edition
Volume
Issue
Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement
Item Access Status
Note
Access the data
Related item(s)
Subject

Artificial intelligence

Machine learning

Persistent link to this record
Citation

Wang, B; Hou, Z; Zhang, G; Shi, J; Huang, Y, Tree ensemble property verification from a testing perspective, Proceedings of the International Conference on Software Engineering and Knowledge Engineering, SEKE, 2021, 2021-July, pp. 166-171