Extracting optimal explanations for ensemble trees via automated reasoning

Loading...
Thumbnail Image
File version

Accepted Manuscript (AM)

Author(s)
Zhang, G
Hóu, Z
Huang, Y
Shi, J
Bride, H
Dong, JS
Gao, Y
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
2022
Size
File type(s)
Location
License
Abstract

Ensemble trees are a popular machine learning model which often yields high prediction performance when analysing structured data. Although individual small decision trees are deemed explainable by nature, an ensemble of large trees is often difficult to understand. In this work, we propose an approach called optimised explanation (OptExplain) that faithfully extracts global explanations of ensemble trees using a combination of logical reasoning, sampling, and nature-inspired optimisation. OptExplain is an interpretable surrogate model that is as close as possible to the prediction ability of the original model. Building on top of this, we propose a method called the profile of equivalent classes (ProClass), which simplify the explanation even further by solving the maximum satisfiability problem (MAX-SAT). ProClass gives the profile of the classes and features from the perspective of the model. Experiment on several datasets shows that our approach can provide high-quality explanations to large ensemble tree models, and it betters recent top-performers.

Journal Title

Applied Intelligence

Conference Title
Book Title
Edition
Volume
Issue
Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement

© 2022 Springer US. This is an electronic version of an article published in Applied Intelligence, 2022. Applied Intelligence is available online at: http://link.springer.com/ with the open URL of your article.

Item Access Status
Note

This publication has been entered in Griffith Research Online as an advanced online version.

Access the data
Related item(s)
Subject

Artificial intelligence

Information and computing sciences

Persistent link to this record
Citation

Zhang, G; Hóu, Z; Huang, Y; Shi, J; Bride, H; Dong, JS; Gao, Y, Extracting optimal explanations for ensemble trees via automated reasoning, Applied Intelligence, 2022

Collections