arXiv / 2018

Interpretable to Whom? A Role-based Model for Analyzing Interpretable Machine Learning Systems

Richard Tomsett, Dave Braines, Dan Harborne, Alun Preece, Supriyo Chakraborty

Computer VisionInterpretabilityPopular and Landmark PapersReinforcement Learning

Several researchers have argued that a machine learning system's interpretability should be defined in relation to a specific agent or task: we should not ask if the system is interpretable, but to whom is it interpretable. We describe a model intended to help answer this question, by identifying different roles that agents can fulfill in relation to the machine learning system. We illustrate the use of our model in a variety of scenarios, exploring how an agent's role influences its goals, and the implications for defining interpretability. Finally, we make suggestions for how our model could be useful to interpretability researchers, system developers, and regulatory bodies auditing machine learning systems.

0 citations0 influential

Full paper

Read the original paper

Open PDF Source page

Learning resources

arXiv PDFPDF arXiv abstract pagearXiv Google Scholar referencesGoogle Scholar Papers with Code searchPapers with Code YouTube explanationsYouTube

Reading state

Discuss in ChatGPT

Uses your own ChatGPT account. The paper context is copied into a tutor prompt before ChatGPT opens.

Preview prompt

You are my AI/ML research paper instructor. I want to deeply understand the paper below.

First, teach it in layers:
1. One-paragraph intuition.
2. Problem statement and why it mattered.
3. Key method, architecture, or algorithm.
4. Important equations or mechanisms, explained intuitively.
5. Experiments and evidence.
6. Limitations, assumptions, and failure modes.
7. How this paper influenced later AI/ML/Deep Learning/GenAI work.
8. A 30-minute study plan with checkpoints.
9. Quiz me with 5 questions and wait for my answers.

When something is not available in the attached context, say what is missing and infer carefully.

### Paper attached as context
Title: Interpretable to Whom? A Role-based Model for Analyzing Interpretable Machine Learning Systems
Authors: Richard Tomsett, Dave Braines, Dan Harborne, Alun Preece, Supriyo Chakraborty
Year: 2018
Venue: arXiv
Categories: Computer Vision, Interpretability, Popular and Landmark Papers, Reinforcement Learning
Citations: 0
Paper URL: https://arxiv.org/abs/1806.07552v1
Open PDF: https://arxiv.org/pdf/1806.07552v1

Abstract:
Several researchers have argued that a machine learning system's interpretability should be defined in relation to a specific agent or task: we should not ask if the system is interpretable, but to whom is it interpretable. We describe a model intended to help answer this question, by identifying different roles that agents can fulfill in relation to the machine learning system. We illustrate the use of our model in a variety of scenarios, exploring how an agent's role influences its goals, and the implications for defining interpretability. Finally, we make suggestions for how our model could be useful to interpretability researchers, system developers, and regulatory bodies auditing machine learning systems.

Learning resources:
- PDF: arXiv PDF (https://arxiv.org/pdf/1806.07552v1)
- arXiv: arXiv abstract page (https://arxiv.org/abs/1806.07552v1)
- Google Scholar: Google Scholar references (https://scholar.google.com/scholar?q=Interpretable%20to%20Whom%3F%20A%20Role-based%20Model%20for%20Analyzing%20Interpretable%20Machine%20Learning%20Systems)
- Papers with Code: Papers with Code search (https://paperswithcode.com/search?q=Interpretable%20to%20Whom%3F%20A%20Role-based%20Model%20for%20Analyzing%20Interpretable%20Machine%20Learning%20Systems)
- YouTube: YouTube explanations (https://www.youtube.com/results?search_query=Interpretable%20to%20Whom%3F%20A%20Role-based%20Model%20for%20Analyzing%20Interpretable%20Machine%20Learning%20Systems+paper+explained)