arXiv / 2019

Automatic Machine Learning by Pipeline Synthesis using Model-Based Reinforcement Learning and a Grammar

Iddo Drori, Yamuna Krishnamurthy, Raoni Lourenco, Remi Rampin, Kyunghyun Cho, Claudio Silva, Juliana Freire

Foundation ModelsInterpretabilityLarge Language ModelsOptimizationPopular and Landmark PapersProbabilistic ML

Automatic machine learning is an important problem in the forefront of machine learning. The strongest AutoML systems are based on neural networks, evolutionary algorithms, and Bayesian optimization. Recently AlphaD3M reached state-of-the-art results with an order of magnitude speedup using reinforcement learning with self-play. In this work we extend AlphaD3M by using a pipeline grammar and a pre-trained model which generalizes from many different datasets and similar tasks. Our results demonstrate improved performance compared with our earlier work and existing methods on AutoML benchmark datasets for classification and regression tasks. In the spirit of reproducible research we make our data, models, and code publicly available.

0 citations0 influential

Full paper

Read the original paper

Open PDF Source page

Learning resources

arXiv PDFPDF arXiv abstract pagearXiv Google Scholar referencesGoogle Scholar Papers with Code searchPapers with Code YouTube explanationsYouTube

Reading state

Discuss in ChatGPT

Uses your own ChatGPT account. The paper context is copied into a tutor prompt before ChatGPT opens.

Preview prompt

You are my AI/ML research paper instructor. I want to deeply understand the paper below.

First, teach it in layers:
1. One-paragraph intuition.
2. Problem statement and why it mattered.
3. Key method, architecture, or algorithm.
4. Important equations or mechanisms, explained intuitively.
5. Experiments and evidence.
6. Limitations, assumptions, and failure modes.
7. How this paper influenced later AI/ML/Deep Learning/GenAI work.
8. A 30-minute study plan with checkpoints.
9. Quiz me with 5 questions and wait for my answers.

When something is not available in the attached context, say what is missing and infer carefully.

### Paper attached as context
Title: Automatic Machine Learning by Pipeline Synthesis using Model-Based Reinforcement Learning and a Grammar
Authors: Iddo Drori, Yamuna Krishnamurthy, Raoni Lourenco, Remi Rampin, Kyunghyun Cho, Claudio Silva, Juliana Freire
Year: 2019
Venue: arXiv
Categories: Foundation Models, Interpretability, Large Language Models, Optimization, Popular and Landmark Papers, Probabilistic ML
Citations: 0
Paper URL: https://arxiv.org/abs/1905.10345v1
Open PDF: https://arxiv.org/pdf/1905.10345v1

Abstract:
Automatic machine learning is an important problem in the forefront of machine learning. The strongest AutoML systems are based on neural networks, evolutionary algorithms, and Bayesian optimization. Recently AlphaD3M reached state-of-the-art results with an order of magnitude speedup using reinforcement learning with self-play. In this work we extend AlphaD3M by using a pipeline grammar and a pre-trained model which generalizes from many different datasets and similar tasks. Our results demonstrate improved performance compared with our earlier work and existing methods on AutoML benchmark datasets for classification and regression tasks. In the spirit of reproducible research we make our data, models, and code publicly available.

Learning resources:
- PDF: arXiv PDF (https://arxiv.org/pdf/1905.10345v1)
- arXiv: arXiv abstract page (https://arxiv.org/abs/1905.10345v1)
- Google Scholar: Google Scholar references (https://scholar.google.com/scholar?q=Automatic%20Machine%20Learning%20by%20Pipeline%20Synthesis%20using%20Model-Based%20Reinforcement%20Learning%20and%20a%20Grammar)
- Papers with Code: Papers with Code search (https://paperswithcode.com/search?q=Automatic%20Machine%20Learning%20by%20Pipeline%20Synthesis%20using%20Model-Based%20Reinforcement%20Learning%20and%20a%20Grammar)
- YouTube: YouTube explanations (https://www.youtube.com/results?search_query=Automatic%20Machine%20Learning%20by%20Pipeline%20Synthesis%20using%20Model-Based%20Reinforcement%20Learning%20and%20a%20Grammar+paper+explained)