Research Paper ML Hub

AI research atlas / v2

Learn AI papers in the right order.

Start with landmark ideas, move through foundations, then branch into LLMs, GenAI, agents, systems, and safety with a reading path that keeps the field from feeling random.

10 learning tracksFull-paper readerChatGPT handoff
Recommended firstLandmark papers

Build the mental timeline before going deep.

Then specializeLLMs, GenAI, safety

Move from foundations to modern systems.

Read modePDF + resources
Path-firstNo more random paper hopping
Research-nativearXiv links, PDFs, resources
Study loopTrack reading and discuss in ChatGPT

Learning path

Where to start, and what to read next

Start with landmarks
01

Orientation / 1-2 weeks

Start Here

Read the papers everyone keeps referencing so the rest of the map has anchors.

Know the landmark namesBuild historical contextPick a direction
Open papers
02

Foundations / 2-4 weeks

Classical ML

Learn the statistical and probabilistic ideas that still sit under modern models.

Bayesian thinkingModel evaluationUncertainty
Open papers
03

Foundations / 1-2 weeks

Optimization

Understand the training mechanics behind gradient-based learning.

Gradient descentGeneralizationTraining stability
Open papers
04

Builder / 3-5 weeks

Deep Learning Core

Move through representation learning, CNNs, residual networks, and scaling patterns.

CNN intuitionRepresentation learningBenchmark culture
Open papers
05

Builder / 3-6 weeks

Sequence Models and LLMs

Study attention, transformers, language modeling, instruction tuning, and evaluation.

AttentionPretrainingInstruction following
Open papers
06

Specialist / 3-6 weeks

Generative AI

Compare GANs, diffusion, autoregressive generation, and modern GenAI workflows.

DiffusionGANsGeneration tradeoffs
Open papers
07

Specialist / 2-4 weeks

Multimodal and Retrieval

Connect language with images, retrieval, embeddings, and real-world knowledge access.

Vision-languageEmbeddingsRetrieval
Open papers
08

Specialist / 3-5 weeks

RL and Agents

Learn decision making, feedback, policy learning, and agent-style systems.

PoliciesRewardsExploration
Open papers
09

Practitioner / 2-4 weeks

Systems and Scaling

Understand the infrastructure and engineering papers behind large-scale training.

Distributed trainingServingEfficiency
Open papers
10

Practitioner / 2-4 weeks

Safety and Interpretability

Study robustness, alignment, transparency, and how to reason about model behavior.

AlignmentRobustnessInterpretability
Open papers

Research library

Reinforcement Learning

Showing papers for this learning path. Open any paper card to read the full paper and related resources.

40 papers shown
unread2023

MizAR 60 for Mizar 50

As a present to Mizar on its 50th anniversary, we develop an AI/TP system that automatically proves about 60% of the Mizar theorems in the hammer setting. We also automatically prove 75% of the Mizar theorems when the automated provers are helped by using only the premises used in the human-written Mizar proofs. We describe the methods and large-scale experiments leading to these results. This includes in particular the E and Vampire provers, their ENIGMA and Deepire learning modifications, a number of learning-based premise selection methods, and the incremental loop that interleaves growing a corpus of millions of ATP proofs with training increasingly strong AI/TP systems on them. We also present a selection of Mizar problems that were proved automatically.

Jakubův, Jan, Chvalovský, Karel, Goertzel, Zarathustra 75,444
Reinforcement Learning
unread2015

Human-level control through deep reinforcement learning

No abstract available yet.

Volodymyr Mnih, Koray Kavukcuoglu, David Silver 29,498
Reinforcement Learning
unread2016

Mastering the game of Go with deep neural networks and tree search

No abstract available yet.

David Silver, Aja Huang, Chris J. Maddison 15,673
Reinforcement Learning
unread2017

Diagnosing Non-Intermittent Anomalies in Reinforcement Learning Policy Executions (Short Paper)

Due to the safety risks and training sample inefficiency, it is often preferred to develop controllers in simulation. However, minor differences between the simulation and the real world can cause a significant sim-to-real gap. This gap can reduce the effectiveness of the developed controller. In this paper, we examine a case study of transferring an octorotor reinforcement learning controller from simulation to the real world. First, we quantify the effectiveness of the real-world transfer by examining safety metrics. We find that although there is a noticeable (around 100%) increase in deviation in real flights, this deviation may not be considered unsafe, as it will be within > 2m safety corridors. Then, we estimate the densities of the measurement distributions and compare the Jensen-Shannon divergences of simulated and real measurements. From this, we show that the vehicle’s orientation is significantly different between simulated and real flights. We attribute this to a different flight mode in real flights where the vehicle turns to face the next waypoint. We also find that the reinforcement learning controller actions appear to correctly counteract disturbance forces. Then, we analyze the errors of a measurement autoencoder and state transition model neural network applied to real data. We find that these models further reinforce the difference between the simulated and real attitude control, showing the errors directly on the flight paths. Finally, we discuss important lessons learned in the sim-to-real transfer of our controller.

Natan, Avraham, Stern, Roni, Kalech, Meir 11,277
Reinforcement Learning
unread2013

Playing Atari with Deep Reinforcement Learning

We present the first deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning. The model is a convolutional neural network, trained with a variant of Q-learning, whose input is raw pixels and whose output is a value function estimating future rewards. We apply our method to seven Atari 2600 games from the Arcade Learning Environment, with no adjustment of the architecture or learning algorithm. We find that it outperforms all previous approaches on six of the games and surpasses a human expert on three of them.

Volodymyr Mnih, Koray Kavukcuoglu, David Silver 5,121
Reinforcement Learning
unread2023

Artificial Intelligence, Machine Learning and Deep Learning in Advanced Robotics, A Review

No abstract available yet.

Mohsen Soori, B. Arezoo, Roza Dastres 874
Reinforcement Learning
unread2018

Artificial Intelligence, Machine Learning, Deep Learning, and Cognitive Computing: What Do These Terms Mean and How Will They Impact Health Care?

This article was presented at the 2017 annual meeting of the American Association of Hip and Knee Surgeons to introduce the members gathered as the audience to the concepts behind artificial intelligence (AI) and the applications that AI can have in the world of health care today. We discuss the origin of AI, progress to machine learning, and then discuss how the limits of machine learning lead data scientists to develop artificial neural networks and deep learning algorithms through biomimicry. We will place all these technologies in the context of practical clinical examples and show how AI can act as a tool to support and amplify human cognitive functions for physicians delivering care to increasingly complex patients. The aim of this article is to provide the reader with a basic understanding of the fundamentals of AI. Its purpose is to demystify this technology for practicing surgeons so they can better understand how and where to apply it.

S. Bini 529
Reinforcement Learning
unread2018

Building Trust in Artificial Intelligence, Machine Learning, and Robotics

No abstract available yet.

K. Siau, Weiyu Wang 498
Reinforcement Learning
unread2018

Artificial intelligence, machine learning and health systems

Artificial Intelligence and machine learning have the potential to be the catalyst for transformation of health systems to improve efficiency and effectiveness, create headroom for universal health coverage and improve outcomes

T. Panch, Peter Szolovits, R. Atun 445
Reinforcement Learning
unread2017

Artificial intelligence, machine learning and deep learning

No abstract available yet.

Pariwat Ongsulee 283
Reinforcement Learning
unread2019

Artificial Intelligence, Machine Learning, Automation, Robotics, Future of Work and Future of Humanity: A Review and Research Agenda

The exponential advancement in artificial intelligence (AI), machine learning, robotics, and automation are rapidly transforming industries and societies across the world. The way we work, the way we live, and the way we interact with others are expected to be transformed at a speed and scale beyond anything we have observed in human history. This new industrial revolution is expected, on one hand, to enhance and improve our lives and societies. On the other hand, it has the potential to cause major upheavals in our way of life and our societal norms. The window of opportunity to understand the impact of these technologies and to preempt their negative effects is closing rapidly. Humanity needs to be proactive, rather than reactive, in managing this new industrial revolution. This article looks at the promises, challenges, and future research directions of these transformative technologies. Not only are the technological aspects investigated, but behavioral, societal, policy, and governance issues are reviewed as well. This research contributes to the ongoing discussions and debates about AI, automation, machine learning, and robotics. It is hoped that this article will heighten awareness of the importance of understanding these disruptive technologies as a basis for formulating policies and regulations that can maximize the benefits of these advancements for humanity and, at the same time, curtail potential dangers and negative impacts.

Weiyu Wang, K. Siau 281
Reinforcement Learning
unread2020

A Review of Further Directions for Artificial Intelligence, Machine Learning, and Deep Learning in Smart Logistics

Industry 4.0 concepts and technologies ensure the ongoing development of micro- and macro-economic entities by focusing on the principles of interconnectivity, digitalization, and automation. In this context, artificial intelligence is seen as one of the major enablers for Smart Logistics and Smart Production initiatives. This paper systematically analyzes the scientific literature on artificial intelligence, machine learning, and deep learning in the context of Smart Logistics management in industrial enterprises. Furthermore, based on the results of the systematic literature review, the authors present a conceptual framework, which provides fruitful implications based on recent research findings and insights to be used for directing and starting future research initiatives in the field of artificial intelligence (AI), machine learning (ML), and deep learning (DL) in Smart Logistics.

M. Woschank, E. Rauch, Helmut E. Zsifkovits 254
Reinforcement Learning
unread2022

Artificial Intelligence, Machine Learning, and Deep Learning in Structural Engineering: A Scientometrics Review of Trends and Best Practices

No abstract available yet.

Arash Teymori Gharah Tapeh, M. Z. Naser 228
Reinforcement Learning
unread2020

The need for a system view to regulate artificial intelligence/machine learning-based software as medical device

Artificial intelligence (AI) and Machine learning (ML) systems in medicine are poised to significantly improve health care, for example, by offering earlier diagnoses of diseases or recommending optimally individualized treatment plans. However, the emergence of AI/ML in medicine also creates challenges, which regulators must pay attention to. Which medical AI/ML-based products should be reviewed by regulators? What evidence should be required to permit marketing for AI/ML-based software as a medical device (SaMD)? How can we ensure the safety and effectiveness of AI/ML-based SaMD that may change over time as they are applied to new data? The U.S. Food and Drug Administration (FDA), for example, has recently proposed a discussion paper to address some of these issues. But it misses an important point: we argue that regulators like the FDA need to widen their scope from evaluating medical AI/ML-based products to assessing systems. This shift in perspective—from a product view to a system view—is central to maximizing the safety and efficacy of AI/ML in health care, but it also poses significant challenges for agencies like the FDA who are used to regulating products, not systems. We offer several suggestions for regulators to make this challenging but important transition.

S. Gerke, Boris Babic, T. Evgeniou 225
Reinforcement Learning
unread2019

Promising Artificial Intelligence‐Machine Learning‐Deep Learning Algorithms in Ophthalmology

Abstract: The lifestyle of modern society has changed significantly with the emergence of artificial intelligence (AI), machine learning (ML), and deep learning (DL) technologies in recent years. Artificial intelligence is a multidimensional technology with various components such as advanced algorithms, ML and DL. Together, AI, ML, and DL are expected to provide automated devices to ophthalmologists for early diagnosis and timely treatment of ocular disorders in the near future. In fact, AI, ML, and DL have been used in ophthalmic setting to validate the diagnosis of diseases, read images, perform corneal topographic mapping and intraocular lens calculations. Diabetic retinopathy (DR), age‐related macular degeneration (AMD), and glaucoma are the 3 most common causes of irreversible blindness on a global scale. Ophthalmic imaging provides a way to diagnose and objectively detect the progression of a number of pathologies including DR, AMD, glaucoma, and other ophthalmic disorders. There are 2 methods of imaging used as diagnostic methods in ophthalmic practice: fundus digital photography and optical coherence tomography (OCT). Of note, OCT has become the most widely used imaging modality in ophthalmology settings in the developed world. Changes in population demographics and lifestyle, extension of average lifespan, and the changing pattern of chronic diseases such as obesity, diabetes, DR, AMD, and glaucoma create a rising demand for such images. Furthermore, the limitation of availability of retina specialists and trained human graders is a major problem in many countries. Consequently, given the current population growth trends, it is inevitable that analyzing such images is time‐consuming, costly, and prone to human error. Therefore, the detection and treatment of DR, AMD, glaucoma, and other ophthalmic disorders through unmanned automated applications system in the near future will be inevitable. We provide an overview of the potential impact of the current AI, ML, and DL methods and their applications on the early detection and treatment of DR, AMD, glaucoma, and other ophthalmic diseases.

L. Balyen, T. Peto 220
Reinforcement Learning
unread2024

FDA-Approved Artificial Intelligence and Machine Learning (AI/ML)-Enabled Medical Devices: An Updated Landscape

As artificial intelligence (AI) has been highly advancing in the last decade, machine learning (ML)-enabled medical devices are increasingly used in healthcare. In this study, we collected publicly available information on AI/ML-enabled medical devices approved by the FDA in the United States, as of the latest update on 19 October 2023. We performed comprehensive analysis of a total of 691 FDA-approved artificial intelligence and machine learning (AI/ML)-enabled medical devices and offer an in-depth analysis of clearance pathways, approval timeline, regulation type, medical specialty, decision type, recall history, etc. We found a significant surge in approvals since 2018, with clear dominance of the radiology specialty in the application of machine learning tools, attributed to the abundant data from routine clinical data. The study also reveals a reliance on the 510(k)-clearance pathway, emphasizing its basis on substantial equivalence and often bypassing the need for new clinical trials. Also, it notes an underrepresentation of pediatric-focused devices and trials, suggesting an opportunity for expansion in this demographic. Moreover, the geographical limitation of clinical trials, primarily within the United States, points to a need for more globally inclusive trials to encompass diverse patient demographics. This analysis not only maps the current landscape of AI/ML-enabled medical devices but also pinpoints trends, potential gaps, and areas for future exploration, clinical trial practices, and regulatory approaches. In conclusion, our analysis sheds light on the current state of FDA-approved AI/ML-enabled medical devices and prevailing trends, contributing to a wider comprehension.

Geeta Joshi, Aditi Jain, Shalini Reddy Araveeti 187
Reinforcement Learning
unread2023

Artificial Intelligence, Machine Learning and Deep Learning: Potential Resources for the Infection Clinician.

BACKGROUND Artificial intelligence (AI), machine learning and deep learning (including generative AI) are increasingly being investigated in the context of research and management of human infection. OBJECTIVES We summarise recent and potential future applications of AI and its relevance to clinical infection practice. METHODS 1,617 PubMed results were screened, with priority given to clinical trials, systematic reviews and meta-analyses. This narrative review focusses on studies using prospectively collected real-world data with clinical validation, and on research with translational potential, such as novel drug discovery and microbiome-based interventions. RESULTS There is some evidence of clinical utility of AI applied to laboratory diagnostics (e.g. digital culture plate reading, malaria diagnosis, antimicrobial resistance profiling), clinical imaging analysis (e.g. pulmonary tuberculosis diagnosis), clinical decision support tools (e.g. sepsis prediction, antimicrobial prescribing) and public health outbreak management (e.g. COVID-19). Most studies to date lack any real-world validation or clinical utility metrics. Significant heterogeneity in study design and reporting limits comparability. Many practical and ethical issues exist, including algorithm transparency and risk of bias. CONCLUSIONS Interest in and development of AI-based tools for infection research and management are undoubtedly gaining pace, although the real-world clinical utility to date appears much more modest.

A. Theodosiou, R. Read 173
Reinforcement Learning
unread2023

Artificial intelligence, machine learning, and deep learning in liver transplantation.

Liver transplantation (LT) is a life-saving treatment for individuals with end-stage liver disease. The management of LT recipients is complex, predominantly because of the need to consider demographic, clinical, laboratory, pathology, imaging, and omics data in the development of an appropriate treatment plan. Current methods to collate clinical information are susceptible to some degree of subjectivity; thus, clinical decision-making in LT could benefit from the data-driven approach offered by artificial intelligence (AI). Machine learning and deep learning could be applied in both the pre- and post-LT settings. Some examples of AI applications pre-transplant include optimising transplant candidacy decision-making and donor-recipient matching to reduce waitlist mortality and improve post-transplant outcomes. In the post-LT setting, AI could help guide the management of LT recipients, particularly by predicting patient and graft survival, along with identifying risk factors for disease recurrence and other associated complications. Although AI shows promise in medicine, there are limitations to its clinical deployment which include dataset imbalances for model training, data privacy issues, and a lack of available research practices to benchmark model performance in the real world. Overall, AI tools have the potential to enhance personalised clinical decision-making, especially in the context of liver transplant medicine.

M. Bhat, Madhumitha Rabindranath, B. Chara 169
Reinforcement Learning
unread2019

Artificial intelligence, machine learning and deep learning: definitions and differences

Artificial intelligence (AI) and its application is the next big thing in dermatological imaging, including, but not limited to, image acquisition, processing, interpretation, reporting and follow-up planning. In addition, there are additional benefits of data integration, data storage and data mining. In fact, the possible applications are so many that AI is expected to become an in-separable tool in a dermatologist's life. Most of the dermatologists, however, are still illiterate in AI. This article is protected by copyright. All rights reserved.

D. Jakhar, I. Kaur 157
Reinforcement Learning
unread2020

Artificial Intelligence, Machine Learning, and Cardiovascular Disease

Artificial intelligence (AI)-based applications have found widespread applications in many fields of science, technology, and medicine. The use of enhanced computing power of machines in clinical medicine and diagnostics has been under exploration since the 1960s. More recently, with the advent of advances in computing, algorithms enabling machine learning, especially deep learning networks that mimic the human brain in function, there has been renewed interest to use them in clinical medicine. In cardiovascular medicine, AI-based systems have found new applications in cardiovascular imaging, cardiovascular risk prediction, and newer drug targets. This article aims to describe different AI applications including machine learning and deep learning and their applications in cardiovascular medicine. AI-based applications have enhanced our understanding of different phenotypes of heart failure and congenital heart disease. These applications have led to newer treatment strategies for different types of cardiovascular diseases, newer approach to cardiovascular drug therapy and postmarketing survey of prescription drugs. However, there are several challenges in the clinical use of AI-based applications and interpretation of the results including data privacy, poorly selected/outdated data, selection bias, and unintentional continuance of historical biases/stereotypes in the data which can lead to erroneous conclusions. Still, AI is a transformative technology and has immense potential in health care.

P. Mathur, S. Srivastava, Xiaowei Xu 152
Reinforcement Learning
unread2019

Artificial intelligence, machine learning, computer-aided diagnosis, and radiomics: advances in imaging towards to precision medicine

The discipline of radiology and diagnostic imaging has evolved greatly in recent years. We have observed an exponential increase in the number of exams performed, subspecialization of medical fields, and increases in accuracy of the various imaging methods, making it a challenge for the radiologist to “know everything about all exams and regions”. In addition, imaging exams are no longer only qualitative and diagnostic, providing now quantitative information on disease severity, as well as identifying biomarkers of prognosis and treatment response. In view of this, computer-aided diagnosis systems have been developed with the objective of complementing diagnostic imaging and helping the therapeutic decision-making process. With the advent of artificial intelligence, “big data”, and machine learning, we are moving toward the rapid expansion of the use of these tools in daily life of physicians, making each patient unique, as well as leading radiology toward the concept of multidisciplinary approach and precision medicine. In this article, we will present the main aspects of the computational tools currently available for analysis of images and the principles of such analysis, together with the main terms and concepts involved, as well as examining the impact that the development of artificial intelligence has had on radiology and diagnostic imaging.

M. Santos, J. F. Ferreira Júnior, D. T. Wada 135
Reinforcement Learning
unread2021

Trends in artificial intelligence, machine learning, and chemometrics applied to chemical data

Abstract Artificial intelligence‐based methods such as chemometrics, machine learning, and deep learning are promising tools that lead to a clearer and better understanding of data. Only with these tools, data can be used to its full extent, and the gained knowledge on processes, interactions, and characteristics of the sample is maximized. Therefore, scientists are developing data science tools mentioned above to automatically and accurately extract information from data and increase the application possibilities of the respective data in various fields. Accordingly, AI‐based techniques were utilized for chemical data since the 1970s and this review paper focuses on the recent trends of chemometrics, machine learning, and deep learning for chemical and spectroscopic data in 2020. In this regard, inverse modeling, preprocessing methods, and data modeling applied to spectra and image data for various measurement techniques are discussed.

Rola Houhou, Thomas Bocklitz 125
Reinforcement Learning
unread2020

Artificial intelligence, machine learning and process automation: existing knowledge frontier and way forward for mining sector

No abstract available yet.

Danish Ali, S. Frimpong 113
Reinforcement Learning
unread2024

Artificial Intelligence, Machine Learning, and Deep Learning for Advanced Business Strategies: a Review

No abstract available yet.

N. Rane, Mallikarjuna Paramesha, Saurabh P. Choudhary 111
Reinforcement Learning
unread2023

Artificial Intelligence/Machine Learning in Energy Management Systems, Control, and Optimization of Hydrogen Fuel Cell Vehicles

Environmental emissions, global warming, and energy-related concerns have accelerated the advancements in conventional vehicles that primarily use internal combustion engines. Among the existing technologies, hydrogen fuel cell electric vehicles and fuel cell hybrid electric vehicles may have minimal contributions to greenhouse gas emissions and thus are the prime choices for environmental concerns. However, energy management in fuel cell electric vehicles and fuel cell hybrid electric vehicles is a major challenge. Appropriate control strategies should be used for effective energy management in these vehicles. On the other hand, there has been significant progress in artificial intelligence, machine learning, and designing data-driven intelligent controllers. These techniques have found much attention within the community, and state-of-the-art energy management technologies have been developed based on them. This manuscript reviews the application of machine learning and intelligent controllers for prediction, control, energy management, and vehicle to everything (V2X) in hydrogen fuel cell vehicles. The effectiveness of data-driven control and optimization systems are investigated to evolve, classify, and compare, and future trends and directions for sustainability are discussed.

Mojgan Fayyazi, Paramjotsingh Sardar, Sumit Infent Thomas 98
Reinforcement Learning
unread2020

KungFu: Making Training in Distributed Machine Learning Adaptive

No abstract available yet.

Luo Mai, Guo Li, Marcel Wagenländer 91
Reinforcement Learning
unread2019

Artificial Intelligence, Machine Learning, and Autonomous Technologies in Mining Industry

The implementation of artificial intelligence (AI), machine learning, and autonomous technologies in the mining industry started about a decade ago with autonomous trucks. Artificial intelligence, machine learning, and autonomous technologies provide many economic benefits for the mining industry through cost reduction, efficiency, and improving productivity, reducing exposure of workers to hazardous conditions, continuous production, and improved safety. However, the implementation of these technologies has faced economic, financial, technological, workforce, and social challenges. This article discusses the current status of AI, machine learning, and autonomous technologies implementation in the mining industry and highlights potential areas of future application. The article presents the results of interviews with some of the stakeholders in the industry and what their perceptions are about the threats, challenges, benefits, and potential impacts of these advanced technologies. The article also presents their views on the future of these technologies and what are some of the steps needed for successful implementation of these technologies in this sector.

Zeshan Hyder, K. Siau, F. Nah 88
Reinforcement Learning
unread2019

Rethinking Drug Repositioning and Development with Artificial Intelligence, Machine Learning, and Omics

Abstract Pharmaceutical industry and the art and science of drug development are sorely in need of novel transformative technologies in the current age of digital health and artificial intelligence (AI). Often described as game-changing technologies, AI and machine learning algorithms have slowly but surely begun to revolutionize pharmaceutical industry and drug development over the past 5 years. In this expert review, we describe the most frequently used machine learning algorithms in drug development pipelines and the -omics databases well poised to support machine learning and drug discovery. Subsequently, we analyze the emerging new computational approaches to drug discovery and the in silico pipelines for drug repositioning and the synergies among -omics system sciences, AI and machine learning. As with system sciences, AI and machine learning embody a system scale and Big Data driven vision for drug discovery and development. We conclude with a future outlook on the ways in which machine learning approaches can be implemented to buttress and expedite drug discovery and precision medicine. As AI and machine learning are rapidly entering pharmaceutical industry and the art and science of drug development, we need to critically examine the attendant prospects and challenges to benefit patients and public health.

M. Koromina, Maria-Theodora Pandi, G. Patrinos 85
Reinforcement Learning
unreadn.d.

Artificial intelligence: machine learning for chemical sciences

No abstract available yet.

A. Karthikeyan, Deva Priyakumar 76
Reinforcement Learning
unread2022

Artificial Intelligence, Machine Learning and Smart Technologies for Nondestructive Evaluation

Nondestructive evaluation (NDE) techniques are used in many industries to evaluate the properties of components and inspect for flaws and anomalies in structures without altering the part’s integrity or causing damage to the component being tested. This includes monitoring materials’ condition (Material State Awareness (MSA)) and health of structures (Structural Health Monitoring (SHM)). NDE techniques are highly valuable tools to help prevent potential losses and hazards arising from the failure of a component while saving time and cost by not compromising its future usage. On the other hand, Artificial Intelligence (AI) and Machine Learning (ML) techniques are useful tools which can help automating data collection and analyses, providing new insights, and potentially improving detection performance in a quick and low effort manner with great cost savings. This paper presents a survey on state of the art AI-ML techniques for NDE and the application of related smart technologies including Machine Vision (MV) and Digital Twins in NDE.

H. Taheri, Maria Gonzalez Bocanegra, Mohammad Taheri 73
Reinforcement Learning
unread2021

Needs and Performance Analysis for Changes in Higher Education and Implementation of Artificial Intelligence, Machine Learning, and Extended Reality

Higher education in the Republic of Serbia needs to be reformed. This paper presents a performance analysis of the changes that the authors assume are mandatory, presenting the research problem this article addresses. Cabinet research, performed by analyzing the theoretical building blocks of available knowledge and experience, is underway. Articles and studies from various publications, such as academic journals and institutes, were used as sources. In addition, academic articles and papers and studies about artificial intelligence, machine learning, and extended reality were also consulted. The authors consider that these technologies could be of great assistance in developing a new higher education strategy. Further, this research is exploratory given that information from the 100 Serbian students from selected higher education institutions was used to better understand if these technologies are welcomed by students. Based on SmartPls software, the research analysis proved that artificial intelligence (AI) and machine learning (ML) are appropriate technologies implemented in higher education institutions (HEI) to develop skills among students, a collaborative learning environment, and an accessible research environment. Additionally, extended reality (XR) facilitates increased motivation, engagement, and learning-by-doing activities between students, offering a realistic environment for learning.

Milena P. Ilić, D. Păun, Nevenka Popović Šević 64
Reinforcement Learning
unread2019

Artificial intelligence/machine learning in manufacturing and inspection: A GE perspective

At GE Research, we are combining “physics” with artificial intelligence and machine learning to advance manufacturing design, processing, and inspection, turning innovative technologies into real products and solutions across our industrial portfolio. This article provides a snapshot of how this physical plus digital transformation is evolving at GE.

K. Aggour, V. Gupta, D. Ruscitto 63
Reinforcement Learning
unread2024

Adaptive reinforcement learning-based control using proximal policy optimization and slime mould algorithm with experimental tower crane system validation

This paper presents a novel optimal reference tracking control approach resulted from the combination of a popular policy gradient Reinforcement Learning (RL) algorithm, namely Proximal Policy Optimization (PPO), and a metaheuristic Slime Mould Algorithm (SMA). One of the most important parameters in the PPO-based RL process is the learning rate, which has a big impact on how the parameters of the actor neural network (NN) are iteratively updated. In every episode of the RL process, the weights and the biases of the actor NN are multiplied with the learning rate, determining how much the learning agent will step into a certain direction computed based on previous experiences. The classical PPO algorithm usually relies on fixed values for the learning rates which rarely change, or not at all, during the learning process. However, its main drawback is that the learning agent cannot take advantage of positive momentum in the learning process by accelerating towards good learning experiences or slow down and quickly change the direction in the case of consecutive negative learning experiences. The main objective of the combination proposed in this paper is to create an adaptive SMA-based PPO approach applied to control systems, which instead of using fixed learning rate values, it uses the SMA to compute optimal values of the learning rates in each time step of the learning process based on the progress of the learning agent. This paper investigates if the adaptive SMA-based PPO control approach can be considered as an alternative to the classical PPO version, which employs fixed values of the learning rate. A comparison is carried out using control system performance indices gathered while performing an optimal reference tracking control task on tower crane system laboratory equipment.

Iuliu Alexandru Zamfirache, Radu‐Emil Precup, Emil M. Petriu 62
Reinforcement Learning
unread2021

A Survey on the Role of Artificial Intelligence, Machine Learning and Deep Learning for Cybersecurity Attack Detection

With the growing internet services, cybersecurity becomes one of the major research problems of the modern digital era. Cybersecurity involves techniques to protect and control the systems, hardware, software, network, and electronic data from unauthorized access. It is necessary to build a cyber-security system to detect different types of attacks. Implementing various intelligent algorithms in cybersecurity led to detect and analyz attack actions occurring in field of computer networks. Cybersecurity uses artificial intelligence, machine learning, and deep learning algorithms capable of extracting optimal feature representation from the big data set. This has been applied to various cybersecurity cases, such as attacks detection, prediction, and analysis. This work aims to perform an analysis of cybersecurity attacks datasets by using intelligent approaches. It also provides a detailed comparison with the performance of algorithms, field implementation to describe network protection optimization technologies benefits.

A. Salih, Subhi T. Zeebaree, Sadeeq y. Ameen 52
Reinforcement Learning
unread2022

Artificial intelligence, machine learning and deep learning in musculoskeletal imaging: Current applications

Artificial intelligence is rapidly expanding in all technological fields. The medical field, and especially diagnostic imaging, has been showing the highest developmental potential. Artificial intelligence aims at human intelligence simulation through the management of complex problems. This review describes the technical background of artificial intelligence, machine learning, and deep learning. The first section illustrates the general potential of artificial intelligence applications in the context of request management, data acquisition, image reconstruction, archiving, and communication systems. In the second section, the prospective of dedicated tools for segmentation, lesion detection, automatic diagnosis, and classification of musculoskeletal disorders is discussed.

T. D’angelo, Danilo Caudo, A. Blandino 48
Reinforcement Learning
unread2019

Artificial Intelligence/Machine Learning in Diabetes Care

Artificial intelligence/Machine learning (AI/ML) is transforming all spheres of our life, including the healthcare system. Application of AI/ML has a potential to vastly enhance the reach of diabetes care thereby making it more efficient. The huge burden of diabetes cases in India represents a unique set of problems, and provides us with a unique opportunity in terms of potential availability of data. Harnessing this data using electronic medical records, by all physicians, can put India at the forefront of research in this area. Application of AI/ML would provide insights to our problems as well as may help us to devise tailor-made solutions for the same.

R. Singla, Ankush Singla, Y. Gupta 39
Reinforcement Learning
unread2022

Algorithm Auditing: Managing the Legal, Ethical, and Technological Risks of Artificial Intelligence, Machine Learning, and Associated Algorithms

Algorithms are becoming ubiquitous. However, companies are increasingly alarmed about their algorithms causing major financial or reputational damage. A new industry is envisaged: auditing and assurance of algorithms with the remit to validate artificial intelligence, machine learning, and associated algorithms.

A. Koshiyama, Emre Kazim, P. Treleaven 33
Reinforcement Learning
unread2018

How Artificial Intelligence, Machine Learning and Deep Learning are Radically Different?

No abstract available yet.

Tanya Tiwari, Tanuj Tiwari, Sanjay Tiwari 29
Reinforcement Learning
unread2020

Apache Mahout: Machine Learning on Distributed Dataflow Systems

No abstract available yet.

Robin Anil, Gökhan Çapan, Isabel Drost-Fromm 27
Reinforcement Learning
unread2020

Implications of embedded artificial intelligence - machine learning on safety of machinery

Abstract The Artificial Intelligence (AI) and the Machine Learning (ML) is a rapidly evolving technology and up until recently has not been a subject of machinery safety. The purpose of this work is to evaluate how embedded artificial intelligence – machine learning can affect the safety of machinery and machinery systems in the development of their applications. This work can be useful to machinery designers to develop their particular applications as it describes how the new hazards, associated with embedded AI – ML, should be considered within the framework of the risk assessment process. The proposed study underlines the new dimension of complexity linked to artificial intelligence and machine learning that could lead to a revision of European legislation in terms of the introduction and/or modification of essential health and safety requirements (EHSR) in the Machinery Directive, in order to guarantee safety levels at least equivalent to those currently achieved.

S. Anastasi, M. Madonna, L. Monica 25
Reinforcement Learning