Although composting has many advantages in the treatment of organic waste, there are still many problems and challenges associated with emissions, like NH3, VOCs, and H2S, as well as greenhouse gases such as CO2, CH4, and N2O. One promising approach to enhancing composting conditions is used of novel analytical methods bad on artificial intelligence. To predict and optimize the emissions (CO, CO2, H2S, NH3) during composting process kinetics thought mathematical models (MM) and machine learning (ML) models were utilized. Data about everyday emissions from laboratory composting with compost’s biochar with different incubation (50, 60, 70 °C) and biochar doses (0, 3, 6, 9, 12, 15% d.m.) were used for MM and ML models selections and training. MM has not been very effective in predicting emissions, (R2 0.1 - 0.9), while ML models such as acritical neural network (ANN, Bayesian Regularized Neural Network; R2 accuracy CO:0,71, CO2:0,81, NH3:0,95, H2S:0,72)) and decision tree (DT, RPART; R2 accuracy CO:0,693, CO2:0,80, NH3:0,93, H2S:0,65) have demonstrated satisfactory results. For the first time the ML models to predict CO and H2S during composting were demonstrated. Further research in a semi-scale and field study composting with biochar is needed to improve the accuracy of developments models.

Within the past few decades, thousands of experiments have been performed to characterize waste and biomass to estimate the bioenergy potential and product identification. There is a need to develop an integrated process model based on experimental literature, and simulation to obtain suitable products. In this study municipal solid waste (MSW) characterization and integrated process model have been developed to optimize final products in a reactor system. The process model has two modes R&D and reactor control (RC) to obtain suitable products including bio-oil, char, and gases. A database was integrated based on thermokinetics, machine learning and simulation models to optimize product efficiency. The experimental data includes thermogravimetric analysis, Fourier transform Infrared Spectroscopy, Gas chromatography, and Mass spectrometry, which are linked with pyrolysis experimental setup. Feedstock-product mapping models were incorporated into the database along with the temperature, heating rates, elemental analysis, and final product concentration, which are utilized for pyrolysis reactor setup. Product feasibility is conducted based on lifecycle cost, affordability, and product efficiency. The present work will bridge the gap between experimental study and decision making based on obtained products at several experimental conditions around the world.

Communication is indispensable for today's lifestyle, and thanks to technology, millions of people can communicate as quickly as possible. The effect of this breakthrough has transformed organizations to the degree that they generate billions of emails daily to facilitate their operations. There is implicit information behind this vast corpus of human-generated content that can be mined and used for their benefit. This paper tries to address the opportunity that email logs can bring to organizations and propose an approach to discover process models by combining supervised text classification and process mining. This framework consists of two main steps, text classification, and process mining. First, Emails will be classified with supervised machine learning, and to mine, the processes fuzzy Miner is used. To further investigate the application of this framework, we also applied this framework over a real-life dataset from a case study organization.

A hybrid smart process and material design system for nanoimprinting is proposed, which combines with a learning system based on experimental and numerical simulation results. Instead of carrying out extensive learning experiments for various condition, the simulation learning results are partially complimented where the results can be theoretically predicted by numerical simulation. In other word, the lacking data in experimental learning are complimented by simulation-based learning results. Therefore, the prediction of nanoimprint results under various conditions without experimental learning could be realized even for unknown materials. In this study, material and process design for a low-temperature nanoimprint process using glycerol-containing polyvinyl alcohol are demonstrated. Experimental results under limited conditions are learned to investigate optimum Glycerol concentrations and process temperatures. On the other hand, simulation-based learning is used to predict the dependence on press pressure and shape parameters. The prediction results for unknown Glycerol concentrations agreed well with the follow-up experiments.

Deep coal beds have been suggested as possible usable underground geological locations for carbon dioxide storage. Furthermore, injecting carbon dioxide into coal beds can improve the methane recovery. Due to importance of this issue, a novel investigation has been done on adsorption of carbon dioxide on various types of coal seam. This study has proposed four types of Gaussian Process Regression (GPR) approaches with different kernel functions to estimate excess adsorption of carbon dioxide in terms of temperature, pressure and composition of coal seams. The comparison of GPR outputs and actual excess adsorption expresses that proposed models have interesting accuracy and also the Exponential GPR approach has better performance than other ones. For this structure, R2=1, MRE=0.01542, MSE=0, RMSE=0.00019 and STD=0.00014 have been determined. Additionally, the impacts of effective parameters on excess adsorption capacity have been studied for the first time in literature. According to these results, the present work has valuable and useful tools for petroleum and chemical engineers who dealing with enhancement of recovery and environment protection.

The strong competition in the automotive industry has required manufacturers to implement lean production, both with methods and techniques specific to Industry 4.0. At the same time, universities must provide graduates with specific skills for applying these new production methods and techniques. In this context, a Lean Learning Factory was developed in the Pitesti University Center, which allows students to learn, experiment, and research, in an environment similar to that of enterprises, the new Lean Manufacturing methods and techniques, and Industry 4.0. The research presented in this study had as its objective identifying the minimum number of repetitions necessary to train operators who serve two differently organized workstations, one classic, the other including digital techniques, but on which the same assembly operation is performed. Several indicators were considered in the analysis, such as the number of errors, the number of stops, the effective duration of the work cycle, and the percentage ratio between the standard duration of cyclical activities and the effective duration of the work cycle. The evolution of these indicators was mathematically modelled by regression functions, using the least squares method. The obtained results also highlight the usefulness of applying the DOJO method as a Lean manufacturing-specific learning technique and the efficiency of implementing digital techniques in work organization.

Emotional instability and stress are main disturbances that condition the learning process, affecting both teachers and students. The main objective of this review is to analyze the influence of stress and emotions (as part of stress) on the learning process. The quality and intensity of emotions will not depend exclusively on a particular situation, but also on the subjective evaluation that the person makes of the situation in terms of a set of assessment dimensions. Emotions lead to sentimental, cognitive, behavioral and physiological changes, which will have a strong influence on intellectual performance. Stress is a physiological mechanism that the organism develops to adapt and survive in external and internal environments. Although it seems that it is a general pattern of response to emotions, it could be assumed that each emotion seems to have its own pattern of physiological reaction. In conclusion, extreme stress situations can generate anxiety and frustration in students. The activation of coping strategies constitutes a key mechanism for dealing positively with problems and challenges, generating positive emotions essential for the self-regulation of learning.

The Wester coastal Delta zone of the Netherlands is the relatively more crowded area of the country where ten of the seventeen million people live. The governmental prognosis is that this number of people will increase steadily in the coming decennia, unless the threat of climate-change seawater level rising. This is the picture in more Delta zones globally what makes the topic of resiliency for these delta-areas of importance. Approaches of resiliency are often dominated by governmental rescue planning and believe in technology solutions, while in the process the behaviour of people can make the difference in overcoming climate-change impact disasters. In the struggle against high water storming and flooding, the Dutch people prove this by developing societal resilient behaviour in a broad spectrum of activities. Post-PhD research on Dutch resilient behaviour in the in 1016-flooded Zaanstreek-Waterland area near the city of Amsterdam confirms that. Recently research by questionnaire among citizens in this region shows that people have favour for shared responsibility with government and related professional organizations. The Dutch examples of societal resiliency carried by people also show a action-learning perspective intertwined with governmental contingency planning. Therewith the Dutch practice shows a positive cross-fertilization of practice and knowledge development.

Binarization of degraded documents is an important preprocessing task for various document analysis such as OCR and historical document analysis. Existing studies have applied various convolutional neural network (CNN) models and generative models for document binarization, but they do not show generalized performance for noise that the model has not seen and it suffers from extracting elaborate text strokes. In this paper, to overcome these challenges, we utilize latent diffusion model (LDM), which is known for high-quality image generation model, for the first time in document binarization. By utilizing the iterative diffusion-denoising process in latent space, it shows high-quality cleaned binarized image generation and high generalized performance through using both data distribution and time step while training. Additionally, we apply gated U-Net to the backbone network to preserve text strokes using trainable gating value. Gated convolution can extract elaborate text stroke by allowing the model to focus on text region by combining gating value and feature. Furthermore, we maximize the effectiveness of the proposed model by training it with a combination of LDM loss and pixel-level loss, which is suitable for the model structure. Experiments on H-DIBCO and DIBCO benchmark datasets show that the proposed model outperforms existing methods.

A multimodal detection system with complementary capabilities for efficient detection was developed for impurity detection. The system consisted of a visible light camera, a multispectral camera, image correction and registration algorithms. It can obtain spectral feature and color feature at the same time, and has higher spatial resolution than a single spectral camera. This system was applied to detect impurities in Pu ’er tea to verify its high efficiency. The spectral and color features of each pixel in the images of Pu ’er tea were obtained by this system and used for pixel classification. The experimental results show that the accuracy of Support Vector Machine (SVM) model based on combined features is 93%, which is 7% higher than that based on only spectral features. By applying median filtering algorithm and contour detection algorithm to the label matrix extracted from pixel-classified images, 8 impurities except hair were detected successfully. Moreover, taking advantage of the high resolution of visible light camera, small impurities can be clearly imaged. By comparing the segmented color image with the pixel-classified image, small impurities such as hair could be detected successfully. Finally, it is proved that the system can obtain multiple images to allow a more detailed and comprehensive understanding of the detected items, and has excellent ability to detect small impurities.

The paper proposes a rock classification method using the vibration signal of the rotary drilling process. This proposed method classifies four rocks with a reliability of 100 %, from the vibration signal record of a lasting 1/4 second. For the design of a suitable classification method, several attributes of the vibration signal were calculated for two different signal recording lengths. Cluster dendrogram, ANOVA test, and boxplot were used to determine useful attributes and proper signal length. The classification rule was found using a decision tree, machine learning tool. The publication gradually describes the process of creating the classification method and the results of the reliability verification of the proposed classification method. Rock disintegration by rotary drilling was carried out under standardized experimental conditions. The disintegration rocks were andesite, granite, limestone, and concrete.

Evaporation is one of the main processes in the hydrological cycle, and it is one of the most critical factors in agricultural, hydrological, and meteorological studies. Due to the interactions of multiple climatic factors, the evaporation is a complex and nonlinear phenomenon; therefore, the data-based methods can be used to have precise estimations of it. In this regard, in the present study, Gaussian Process Regression (GPR), Nearest-Neighbor (IBK), Random Forest (RF) and Support Vector Regression (SVR) were used to estimate the pan evaporation (PE) in the meteorological stations of Golestan Province, Iran. For this purpose, meteorological data including PE, temperature (T), relative humidity (RH), wind speed (W) and sunny hours (S) collected from the Gonbad-e Kavus, Gorgan and Bandar Torkman stations from 2011 through 2017. The accuracy of the studied methods was determined using the statistical indices of Root Mean Squared Error (RMSE), correlation coefficient (R) and Mean Absolute Error (MAE). Furthermore, the Taylor charts utilized for evaluating the accuracy of the mentioned models. The outcome indicates that the optimum state of Gonbad-e Kavus, Gorgan and Bandar Torkman stations, Gaussian Process Regression (GPR) with the error values of 1.521, 1.244, and 1.254, the Nearest-Neighbor (IBK) with error values of 1.991, 1.775, and 1.577, Random Forest (RF) with error values of 1.614, 1.337, and 1.316, and Support Vector Regression (SVR) with error values of 1.55, 1.262, and 1.275, respectively, have more appropriate performances in estimating PE. It found that GPR for Gonbad-e Kavus Station with input parameters of T, W and S and GPR for Gorgan and Bandar Torkmen stations with input parameters of T, RH, W, and S had the most accurate performances and proposed for precise estimation of PE. Due to the high rate of evaporation in Iran and the lack of measurement instruments, the findings of the current study indicated that the PE values might be estimated with few easily measured meteorological parameters accurately.

Process safety plays a vital role in the modern process industry. To prevent undesired accidents caused by malfunctions or other disturbances in complex industrial processes, considerable attention has been paid to data-driven fault detection techniques. To explore the underlying manifold structure, manifold learning methods including Laplacian eigenmaps, locally linear embedding, and Hessian eigenmaps have been utilized in data-driven fault detection. However, only the partial local structure information is extracted from the aforementioned methods. In this paper, these typical manifold learning methods are synthesized to find the underlying manifold structure from different angles. A more comprehensive local structure is discovered under a unified framework by constructing an objection optimization function for dimension reduction of the process data. The proposed method takes advantage of different manifold learning methods. Based on the proposed dimension reduction method, a new data-driven fault detection method is developed. Hotelling’s T2 and Q statistics are established for the purpose of fault detection. Experiments on an industrial benchmark Tennessee Eastman process and a real blast furnace ironmaking process are carried out to demonstrate the superiority and effectiveness of the proposed method.

Chemical process control relies on a tightly controlled, narrow range of margins for critical variables, ensuring process stability and safeguarding equipment from potential accidents. The availability of historical process data is limited to a specific setpoint of operation. This challenge raises issues for process monitoring in predicting and adjusting to deviations outside of the range of operational parameters. Therefore, this paper proposes simulation-assisted deep transfer learning for predicting and optimizing the final purity and production capacity of the glycerin purification process. The proposed network is trained by the simulation domain to generate a base feature extractor, which is then fine-tuned using few-shot learning techniques on the target learner to extend the working domain of the model beyond the historical practice. The result shows that the proposed model improved prediction performance by 99% in predicting water content and 79.72% in glycerin prediction over the conventional deep learning model. Additionally, the implementation of the proposed model identified the production and product quality improvement for enhancing the glycerin purification process.

This study introduces an integrated method for managing process risks in a Business Process Reengineering (BPR) project, using Robust Data Envelopment Analysis (RDEA) and machine learning (ML). The goal is to prioritize risks based on three standard factors of PFMEA: Severity, Occurrence, and Detection (S-O-D), and incorporating two additional factors (Breakdown Cost and Breakdown Duration) seen as undesirable outputs. The model also accounts for the effect of uncertainty on expert-estimated values by applying disturbance percentages in the linear PFMEA-RDEA model. A machine learning model is proposed to predict new values if partial or total modifications have been made to the processes. The approach was implemented in an au-tomotive sector company, and the results showed the impact of uncertainty on values by com-paring different approaches such as RPN, PFMEA-DEA, and PFMEA-RDEA. A new reduced risk categorization was achieved, who allowed for decision-makers to focus on necessary actions for reengineering.

This qualitative study explores the implementation and conformation process of digital devices in teaching and learning before, during, and after the COVID-19 pandemic in Nepal. Using Rogers' Diffusion of Innovation Theory as a framework, the study examines the adoption and adaptation of digital devices by in-service secondary mathematics teachers (n=62) and their perceptions and preferences towards instructional modality. The findings suggest that despite the increased reliance on digital devices during the pandemic, there is a less likelihood of using them in face-to-face classrooms in developing countries like Nepal. The adoption of online learning has not yet reached the confirmation stage, even after the onset of the COVID-19 pandemic. Prior to the pandemic, online learning was not widely implemented or confirmed by teachers in developing countries societies. The study also provides important insights into the challenges and opportunities of using digital devices in post-COVID-19 classrooms, and its implications for policymakers and educators in Nepal.

The construction of tall buildings generates a high spatial and temporal concentration of greenhouse gas (GHG) emissions. Research studies have shown that as building height increases, more resources per floor area are required to withstand the increasing effects of lateral loads (wind and earthquake). This has major implications for the environmental performance of tall buildings since the Embodied GHG Emissions (EGHGE) of structural systems tend to represent the greatest portion of the life cycle GHG emissions of tall buildings. This study presents a data driven-based approach for decarbonization of tall buildings and evaluates the significant impact of material types (concrete, steel, and timber), concrete strength, and structural systems relative to a building's height on the EGHGE associated with tall buildings. In mitigating the effects of climate change, this research implements machine learning (ML) algorithms as an early-stage design tool to facilitate the choice of materials, and structural systems for tall buildings. This work considers a wide range of high-rise buildings with four different types of lateral structural systems (Braced-Frame system, Outrigger-Belt system, Shear Wall system, and Tubular system), four different types of construction materials (concrete, steel, hybrid, and timber), varying heights (ranging from 10 to 100 stories), and various concrete materials with different compressive strength ranging from 32 to 90 MPa. Data gathered from more than 100 existing tall building projects along with the data obtained from finite element analysis of 120 high-rise buildings models were utilized to train various ML regression algorithms: Decision Tree, Support Vector Machine, Polynomial Regression, and Elastic-Net Regularized Regression. The performance of ML models was carefully assessed, and the best prediction model was selected to estimate the total amount of CO2 emissions for high-rise buildings. Results indicate that hybrid structures with the Out-Rigger-Belt system exhibit the lowest carbon emission (110 kg/m2) compared to other structural types and systems.

The article presents a cyber-physical system for acquiring, processing and reconstructing images from measurement data. The technology was based on process tomography, intelligent measurement sensors, machine learning, Big Data, Cloud Computing, Internet of Things as a solution for Industry 4.0. Industrial tomography enables observation of physical and chemical phenomena without the need of internal penetration and allows real-time monitoring of production processes. The application includes specialized intelligent devices for tomographic measurements and dedicated algorithms for solving the inverse problem. The work focuses mainly on electrical tomography and image reconstruction using deterministic methods and machine learning, the reconstruction results were compared, different measurement models were used. The researches were carried out for synthetic data and laboratory measurements. The main advantage of the proposed system is the possibility of spatial data analysis and their high processing speed. The presented research results show that the process tomography gives the possibility to analyse the processes taking place inside the facility without disturbing the production, analysis and detection of obstacles, defects and various anomalies. Knowing the characteristics of a given solution, the application allows you to choose the appropriate method to reconstruct the image.

Data-driven models (DDMs) are extensively used in environmental modeling but face challenges due to limited training data and potential results not adhering to physical laws. To address this challenge, this study developed a process-guided deep learning (PGDL) model, integrating a long short-term memory (LSTM) neural network and a process-based model (PBM), CE-QUAL-W2 (W2), to predict water temperature in a stratified reservoir. The PGDL included an energy constraint term from W2's thermal energy equilibrium into the cost function of the LSTM, besides the mean square error term. In PGDL, parameters were optimized by penalizing deviations from the energy law, ensuring adherence to physical constraints. Compared to LSTM, PGDL demonstrated enhanced satisfaction with the energy balance and superior performance in water temperature prediction. Even with less field data for training, PGDL outperformed both LSTM and calibrated W2 after pre-training with data generated using the uncalibrated W2. Therefore, integration of DDM with a PBM ensured physical consistency in water temperature prediction for complex stratified reservoirs with limited data. Moreover, pre-training the PGDL with PBM proved highly effective in mitigating bias and variance due to insufficient field measurement data.

Machine learning is an established and frequently used technique in industry and academia but a standard process model to improve success and efficiency of machine learning applications is still missing. Project organizations and machine learning practitioners have a need for guidance throughout the life cycle of a machine learning application to meet business expectations. We therefore propose a process model for the development of machine learning applications, that covers six phases from defining the scope to maintaining the deployed machine learning application. The first phase combines business and data understanding as data availability oftentimes affects the feasibility of the project. The sixth phase covers state-of-the-art approaches for monitoring and maintenance of a machine learning applications, as the risk of model degradation in a changing environment is eminent. With each task of the process, we propose quality assurance methodology that is suitable to address challenges in machine learning development that we identify in form of risks. The methodology is drawn from practical experience and scientific literature and has proven to be general and stable. The process model expands on CRISP-DM, a data mining process model that enjoys strong industry support but lacks to address machine learning specific tasks. Our work proposes an industry and application neutral process model tailored for machine learning applications with focus on technical tasks for quality assurance.

Organisations need dynamic capabilities in the ongoing digital transformation to reconfigure knowledge and learning. There is a need to define new concepts and explain mechanisms of relevant factors to build dynamic capabilities. Especially organisations acting in healthcare are caught in a dilemmatic situation. New, digital processes and business models are promising benefits for cost-containment measures and improved patient-centric care, offering digital services. However, investments are needed to benefit. The important question is: how can individual actors in healthcare be motivated to engage in this transformational process to build and reconfigure relevant competences and establish new learning routines? Founded on the essence of existing literature, we assume sustained learning as a relevant dynamic capability to seize and sense competences and reconfigure human capital. This paper answers the call for deeper investigations into the mechanisms in new digitally transformed environments and sectors with less focus on performance and competitive advantages, like public administration or the healthcare sector. Based on previous research, validated in qualitative interviews and quantitative testing, we define the new construct of sustained learning with its subdimensions. By providing measures, we build the ground for further quantitative research.

Background: Laparoscopy for benign ovarian pathology is the appropriate surgical approach and it has a lot of well-known advantages. Minimal invasive gynecological surgery increases the quality of life for the patient. The learning process of laparoscopy is difficult and re-quires many interventions to acquire manual skills. The objectives of the study were to assess the learning process of laparoscopy for adnexal pathology surgery performed by beginner laparoscopists. Materials and Methods: This study included three gynecological surgeons who were beginners in laparoscopy and who were named A, B and C. We collected information about patients, diagnosis, surgical technique and complications. Results: We have analyzed the data from 159 patients. The most frequent primary diagnosis was functional ovarian cyst, and the laparoscopic cystectomy was performed in 49.1% of intervention. The need to convert a laparoscopy into laparotomy was necessary in 1.3% of patients. There were no cases of reintervention, blood transfusion or ureteral lesions. The duration of the surgical intervention varied statistically significantly according to patient's BMI and to the surgeon. After 20 laparoscopic interventions, a significant improvement was found in the time needed to perform ovarian cystectomy (operator A and B) and salpingectomy (operator C). Conclusions: The process of learning laparoscopy is laborious and difficult. We found a significant decrease in operating time after a number of twenty laparoscopic interventions.

Material Extrusion is a popular additive manufacturing technology due to its low cost, wide market availability, ability to construct complex parts, safety, and cleanliness. However, optimizing the process parameters to obtain the best possible mechanical properties has not been extensively studied. This paper aims to develop ensemble learning-based models to predict the ultimate tensile strength, Young's modulus, and strain at break of PLA and PLA-CF 3D-printed parts, using printing temperature, printing speed, and layer thickness as process parameters. Additionally, the study investigates the impact of process parameters and material selection on the mechanical properties of the printed parts and uses Genetic Algorithms for multi-objective optimization according to user specifications. The results indicate that process parameters and material selection significantly influence the mechanical properties of the printed parts. The Genetic Algorithm successfully identifies optimal parameter values for the desired mechanical properties. Moreover, this work is the first to model Process-Structure-Properties relationships for an additive manufacturing process and to use a multi-objective optimization approach for multiple mechanical properties, utilizing ensemble learning-based algorithms and Genetic Algorithms.

Artificial intelligence (AI) is a versatile term that is a conclusive remedy to solve the problem using past rational data after deep contemplation using these terms i-e basic statistics, carving data, familiarity with common AI algorithms. Seafood especially tiger prawn export as a busi-ness will provide enormous foreign exchange to any country if the farmers overcome the corre-lated vulnerabilities in prawn farming. This research is elucidating lacking in Tiger prawn (TP) farming like curbing of Oxygen, pH, water temperature, and nutrients, etc. Moreover, hatchery statistics in terms of juveniles will depict this study's clear picture of curbed aquaculture. For normative decisions, the Analytical Hierarchical Process (AHP) is used. The problem which has been faced by local prawn farmers that there is a stagnant TP growth in ponds, the reason is the predominant sensitivity factor in TP. For this reason, they need indemnification of thirteen fac-tors with natural resources to get the plausible results to get calmness in their lives. This study will solely focus on the TP growth model, and the monitoring effect will be established by the Artificial Intelligence algorithm. This study will employ the AHP, 0-1 scaling method, data cura-tion techniques, and ecological statistics. The life of Tiger Prawn (TP) depends upon these factors mainly, a) Physical and b) Chemical parameters. Physical parameters contain environment (E) provided to TP like season (S) and temperature (T) etc. whereas the quality of Ammonia NH3 (N) from fish waste, Oxygen level (O), and water quality hard & soft (W) lies in chemicals do-main. This research will Elucidate the factors which cause conceptual muddles in the aquamarine life of TP, for this reason, Statistical tools will assess the current result, forecast the gap. AHP will analyze the domain inputs, circumspect ramification which will depict visceral factors, later results depict which pond suits the TP. In curtail, these factors will be curbed to improve the growth of TP in a control conditioned environment.

The national-scale evaluation and modelling of the impact of agricultural management and cli-mate change on soils, crop growth, and the environment require soil information at a spatial res-olution addressing individual agricultural fields. This manuscript presents a data science ap-proach which agglomerates the soil parameter space into a limited number of functional soil pro-cess units (SPUs) which may be used to run agricultural process models. In fact, two unsupervised classification methods were developed to generate a multivariate 3D data product consisting of SPUs, each being defined by a multivariate parameter distribution along the depth profile from 0 to 100 cm. The two methods account for differences in variable types and distributions and in-volve genetic algorithm optimization to identify those SPUs with the lowest internal variability and maximum inter-unit difference with regards to both, their soil characteristics and landscape setting. The high potential of the methods was demonstrated by applying them to the agricultural German soil landscape. The resulting data product consists of twenty SPUs. It has a 100 m raster resolution in the 2D mapping space, and its resolution along the depth profile is 1 cm. It includes the soil properties texture, stone content, bulk density, hydromorphic properties, total organic carbon content, and pH.

The key to building a strong bridge country lies in talent, and the foundation lies in education. The cultivation of bridge engineering talents is related to the future and destiny of building a strong bridge country. This course adopts the educational philosophy of "holographic teaching method" centered on the comprehensive development of students, cultivating "engineering thinking" guided by engineering education certification, enhancing "abilities and qualities" through professional knowledge, reconstructing the course knowledge content system through engineering philosophy thinking, and implementing the ideological and political construction of the course in a multi-level unified manner of "explicit + implicit". Based on restructuring the course content system, we will strengthen the construction of diversified course resources, integrate theory with practice throughout the entire process of the course, practice the concept of "bridge architects + bridge engineers" parallel development, and cultivate cross-border and compound talents with comprehensive qualities of "engineering + art + humanities".

The article takes the case of the adoption of machine learning in a steel manufacturing process through a platform provided by a novel Canadian startup, Canvass Analytics. This way the steel company could optimize the process in a blast furnace. The content of the paper includes a conceptual framework on key factors around steel manufacturing and machine learning. Method: The article takes the case of the adoption of machine learning in a steel manufacturing process through a platform provided by a novel Canadian startup, Canvass Analytics. This way the steel company could optimize the process in a blast furnace. The content of the paper includes a conceptual framework on key factors around steel manufacturing and machine learning. Results: This case is relevant for the authors by the way the business model proposed by the startup attempts to democratize Artificial Intelligence and Machine Learning in industrial environments. This way the startup delivers value to facilitate traditional industries to obtain better operational results, and contribute to a better use of resources. Conclusion: This work is focused on opportunities that arise around Artificial Intelligence as a driver for new business and operating models. Besides the paper looks into the framework of the adoption of Artificial Intelligence and Machine Learning in a traditional industrial environment towards a smart manufacturing approach.

The copper mining industry is increasingly using artificial intelligence methods to improve cop-per production processes. Recent studies reveal the use of algorithms such as Artificial Neural Network, Support Vector Machine, and Random Forest, among others, to develop models for predicting product quality. Other studies compare the predictive models developed with these machine learning algorithms in the mining industry, as a whole. However, not many copper mining studies published compare the results of machine learning techniques for copper recovery prediction. This study makes a detailed comparison between three models for predicting copper recovery by leaching, using four datasets resulting from mining operations in northern Chile. The algorithms used for developing the models were Random Forest, Support Vector Machine, and Artificial Neural Network. To validate these models, four indicators or values of merit were used: accuracy (acc), precision (p), recall (r), and Matthew’s correlation coefficient (mcc). This paper describes dataset preparation and the refinement of the threshold values used for the predictive variable most influential on the class (the copper recovery). Results show both a precision over 98.50% and also the model with the best behavior between the predicted and the real. Finally, the models obtained show the following mean values: acc=94.32, p=88.47, r=99.59, and mcc=2.31. These values are highly competitive as compared with those obtained in similar studies using other approaches in the context.

It is difficult to capture the real-time online measurement data for biochemical oxygen demand (BOD) in wastewater treatment processes. An optimized extreme learning machine (ELM) based on an improved cuckoo search algorithm (ICS) is proposed in this paper for the design of soft BOD measurement model. In ICS-ELM, the input weights matrices of the extreme learning machine (ELM) and the threshold of the hidden layer are encoded as the cuckoo's nest locations. The best input weights matrices and threshold are obtained by using the strong global search ability of improved cuckoo search (ICS) algorithm. The optimal results can be used to improve the precision of forecasting based on less number of neurons of the hidden layer in ELM. Simulation results show that the soft sensor model has good real-time performance, high prediction accuracy and stronger generalization performance for BOD measurement of the effluent quality compared to other modeling methods such as back propagation (BP) network in most cases.

In an industrial environment, the quality assurance of weld seams requires extensive efforts. The most commonly used methods for that are expensive and time-consuming destructive tests, since quality assurance procedures are difficult to integrate into production processes. Beyond that, available test methods allow only the assessment of a very limited set of characteristics. They are either suitable for determining selected geometric features or for locating and evaluating internal seam defects. The presented work describes an evaluation methodology based on microfocus X-ray computed tomography scans (µCT scans) which enable the 3D characterization of weld seams, including internal defects such as cracks and pores. A 3D representation of the weld contour, i.e., the complete geometry of the joint area in the component with all quality-relevant geometric criteria, is an unprecedented novelty. Both the dimensions of the weld seam and internal defects can be revealed, quantified with a resolution down to a few micrometers and precisely assigned to the welded component. On the basis of the methodology developed within the framework of this study, the results of the scans performed on the alloy AA 2219 can be transferred to other aluminum alloys. In this way, the data evaluation framework can be used to obtain extensive reference data for the calibration and validation of inline process monitoring systems employing Deep Learning-based data processing.

The goal of this study is both to determine the opinion that professors and students at the University of (details removed for peer review) have of active methodologies and to describe the perception and opinion of the modes of organization, methodological focuses, and evaluation systems that define the teaching-learning process. On surveying the professors and the students in their classes, we found significant differences in 32 of the 92 variables in common. The content of these results shows that professors and students are believe they are making progress toward a learning-centered model, that implementation of active methodologies implies new functions in their teaching practice.

In recent times, the process control network (PCN) of oil and gas installation has been subjected to amorphous cyber-attacks which include Denial-of-Service (DoS), Distributed-Denial-of-Service (DDoS), Man-in-the-Middle (MitM) attacks, and this may have been caused majorly by the integration of open network to Operation Technology (OT) as a result of low-cost network expansion. The connection of the OT to the internet for firmware updates, third-party support, or vendor interventions, has exposed the industry to attacks. The inability to detect these unpredictable cyber-attacks exposes the PCN and a successful attack can lead to devastating effects. This paper reviews the different forms of cyber-attacks in PCN of oil and gas installations and proposes the use of machine learning algorithms to monitor data exchanges between the sensors, controllers, processes, and the final control elements on the network so as to detect anomalies in such data exchanges. Python 3.0 Libraries, Deep-Learning Toolkit, MATLAB, and Allen Bradley RSLogic 5000 PLC Emulator software were used in the simulation of process control. The outcome of the experiments shows the reliability and functionality of the different machine-learning algorithms in detecting these anomalies with significant precise attack detections identified using a coarse tree algorithm.

Big data technologies are disruptive technologies that affect every business, including those in the construction industry. The Thai government has also been affected, and attempted to use machine learning techniques with the analytics of big data technologies to predict which construction projects have a winning price over the project budget. However, this technology was never developed, and the government did not implement it because they had data obtained via a traditional data collection process. In this study, traditional data were processed to predict behavior in Thai government construction projects using a machine learning model. The data were collected from the government procurement system in 2019. There were seven input data, including project owner department, type of construction project, bidding method, project duration, project level, winning price over estimated price, and winning price over budget. A range of classification techniques, including an artificial neural network (ANN), a decision tree (DC), and K-nearest neighbor (KNN), were used in this study (ANN). According to the results, after hyperparameter tuning, ANN had the greatest prediction accuracy with 78.9 percent. This study confirms that data from the Thai government procurement system can be investigated using machine learning techniques from big data technologies.

In the domain of financial trading, where accuracy and swift response to data discrep- ancies are paramount for maintaining clienttrust, our research paper delves into the development of a real-time alert system utilizing SpringBoot, a framework renowned for its robustness and adaptability in enterprise applications. We embark on a comprehensive journey, beginning with addressing thefoundational challenges inherent in monitoring trade inquiries - the necessity for real-time processing, unwavering data accuracy,and ensuring unwavering system reliability. The study then methodically transitions to the architectural design, where we explore howSpringBoot’s capabilities are optimally utilized to meet these challenges. Following this, we delve into the im- -plementationphase, detailing the strategic selection of compatible technologies and methods for effective data management and discrepancydetection. The paper culminates in a thorough evalu- ation of the system, where we assess performance across various operationalscenarios, scrutinize the accuracy of the discrepancy detection mechanisms, and integrate real-world feedback from users in thetrading sector. This holistic approach not only highlights the versatility and efficiency of SpringBoot in creating reliable alert systems in the high-stakes world of financial trading but also serves as a detailed guide for similar endeavors in this field

Deep learning is an emerging area of machine learning (ML) research. It comprises multiple hidden layers of artificial neural networks. The deep learn- ing methodology applies nonlinear transformations and model abstractions of high level in large databases. The recent advancements in deep learning architec- tures within numerous fields have already provided significant contributions in artificial intelligence. This article presents a state of the art survey on the contri- butions and the novel applications of deep learning. The following review chron- ologically presents how and in what major applications deep learning algorithms have been utilized. Furthermore, the superior and beneficial of the deep learning methodology and its hierarchy in layers and nonlinear operations are presented and compared with the more conventional algorithms in the common applica- tions. The state of the art survey further provides a general overview on the novel concept and the ever-increasing advantages and popularity of deep learning.

The use of drones for various applications has become increasingly popular in recent years, and machine learning has played a significant role in this trend. In this paper, we provide a comprehensive survey of the classification and application of machine learning in drones. The paper begins with an overview of the different types of machine learning algorithms and their applications in drones, including supervised learning, unsupervised learning, and reinforcement learning. Next, we present a detailed analysis of various real-world applications of machine learning in drones, such as object recognition, route planning, obstacle avoidance, search area optimization, and autonomous search. The paper also discusses the challenges and limitations of using machine learning in drones, such as data privacy, data quality, and computational requirements. Finally, the paper concludes with a discussion of the future directions of machine learning in drones and its potential impact on various industries and fields. This paper provides a valuable resource for researchers, practitioners, and students interested in the intersection of machine learning and drones.

Federated learning techniques aim to train and build machine learning models based on distributed datasets across multiple devices, avoiding data leakage. The main idea is to perform training on remote devices or isolated data centers without transferring data to centralized repositories, thus mitigating privacy risks. Data analytics in education, in particular learning analytics, is a promising scenario to apply this approach to address the legal and ethical issues related to processing sensitive data. Indeed, given the nature of the data to be studied (personal data, educational outcomes, data concerning minors), it is essential to ensure that the conduct of these studies and the publication of the results provide the necessary guarantees to protect the privacy of the individuals involved and the protection of their data. In addition, the application of quantitative techniques based on the exploitation of data on the use of educational platforms, student performance, use of devices, etc., can account for educational problems such as the determination of user profiles, personalized learning trajectories, or early dropout indicators and alerts, among others. This paper presents the application of federated learning techniques to two learning analytics problems: dropout prediction and unsupervised student classification. The experiments allow us to conclude that the proposed solutions achieve comparable results from the performance point of view with the centralized versions, avoiding centralizing the data for training the models.

We study the brain segmentation by dividing the brain into multiple tissues. Given possible brain segmentation by deep, machine learning can be efficiently exploited to expedite the segmentation process in the clinical practice. To accomplish segmentation process, a MRI and tissues transfer using generative adversarial networks is proposed. Given the better result, we propose the transfer model using GAN. For the case of the brain tissues, white matter (WM), gray matter (GM) and cerebrospinal fluid (CSF) are segmented. Empirical results show that this proposed model significantly improved segmentation results compared to the stat-of-the-art results. Furthermore, a dice coefficient (DC) metric is used to evaluate the model performance.

The article addresses the problem of course development in virtual teaching and learning spaces by teachers to support blended learning in the Ecuadorian unified baccalaureate. For this purpose, a documentary analysis of 465 papers selected by a search in Scopus and Google Scholar about blended learning and 145 papers selected by a search in Scopus and Google Scholar about development of virtual courses was carried out. The definition of the first concept is qualitatively different from the previous ones by analysing it as a form of organisation and assessing the configuration of face-to-face and distance learning depending on the educational objective. The second concept defined presents the unrepeatable and unique character of each course given by the configuration of its digital resources, the characteristics of these resources and the new qualities that are conferred on them. Subsequently, based on them, the methodology that contributed to the development of courses in virtual spaces as a support to blended learning is proposed. Unlike other methodologies, the proposal explicitly states its conceptual apparatus and the necessary requirements for its introduction in an educational organization. It incorporates important actions that do not appear in other methodologies such as cross-cutting processes including quality assurance with its corresponding metrics, maintenance, recall and evaluation of previous actions.

Class Incremental Learning (CIL) has emerged as a vital machine learning paradigm, particularly suited for environments with continuous data streams, such as those encountered in the financial industry. CIL enables models to progressively acquire and accumulate new knowledge without retraining the entire dataset, making it highly efficient for dynamic financial markets. In this paper, we explore the application of CIL to financial data streams, where high-frequency, high-dimensional data, such as stock prices and cryptocurrency transactions, evolve rapidly. The challenges inherent in CIL, including catastrophic forgetting—where the model loses previously learned knowledge—and intransigence—where it resists learning new classes—are addressed through both regularization-based techniques and dynamic architecture expansion. We present a comprehensive analysis of the algorithms designed to mitigate these challenges and highlight their relevance in financial applications like algorithmic trading, portfolio management, risk assessment, and fraud detection. By demonstrating how CIL enables models to adapt to new market conditions and asset classes while retaining past knowledge, we illustrate its critical role in advancing real-time financial decision-making. Through a detailed examination of the methodologies and their applications, this paper aims to provide insights into the future of adaptive financial models using Class Incremental Learning. We have also summarized methodologies into a model optimization-based class and a data focused class.

In recent years, online learning has become one of the most popular methods of educational delivery due to advances in technology, which has been made even more evident in the COVID-19 lockdown period. Online education has evolved into a distinct field of study within the educational system over the last few years. It is also important to note that parallel with the growth in this field, there has also been an increase in the number of scholarly journals that regularly publish research in this field, reflecting the importance of this field in the modern day. In spite of the fact that online learning offers a wide range of educational options, from short courses to full-time degrees, as well as being accessible, flexible, environmentally friendly, and affordable, there are also certain challenges associated with this educational approach. These challenges include the lack of social interaction, technical errors, a lack of hands-on training, and difficulties in assessing students. It is, therefore, imperative to ask the crucial question of whether online learning can replace traditional classroom learning or whether it can supplement it in hybrid models with it, as well as what factors and conditions are likely to determine this in the short- and long-term, as well as how it will be blended together in the future. The purpose of this commentary is to provide a brief summary of the current status of both learning models, as well as their pros and cons, in order to answer the question that was posed above.

The popularity of deep reinforcement learning (DRL) methods in economics have been exponentially increased. DRL through a wide range of capabilities from reinforcement learning (RL) and deep learning (DL) for handling sophisticated dynamic business environments offers vast opportunities. DRL is characterized by scalability with the potential to be applied to high-dimensional problems in conjunction with noisy and nonlinear patterns of economic data. In this work, we first consider a brief review of DL, RL, and deep RL methods in diverse applications in economics providing an in-depth insight into the state of the art. Furthermore, the architecture of DRL applied to economic applications is investigated in order to highlight the complexity, robustness, accuracy, performance, computational tasks, risk constraints, and profitability. The survey results indicate that DRL can provide better performance and higher accuracy as compared to the traditional algorithms while facing real economic problems at the presence of risk parameters and the ever-increasing uncertainties.

N-shot learning has emerge in recent year as potential learning approach to solve the problem of data scarcity by learning underlying pattern from a few training sample. Despite recent state-of-the-art research on model-agnostic metal learning, transfer learning, and optimization strategy to rapidly learn valid information from few sample, there remains a big challenge on an actual out-of-distribution zero-day without any similarity to previously known malware family or new variant of an existing malware family. This ultimately questions the effectiveness of current state-of-the-art few-shot learning approach. In this research, we did an in-depth investigation into the performance of state-of-the-art Zero-shot, Single-shot, and few-shot learning approaches on zero-day out-of-distribution malware attack detection based on their static properties using Malimg and Malevis malware dataset. We ensure our model was aware of an out-of-distribution class during training while varying the number of samples in the out-of-distribution class accordingly zero-shot(no sample), single-shot (1 sample), few-shot(5 samples) while using confusion matrix to get the actual number of correct prediction on out-of-distribution malware validation samples. we assert that the model should be smart enough to detect and classify previously unseen data into an empty family as an out-of-distribution considering that the model was made to be aware of the existence of such distribution during training. Result shows 0, 0, and 3 correct out-of-distribution predictions on Zero-shot, single-shot, and few-shot experiments respectively, thereby showing limitation of the current state-of-the-art N-shot approaches on out-of-distribution attack.

Self-supervised learning is a method that learns general representation from unlabeled data. Masked image modeling (MIM), one of the generative self-supervised learning methods, has drawn attention showing state-of-the-art performance on various downstream tasks, though showing poor linear separability resulting from the token-level approach. In this paper, we propose a contrastive learning-based multi-view masked autoencoder for MIM, exploiting an image-level approach by learning common features from two different augmented views. We strengthen MIM by learning long-range global patterns from contrastive loss. Our framework adopts simple encoder-decoder architecture, learning rich and general representation by following a simple process: 1) two different views are generated from an input image with random masking and by contrastive loss, we can learn semantic distance of the representations generated by an encoder. By applying a high mask ratio, 80%, it works as strong augmentation and alleviates the representation collapse problem. 2) With reconstruction loss, decoder learns to reconstruct an original image from the masked image. We assess our framework by several experiments on benchmark datasets of image classification, object detection, and semantic segmentation. We achieve 84.3% fine-tuning accuracy on ImageNet-1K classification and 76.7% in linear probing, exceeding previous studies and show promising results on other downstream tasks. Experimental results demonstrate that our work can learn rich and general image representation by applying contrastive loss to masked image modeling.

Continual learning, a crucial facet of machine learning, involves the perpetual acquisition of valuable insights from incoming data, sans the necessity for full dataset access. Esteemed as a fundamental goal in artificial intelligence, continual learning grapples with an enduring challenge—catastrophic forgetting. A proficient model must exhibit adaptability for new data assimilation and robustness to retain existing knowledge. Class-incremental learning (CIL) aids the gradual integration of knowledge from newly introduced classes, forming a universal classifier. However, directly training the model with fresh class instances triggers a problem—forgetting distinguishing features of prior classes, causing a performance decline. Addressing such issues in machine learning, this survey aims to delineate significant challenges, outcomes, and recent advancements, including our contributions to CIL techniques, especially in image classification.

In the fourth industrial revolution, artificial intelligence (AI) and machine learning (ML) have increasingly been applied to manufacturing, particularly additive manufacturing (AM), to enhance processes and production. This study provides a comprehensive review of the state-of-the-art achievements in this domain, highlighting not only the widely discussed supervised learning but also the emerging applications of semi-supervised learning and reinforcement learning (RL). These advanced ML techniques have recently garnered significant attention due to their potential to further optimize and automate AM processes. The review aims to offer insights into various ML technologies employed in current research projects and to promote the diverse applications of ML in AM. By exploring the latest advancements and trends, this study seeks to foster a deeper understanding of ML’s transformative role in AM, paving the way for future innovations and improvements in manufacturing practices.

There is only a very short reaction time for people to find the best way out of a building in a fire outbreak. Software applications can be used to assist the rapid evacuation of victims; however, this is an arduous task, which requires an understanding of advanced technologies. Since well-known pathway algorithms (such as, Dijkstra, Bellman-Ford and A*) can lead to serious problems over performance, we decided to make use of deep reinforcement learning techniques. A wide range of strategies including a random initialization of replay buffer and transfer learning were assessed in three projects involving schools of different sizes. The results showed the proposal was viable and that in most cases the performance of transfer learning was superior. In addition, the study raised challenges that had to be faced in the future.

Sparse reward long horizon task is a major challenge for deep reinforcement learning algorithm. One of the key barriers is data-inefficiency. Even in the simulation environment, it usually takes weeks to training the agent. In this study, a data-efficiency training framework is proposed, where a curriculum learning is design for the agent in the simulation scenario. Different distributions of the initial state are set for the agent to get more informative reward during the whole training process. A fine-tuning of the parameters in the output layer of the neural network for value function is conduct to bridge the gap between sim-to-real. An experiment of UAV maneuver control is conducted in the proposed training framework to verify the method more efficient. We demonstrate that data-efficiency is different for the same data in different training stages.

This paper presents the redesign process of FLIC, a web application developed for creating personal learning pathways in higher education, now adapted for primary and secondary education as FLIC-IPAFLEX. This redesign addresses the need to personalise learning through flexible pathways and supports teachers in designing learning situations (LS) in accordance with the criteria established by the new Education Law (LOMLOE). The SCRUM model, integrated into Design-Based Research (DBR), was employed, implementing several iterative cycles involving teachers to validate the tool's utility. The platform facilitates the creation, publication, and reuse of LS by enabling the filtering of competencies, evaluation criteria, and basic knowledge, as well as integrating with Google Classroom, an application widely used by teachers. The results show a positive user evaluation, highlighting its ease of use and capacity to foster collaboration among teachers, thereby promoting the co-design of flexible and adaptive LS. FLIC-IPAFLEX aims to contribute to the field of learning design technologies, aligning with the demands of compulsory education and supporting collaborative processes within the educational environment.

This article discusses the comparison between digital and traditional face-to-face coaching within the scope of shadow education institutions. While analyzing the differences and similarities between the two educational models, both their advantages and disadvantages are thoroughly discussed. In this context, interviews were conducted with students and teachers who receive education in both face-to-face and digital coaching, and the positive and negative aspects of both institutions, suitable and unsuitable courses, the future situation, and the effects on students' academic achievements were revealed. According to the results obtained from the research, it is noteworthy that students who do not receive education in digital coaching have prejudices against digitalization. Additionally, no significant difference was found between the academic achievements of students receiving education in digital coaching and those receiving education in face-to-face coaching.

The emergence of few-shot learning as a potential approach to address the problem of data scarcity by learning underlying pattern from a few training sample had so far given a mix-result especially on the suitability of model-agnostic meta learning, transfer learning, and optimization strategy to rapidly learn valid information from few sample. In this research, we did an in-depth evaluation of meta- learning to determine their plausibility and suitability for previously unknown cyberattack detection by first retrieving the original research artifacts of current state of the art meta learning to repeat the experiment with original dataset before replicating the experiment with two different malware dataset which had not been previously done with meta-transfer learning. On each of the experiments, meta-transfer learning gave good results on digital character recognition dataset but abysmal result on Malimg and Malevis malware images datasets thereby indicating its unreliability for detecting cyberattacks and the need for an improvement to the state-of-the-art meta transfer learning towards a better attack detection. Transfer learning performance is independent on imbalance and hence does not influence its performance since both malware dataset used for this experiment result in high validation loss and balancing the dataset doesn't result in reduced validation loss,the successful learning transfer seen on digital character recognition dataset is not unconnected to the fact that several languages have similar characters and digits thereby enhancing the successful learning transfer unlike malware datasets, and more importantly the finding that current meta-learning transfer approach doesn't generalize well on malware dataset and hence not suitable for detecting previously unseen out-of-distribution attack.

Despite the importance of few-shot learning, the lack of labeled training data in the real world, makes it extremely challenging for existing machine learning methods as this limited data set does not represent the data variance well. In this research, we suggest employing a generative approach using variational autoencoders (VAEs), which can be used specifically to optimize few-shot learning tasks by generating new samples with more intra-class variations. The purpose of our research is to increase the size of the training data set using various methods to improve the accuracy and robustness of the few-shot face recognition. Specifically, we employ the VAE generator to increase the size of the training data set, including the basic and the novel sets while utilizing transfer learning as the backend. Based on extensive experimental research, we analyze various data augmentation methods to observe how each method affects the accuracy of face recognition. We conclude that the face generation method we proposed can effectively improve the recognition accuracy rate to 96.47% using both the base and the novel sets.

Sugarcane is the primary crop in the global sugar industry, yet it remains highly susceptible to a wide range of diseases that significantly impact its yield and quality. An effective solution is required to solve the issues given by manual identification of plant diseases, which is time-consuming and wasteful, as well as low detection accuracy. This paper proposes the development of a robust deep ensemble convolutional neural network (DECNN) model for the accurate detection of sugarcane leaf diseases. Initially, several transfer learning (TL) models, including EfficientNetB0, MobileNetV2, DenseNet121, NASNetMobile, and EfficientNetV2B0, were enhanced through the addition of specific layers. A comparative study was then conducted on the improved dataset. The application of data augmentation, along with the addition of dense layers, batchnormalization layers, and dropout layers, led to improved detection accuracy, precision, recall, and F1 score for each model. Among the five enhanced transfer learning models, the modified EfficientNetB0 model demonstrated the highest detection accuracy, ranging from 97.08% to 98.54%. In conclusion, the DECNN model was developed by integrating the modified EfficientNetB0, MobileNetV2, and DenseNet121 models using a distinctive performance-based custom weighted ensemble method, with weight optimization carried out using the Tree-structured Parzen Estimator (TPE) technique. This resulted in a model that achieved a detection accuracy of 99.17%, outperforming the individual performances of the modified EfficientNetB0, MobileNetV2, and DenseNet121 models in detecting sugarcane leaf diseases.

In conventional Federated Learning (FL), clients work together to train a model managed by a central server, intending to speed up the learning process. However, this approach imposes significant computational and communication burdens on clients, particularly with complex models. Additionally, while FL strives to protect client privacy, the server's access to local and global models raises security concerns. To address these challenges, Split Learning (SL) separates the model into parts handled by the client and the server, though it suffers from inefficiencies due to sequential client participation. To overcome these issues, SplitFed Learning (SFL) was proposed, which combines the parallelism of FL with the model-splitting strategy of SL, enabling simultaneous training by multiple clients. Our main contribution is the theoretical analysis of SFL, which, for the first time, includes non-i.i.d. datasets, non-convex loss functions, and both full and partial client participation. We provide convergence proofs for a state-of-the-art SFL algorithm based on conventional convergence analysis assumptions for FL. Our results prove that we can recover the linear convergence rate of conventional FL for the SFL algorithm with the distinction that increasing the number of local steps or clients may not speed up the convergence in SFL.

Classifiers face a myriad of challenges in today’s data-driven world, ranging from overfitting and high computational costs to low accuracy, imbalanced training datasets, and the notorious black box effect. Furthermore, many traditional classifiers struggle with the robust handling of noisy and missing feature values. In response to these hurdles, we present classification methods that leverage the power of feature partitioning learning and outranking measures. Our classification algorithms offer an innovative approach, eliminating the need for prior domain knowledge by automatically discerning feature intervals directly from the data. These intervals capture essential patterns and characteristics within the dataset, empowering our classifiers with newfound adaptability and insight. In addition, we employ outranking measures to mitigate the influence of noise and uncertainty in the data. Through pairwise comparisons of alternatives on each feature, we enhance the robustness and reliability of our classification outcomes. The developed classifiers are empirically evaluated on several data sets from UCI repository and are compared with well-known classifiers including k Nearest Neighbors (K-NN), Support Vector Machine (SVM), Random Forest (RF), Neural Network (NN), Naive Bayesian (NB) and Nearest Centroid (NC). The experiments result demonstrate that the classifiers based on feature interval learning and outranking approaches are robust to imbalanced data and to irrelevant features and achieve comparably and even better performances than the well-known classifiers in some cases. Moreover, our proposed classifiers produce more explainable models whilst preserving high predictive performance levels.

Globalization, knowledge economy, information technology advancements, and the rise of learning societies contribute to the concept of a learning city. The study examines the economic indicators of Yazd city, Iran, in the context of learning city development. A descriptive-analytical approach with a survey method and cluster sampling was employed. Data analysis involved Kolmogorov-Smirnov normality test, single-sample T-test, simple linear regression, and Kendall's W test. The normality test confirmed data normality. The T-test indicated that experts perceived the current state of most variables in Yazd as undesirable. Regression analysis revealed a significant positive association between the economic index and independent variables. Kendall's W test prioritized areas based on economic indicators, with the top 7 and bottom 5 areas identified for focused interventions. The study emphasizes the need to prioritize areas within Yazd based on their economic indicators. This prioritization informs strategies for enhancing social and legal aspects of Yazd's transformation into a learning city. Further research should explore effective methods to cultivate a full-fledged learning environment in the city.

Multimodal remote sensing data classification can enhance the model’s ability to distinguish land features through multimodal data fusion. In this context, how to help models understand the relationship between multimodal data and target tasks is the focus of researchers. Inspired by human feedback learning mechanisms, causal reasoning mechanisms, and knowledge induction mechanisms, this paper integrates causal learning, reinforcement learning, and meta learning into a unified remote sensing data classification framework and proposed the causal meta-reinforcement learning (CMRL). First, based on feedback learning mechanisms, we have overcome the limitations of traditional implicit optimization of fusion features and customized a reinforcement learning environment for multimodal remote sensing data classification tasks. Through feedback interactive learning between agents and the environment, we help them understand the complex relationships between multimodal data and labels, thereby achieving full mining of multimodal complementary information. Second, based on the causal inference mechanism we designed causal distribution prediction action, classification reward, and causal intervention reward, capturing pure causal factors in multimodal data and cutting off false statistical associations between non-causal factors and class labels. Finally, based on the knowledge induction mechanism, we designed a bi-layer optimization mechanism based on meta-learning. By constructing a meta training task and meta validation task simulation model in the generalization scenario of unseen data, we helped the model induce cross-task shared knowledge, thereby improving its generalization ability for unseen multimodal data. The experimental results on multiple sets of multimodal datasets show that the proposed method achieved state-of-the-art performance in multimodal remote sensing data classification tasks.

Online learning is gaining massive popularity with time. The e-learning platforms operate differently from traditional educational institutions and hence need different strategy for course recommendations. This survey aims to cover the major emerging research areas in e-learning recommender systems. Our study covers different areas of research including graph-based methodologies, ITS, query optimization, content-based, and collaborative filtering, big data, and association rules mining. This survey aimed to explore all major emerging directions of recommender systems in education. This study analyzed existing literature in all of the areas mentioned before and performed objective-based analysis. A brief performance analysis was also done for the researches where the values were comparable. Limitations of existing researches were also identified and studied to shed some light on future directions.

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and improved performance. Despite the increasing interest in GNNs and their use cases, there is little research on their transferability. This research demonstrates that transfer learning is effective with GNNs, and describes how source tasks and the choice of GNN impact the ability to learn generalisable knowledge. We perform experiments using real-world and synthetic data within the contexts of node classification and graph classification. To this end, we also provide a general methodology for transfer learning experimentation and present a novel algorithm for generating synthetic graph classification tasks. We compare the performance of GCN, GraphSAGE and GIN across both the synthetic and real-world datasets. Our results demonstrate empirically that GNNs with inductive operations yield statistically significantly improved transfer. Further we show that similarity in community structure between source and target tasks support statistically significant improvements in transfer over and above the use of only the node attributes.

Deep learning (DL), a branch of machine learning (ML) and artificial intelligence (AI) is nowadays considered as a core technology of today's Fourth Industrial Revolution (4IR or Industry 4.0). Due to its learning capabilities from data, DL technology originated from artificial neural network (ANN), has become a hot topic in the context of computing, and is widely applied in various application areas like healthcare, visual recognition, cybersecurity, and many more. However, building an appropriate DL model is a challenging task, due to the dynamic nature and variations in real-world problems and data. Moreover, the lack of core understanding turns DL methods into black-box machines that hamper development at the standard level. This article presents a structured and comprehensive view on DL techniques including a taxonomy considering various types of real-world tasks like supervised or unsupervised. In our taxonomy, we take into account deep networks for supervised or discriminative learning, unsupervised or generative learning as well as hybrid learning and relevant others. We also summarize real-world application areas where deep learning techniques can be used. Finally, we point out ten potential aspects for future generation DL modeling with research directions. Overall, this article aims to draw a big picture on DL modeling that can be used as a reference guide for both academia and industry professionals.

During the COVID-19 outbreak, most university courses have been offered on online platforms. A sudden shift from face-to-face classroom learning to online formats could influence the learning effectiveness of classes. This study aims to investigate differences in the learning effectiveness of online and face-to-face lecture courses. It also explores factors that impact the effectiveness of online instruction. These factors include interactions among learners, interactions between learners and the instructor, the quality of online platforms, learners’ ability to use devices and follow instructions, and learners’ situational challenges. The study participants were 261 university students at King Mongkut’s University of Technology Thonburi in Bangkok, Thailand. All participants were enrolled in at least one lecture course, such as history, humans and the environment, the environment and development, or general philosophy, during the 2019 academic year. A questionnaire was distributed to participants after they completed these courses in May 2020. Paired simple t-test analyses were used to compare the effectiveness of online and face-to-face classes, and a multiple regression analysis was used to identify factors that impact the learning effectiveness of online classes. The results show that online classes are less effective than face-to-face courses. The multiple regression analysis also revealed that the effectiveness of online learning was significantly impacted by learners’ ability to interact with classmates during class, their ability to interact with instructors after the class, the quality of online platforms, and disturbances or distractions in learners’ environments.

Generic text embeddings have demonstrated considerable success across a multitude of applications. However, these embeddings are typically derived by modeling the co-occurrence patterns within text-only corpora, which can limit their ability to generalize effectively across diverse contexts. In this study, we investigate methodologies that incorporate visual information into textual representations to overcome these limitations. Through extensive ablation studies, we introduce a novel and straightforward architecture named VisualText Fusion Network (VTFN). This architecture not only surpasses existing multimodal approaches on a range of well-established benchmark datasets but also achieves state-of-the-art performance on image-related textual datasets while utilizing significantly less training data. Our findings underscore the potential of integrating visual modalities to substantially enhance the robustness and applicability of text embeddings, paving the way for more nuanced and contextually rich semantic representations.

Recommender systems in education are becoming more widespread, typically focusing on recommending courses or study materials. This study proposes a machine learning approach to recommend a university degree based on high school and university standardised test results, incorporating students' socioeconomic information as input variables. The objective is to develop a tool for students’ decision-making, supporting the sustainable development goal of Quality Education by providing a data schema to maximise the likelihood of a successful match between the student's profile and the academic program. With its focus on equity in education, this study provides a data-driven approach to assist students in selecting suitable university degrees, aiming to improve educational outcomes and inspire a more equitable education system.

We study how abstract representations emerge in a Deep Belief Network (DBN) trained on benchmark datasets. Our analysis targets the principles of learning in the early stages of information processing, starting from the “primordial soup" of the under-sampling regime. As the data is processed by deeper and deeper layers, features are detected and removed, transferring more and more “context-invariant” information to deeper layers. We show that the representation approaches an universal model – the Hierarchical Feature Model (HFM) – determined by the principle of maximal relevance. Relevance quantifies the uncertainty on the model of the data, thus suggesting that “meaning" – i.e. syntactic information – is that part of the data which is not yet captured by a model. Our analysis shows that shallow layers are well described by pairwise Ising models, which provide a representation of the data in terms of generic, low order features. We also show that plasticity increases with depth, in a similar way as it does in the brain. These findings suggest that DBNs are capable of extracting a hierarchy of features from the data which is consistent with the principle of maximal relevance.

Fruit quality is a critical factor in the produce industry, affecting producers, distributors, consumers, and the economy. High-quality fruits are more appealing, nutritious, and safe, boosting consumer satisfaction and revenue for producers. Artificial Intelligence can aid in assessing the quality of the fruit using images. This paper presents a general machine-learning model for assessing fruit quality using deep image features. The model leverages the learning capabilities of the recent successful networks for image classification called Vision Transformers (ViT). The ViT model is built and trained with a combination of various fruit datasets and learned to distinguish between good and rotten fruit images. The general model demonstrated impressive results in accurately identifying the quality of various fruits such as Apples (with a 99.50% accuracy), Cucumbers (99%), Grapes (100%), Kakis (99.50%), Oranges (99.50%), Papayas (98%), Peaches (98%), Tomatoes (99.50%), and Watermelons (98%). However, it showed slightly lower performance in identifying Guavas (97%), Lemons (97%), Limes (97.50%), mangoes (97.50%), Pears (97%), and Pomegranates (97%).

Modelling both long and short-term user interests from historical data is crucial for accurate recommendations. However, unifying these metrics across multiple application domains can be challenging, and existing approaches often rely on complex, intertwined models which can be difficult to interpret. To address this issue, we propose a lightweight, plug-and-play interest enhancement module that fuses interest vectors from two independent models. After analyzing the dataset, we identify deviations in the recommendation performance of long and short-term interest models. To compensate for these differences, we use feature enhancement and loss correction during training. In the fusion process, we explicitly split long-term interest features with longer duration into multiple local features. We then use a shared attention mechanism to fuse multiple local features with short-term interest features to obtain interaction features. To correct for bias between models, we introduce a comparison learning task that monitors the similarity between local features, short-term features, and interaction features. This adaptively reduces the distance between similar features. Our proposed module combines and compares multiple independent long-term and short-term interest models on multiple domain datasets. As a result, it not only accelerates the convergence of the models but also achieves outstanding performance in challenging recommendation scenarios.

Over the past decade, research in the field of Deep Learning has brought about novel improvements in image generation and feature learning; one such example being a Generative Adversarial Network. However, these improvements have been coupled with an increasing demand on mathematical literacy and previous knowledge in the field. Therefore, in this literature review, I seek to introduce Generative Adversarial Networks (GANs) to a broader audience by explaining their background and intuition at a more foundational level. I begin by discussing the mathematical background of this architecture, specifically topics in linear algebra and probability theory. I then proceed to introduce GANs in a more theoretical framework, along with some of the literature on GANs, including their architectural improvements and image-generation capabilities. Finally, I cover state-of-the-art image generation through style-based methods, as well as their implications on society.

This study evaluated the using of machine vision in combination with deep learning to identify weeds in real-time for wheat production system. PMAS-Arid Agriculture university research farm were selected for collection of images (6000 total images) of weeds and wheat crops under different weather condition. During growing season, the database was constructed to identify the weeds. For this study two framework were used TensorFlow and PyTorch under CNNs and Deep learning. Deep learning perfromed better with in PyTourch value as compared to another model in Tensorflow. comparing with other networks such as YOLOv4, we concluded that our network reaches a better result between speed and accuracy. Specifically, the maximum precision of weed and wheat plants were 0.89 and 0.91 respectively with 9.43 ms and 12.38 ms inference time per image (640 × 640) NVIDIA RTX2070 GPU.

Tremendous progress has been witnessed in artificial intelligence within the domain of neural network backed deep learning systems and its applications. As we approach the post Moore’s Law era, the limit of semiconductor fabrication technology along with a rapid increase in data generation rates have lead to an impending growing challenge of tackling newer and more modern machine learning problems. In parallel, quantum computing has exhibited rapid development in recent years. Due to the potential of a quantum speedup, quantum based learning applications have become an area of significant interest, in hopes that we can leverage quantum systems to solve classical problems. In this work, we propose a quantum deep learning architecture; we demonstrate our quantum neural network architecture on tasks ranging from binary and multi-class classification to generative modelling. Powered by a modified quantum differentiation function along with a hybrid quantum-classic design, our architecture encodes the data with a reduced number of qubits and generates a quantum circuit, loading it onto a quantum platform where the model learns the optimal states iteratively. We conduct intensive experiments on both the local computing environment and IBM-Q quantum platform. The evaluation results demonstrate that our architecture is able to outperform Tensorflow-Quantum by up to 12.51% and 11.71% for a comparable classic deep neural network on the task of classification trained with the same network settings. Furthermore, our GAN architecture runs the discriminator and the generator purely on quantum hardware and utilizes the swap test on qubits to calculate the values of loss functions. In comparing our quantum GAN, we note our architecture is able to achieve similar performance with 98.5% reduction on the parameter set when compared to classical GANs. With the same number of parameters, additionally, QuGAN outperforms other quantum based GANs in the literature for up to 125.0% in terms of similarity between generated distributions and original data sets.

The conventional machine learning (ML) algorithms are continuously advancing and evolving at a fast-paced by introducing the novel learning algorithms. ML models are continually improving using hybridization and ensemble techniques to empower computation, functionality, robustness, and accuracy aspects of modeling. Currently, numerous hybrid and ensemble ML models have been introduced. However, they have not been surveyed in a comprehensive manner. This paper presents the state of the art of novel ML models and their performance and application domains through a novel taxonomy.

This paper presents a new method : HIVEC to learn latent vector representations of graphs in a manner that captures the semantic dependencies of sub-structures. The representations can then be used in machine learning algorithms for tasks such as graph classification, clustering etcetera. The method proposed is unsupervised and uses the information of co-occurrence of sub-structures. It introduces a notion of hierarchical embeddings that allows us to avoid repetitive learning of sub-structures for every new graph. As an alternative to deep learning methods, the edit distance similarity between sub-structures is also used to learn vector representations. We compare the performance of these methods against previous work.

We investigate soccer analytics from supervised learning, unsupervised learning, and reinforcement learning perspectives. With the increasing availability of player tracking data and event logs, machine learning techniques have become essential for uncovering patterns in player and team performance. In this paper, we examine how supervised learning models are applied to tasks such as match outcome prediction and player rating systems, while unsupervised learning is utilized for player clustering, tactical analysis, and the discovery of hidden patterns in game data. Reinforcement learning, on the other hand, plays a key role in optimizing decision-making during matches by learning optimal strategies and tactics through trial and error. By providing a comprehensive overview of these approaches, we aim to highlight the transformative potential of machine learning in modern soccer analytics and how it continues to shape the sport. We also provide summary of other soccer analytics research in this work.

Undergraduate learning is a multifaceted concept that many researchers have investigated to promote student engagement, academic performance, etc. Exploring factors promoting learning among undergraduates in FYW programs, which are required for undergraduates might potentially contribute to sustainable, cross-disciplinary undergraduate education. This study used the 10-year longitudinal grade and survey data at San José State University (SJSU) and the data was collected from Academic Years (AYs) 2015 to 2020, and five student surveys constituted the sample size of 18,101 students. In 2016, SJSU changed the remedial writing course to college writing courses. Since then, students need to complete an online module course before placing themselves into a one-semester or two-semester writing course. The previous study showed that students with higher writing comfort and confidence tend to place themselves into a semester-long class. Regression analysis was applied to examine the relationships among factors promoting learning among those students. University admitted students from various diversity and backgrounds, the results of this study suggested that what students chose and persisted in were more important in advancing their academic success rather than prior learning experience or psychological factors before the class.

The COVID-19 pandemic has led to the growth of hybrid and online learning environments and the trend to introduce more technology into the classroom. One such change would be the use of smart synchronous hybrid learning environments (SSHLE), which are settings with both in-person and online students concurrently, and in which technology plays a key role in sensing, analyzing, and reacting throughout the teaching and learning process. These changing environments and the incorporation of new technologies can place a greater orchestration load on participants and a reduction in teacher agency. In this context, the aim of this paper is to analyse the orchestration load and teacher agency in different SSHLEs. The NASA-TLX model was used to measure the orchestration load in several scenarios. Questionnaires and interviews were used to measure teacher agency. The results obtained indicate that the orchestration load of the teacher tends to be high (between 60 and 70 points out of 100 of the NASA-TLX workload), especially when they lack experience in synchronous hybrid learning environments, and the orchestration load of the students tends to have average values (between 50 and 60) in the SSHLEs analysed. Meanwhile, the teacher agency does not appear to be altered but shows potential for improvement.

A common challenge in real-world classification scenarios with sequentially appending target domain data is insufficient training datasets during the training phase. Therefore, conventional deep learning and transfer learning classifiers are not applicable especially when individual classes are not represented or are severely underrepresented at the outset. Domain Generalization approaches reach their limits when domain shifts become too large, making them occasionally unsuitable as well. In many (technical) domains, however, it is only the defect/ worn/ reject classes that are insufficiently represented, while the non-defect class is often available from the beginning. The proposed classification approach addresses such conditions and is based on a CNN encoder. Following a contrastive learning approach, it is trained with a modified triplet loss function using two datasets: Besides the non-defective target domain class (= 1st dataset), a state-of-the-art labeled source domain dataset that contains highly related classes (e.g., a related manufacturing error or wear defect) but originates from a (highly) different domain (e.g., different product, material, or appearance) (= 2nd dataset) is utilized. The approach learns the classification features from the source domain dataset while at the same time learning the differences between the source and the target domain in a single training step, aiming to transfer the relevant features to the target domain. The classifier becomes sensitive to the classification features and – by architecture – robust against the highly domain-specific context. The approach is benchmarked in a technical and a non-technical domain and shows convincing classification results. In particular, it is shown that the domain generalization capabilities and classification results are improved by the proposed architecture, allowing for larger domain shifts between source and target domains.

Deep learning has achieved lots of successes in many fields, but when trainable sample are extremely limited, deep learning often under or overfitting to few samples. Meta-learning was proposed to solve difficulties in few-shot learning and fast adaptive areas. Meta-learner learns to remember some common knowledge by training on large scale tasks sampled from a certain data distribution to equip generalization when facing unseen new tasks. Due to the limitation of samples, most approaches only use shallow neural network to avoid overfitting and reduce the difficulty of training process, that causes the waste of many extra information when adapting to unseen tasks. Euclidean space-based gradient descent also make meta-learner's update inaccurate. These issues cause many meta-learning model hard to extract feature from samples and update network parameters. In this paper, we propose a novel method by using multi-stage joint training approach to post the bottleneck during adapting process. To accelerate adapt procedure, we also constraint network to Stiefel manifold, thus meta-learner could perform more stable gradient descent in limited steps. Experiment on mini-ImageNet shows that our method reaches better accuracy under 5-way 1-shot and 5-way 5-shot conditions.

We introduce a modelling framework for the investigation of on-line machine learning processes in non-stationary environments. We exemplify the approach in terms of two specific model situations: In the first, we consider the learning of a classification scheme from clustered data by means of prototype-based Learning Vector Quantization (LVQ). In the second, we study the training of layered neural networks with sigmoidal activations for the purpose of regression. In both cases, the target, i.e. the classification or regression scheme, is considered to change continuously while the system is trained from a stream of labeled data. We extend and apply methods borrowed from statistical physics which have been used frequently for the exact description of training dynamics in stationary environments. Extensions of the approach allow for the computation of typical learning curves in the presence of concept drift in a variety of model situations. First results are presented and discussed for stochastic drift processes in classification and regression problems. They indicate that LVQ is capable of tracking a classification scheme under drift to a non-trivial extent. Furthermore, we show that concept drift can cause the persistence of sub-optimal plateau states in gradient based training of layered neural networks for regression.

Generating executable code from natural language instructions using Large Language Models (LLMs) presents challenges such as semantic understanding and handling ambiguous input. This study focuses on the SantaCoder model and explores the impact of in-context learning on code generation using the MBPP and HumanEval datasets for evaluation. Our results demonstrate significant improvements in three key metrics (defined in the paper): correctness@k, similarity@k and pass@k. To address the problem of selecting optimal demonstrations to maximize correctness and pass rates, we investigate two methods: latent concept selection and random selection in this paper. These findings highlight the effectiveness of in-context learning and the critical role of demonstration selection in enhancing the accuracy, efficiency, and versatility of the SantaCoder model in code generation.

Dementia education and training for workforce development is becoming increasingly important in bridging knowledge gaps among health and social care practitioners in the UK and internationally. Dementia Education for Workforce Excellence (DEWE) was developed during the COVID-19 pandemic blending both synchronous and asynchronous instruction and delivered across three different contexts: care homes, home care, and nurse education within the UK and India. This study aimed to evaluate DEWE using mixed methods with online survey data analyzed descriptively and interview data analyzed thematically. Integration of survey and interview data aimed toward a comprehensive evaluation of this novel approach for dementia workforce development. Thirty-four social care practitioners and nurse educators completed the online survey demonstrating high-level learner satisfaction; learning gains; behavioral change, and motivation to share new knowledge. Four key themes developed from the analysis of interviews (n=9) around participants’ pursuit of new knowledge; delivery modes in DEWE; learning gains and impact of DEWE; and adaptations for future program implementation. Findings suggest DEWE is an innovative resource that promotes person- and relationship-centered dementia care across all stages of one’s dementia journey. Cultural adaptations are recommended for international delivery to ensure contextual alignment and maximum impact.

Ransomware attacks have rapidly proliferated, inflicting severe financial damages on businesses and individuals. Machine learning approaches to automate ransomware detection have shown promise but grapple with challenges like limited training data. This study introduces a novel deep learning model for few-shot ransomware classification. The model employs entropy features derived directly from malware binaries coupled with a twin neural network architecture utilizing transfer learning. Tests on over 1000 samples across 11 families demonstrate a weighted F1-score of 85.8\%, surpassing existing methods. The approach mitigates biases in limited training data and preserves intricacies lost in image-based features. It exhibits precise classification capabilities even with sparse samples of new ransomware variants. The research highlights the potential of entropy-driven deep learning to equip defenses against emerging zero-day ransomware strains.

Breast cancer is a common malignant tumour and studies have shown that early and accurate detection is crucial for patients. With the maturity of medical imaging and deep learning development, significant progress has been made in breast cancer classification, which greatly improves the accuracy and efficiency of classification. This review focuses on deep learning, migration learning, GAN, and lifelong learning to elaborate and summarise the important roles arising from breast cancer detection. This review also examines the dataset and labeling issues required for breast cancer classification. In conclusion, at the end of the article, we look at future directions for breast cancer classification research, including cross-migration learning, multimodal data fusion, model interpretability, and lifelong learning, and also explore how to provide personalized treatment plans for patients.

At the beginning of 2020, with the onset of the pandemic, the traditional learning environment for learners drastically changed globally. Since then, most students/teachers have started and practiced distance and virtual learning/teaching. Thus, a technological breakthrough in virtual learning has followed. In connection with this, many countries worldwide have commenced allocating additional financing and funds for educational institutions' technological improvement and development. The long-term stay in distance learning has revealed and highlighted new problems students face: their knowledge level has decreased, they lack socialization skills, and they face psychological and physical health problems. Due to this negative impact on students, a need to research and evaluate how much the EU countries allocated to solve the distance learning-caused problems and what programs or models they prepared has emerged and encouraged further studies. The research has found that many countries increased their allocations very minimally, e.g., 0.0.1%, but some increased their available budgets to 32%. Notably, most countries did not separate distance learning exit funding from distance learning preparation funding. Based on the problems the countries saw, only a few states identified withdrawal from distance learning as a problem. Considering this, we set ourselves the goal to evaluate exit models from distance learning and allocated funding amounts. The following objectives were planned to achieve the goal: · to evaluate the global practice of exit from distance learning; · to determine the scope of funding for pandemic management; · to evaluate the amounts of funding allocated to manage pandemic-caused consequences and the GDP ratio. Research methods: mathematical-statistical analysis, empirical analysis, and analysis of scientific literature.

Reinforcement Learning (RL) has demonstrated considerable potential in solving challenges across various domains, notably in autonomous driving. Nevertheless, implementing RL in autonomous driving comes with its own set of difficulties, such as the overestimation phenomenon, extensive learning time, and sparse reward problems. Although solutions like Hindsight Experience Replay (HER) have been proposed to alleviate these issues, the direct utilization of RL in autonomous vehicles remains constrained due to the intricate fusion of information and the possibility of system failures during the learning process. In this paper, we present a novel RL-based autonomous driving system technology that combines Obstacle Dependent Gaussian (ODG) RL, Soft Actor-Critic (SAC), and meta-learning algorithms. Our approach addresses key issues in RL, including the overestimation phenomenon and sparse reward problems, by incorporating prior knowledge derived from the ODG algorithm. We evaluated our proposed algorithm on official F1 circuits, using high-fidelity racing simulations with complex dynamics. The results demonstrate exceptional performance, with our method achieving up to 89% faster learning speed compared to existing algorithms in these environments.

This review paper delves into using micro-credentials in higher education ecosystems as a digital enablers. Micro-credentials, which are digital credentials that attest to a learner’s mastery of a specific skill or knowledge area, are becoming more popular in higher education. The paper examines the successful implementation of micro-credential frameworks in higher education, using case studies to demonstrate the advantages of micro-credentials. The review emphasizes the agility and flexibility of microcredentials, which enable learners to acquire new skills quickly and respond to changes in the job market. In addition, the paper discusses the digital nature of micro-credentials and how they allow institutionsto provide targeted, skills-based training that isrelevant to employers. It also explores how micro-credentials are delivered through online platforms, making them convenient and easily accessible for learners. The review underscores the significance of digital infrastructure, connectivity, and public utility for promoting micro-credentials. The paper argues that micro-credentials function as a digital enabler for higher edu- cation ecosystems, allowing learners to acquire targeted training and enabling institutions to expand their offerings and reach more students. The paper concludes by highlighting the potential for micro-credentials to help bridge the skills gap and equip learners with the skills necessary to succeed in today’s digital economy.

Tuberculosis (TB) disease still remain a major global threat due to the growing number of drug-resistant species and global warming. Despite the fact that there are new molecular diagnostic approaches, however, majority of developing countries and remote clinics depends on conventional approaches such as Tuberculin test, microscopic examinations and radiographic imaging (Chest X-ray). These techniques are hindered by several challenges which can lead to miss-diagnosis especially when interpreting large number of sample cases. Thus, in order to reduce workload and prevent miss-diagnosis, scientists incorporated computer-aided technology for detection of medical images known as Computer aided Detection (CADe) or Diagnosis (CADx). The use of AI-powered techniques has shown to improve accuracy, sensitivity, specificity. In this review, we discussed about the epidemiology, pathology, diagnosis and treatment of tuberculosis. The review also provides background information on Artificial Intelligence (AI), Machine Learning (ML), Deep Learning (DL), Transfer Learning (TL) and their applications in detection of tuberculosis from both microscopic slide images and X-ray images. The review also proposed an IoT/AI powered system which allows transfer of results obtained from DL models with end users through internet networks. The concept of futuristic diagnosis, limitations of current techniques and open research issues are also discussed.

The use of Information Communication Technologies (ICT) in education brings up new possibilities of promoting the learning and health experiences. In this sense, education contexts of 21st century must consider these two areas of knowledge, especially their integration. This article presents learning practices developed with mobile devices and games, in order to improve learning and well-being in children and adolescents undergoing cancer treatment in non-formal educational setting. The methodology is based on qualitative case studies with content-based data analysis, involving informal interviews and observation methods. The study considers data from 5 patients who participated in the research between 2015 and 2019. The results demonstrate a positive influence of the practices with mobile technologies and games in terms of learning and in the well-being feeling of patients during the treatment.

Video self-supervised learning (VideoSSL) offers significant potential for reducing annotation costs and enhancing a wide range of downstream tasks in video understanding. The ultimate goal of VideoSSL is to achieve human-level video intelligence across a spectrum of tasks, from low-level tasks such as pixel temporal correspondence to high-level complex spatio-temporal tasks like action recognition. However, most existing VideoSSL methods focus on isolated aspects of this spectrum and fail to integrate different levels of task complexity. Our study presents the first comprehensive survey that connects all families of VideoSSL methods. We provide a detailed review of the full spectrum of VideoSSL, from low to high levels, by conceptually linking their self-supervised learning objectives and including a comprehensive categorization. Our extensive evaluation highlights the strengths and limitations of each SSL objective across various downstream task families. We also detail the challenges in current VideoSSL research such as data curation, interpretability, deployment, and privacy concerns, an area that previous surveys have not thoroughly explored. In addressing these challenges, we recognize the strengths of existing methods in addressing these challenges and outline future directions for research.

Recent advancements in artificial intelligence (AI) and deep learning have revolutionized the field of protein engineering, particularly in the area of de novo protein design. This review article explores the impact of AI-driven approaches on protein design, with a specific focus on the role of structure prediction neural networks, such as AlphaFold and RoseTTAFold. The article discusses the paradigm shift brought about by these networks, which have enabled the design of proteins with unique structures and functions that are not found in nature. The review covers various aspects of AI-driven protein design, including the use of protein language models to harness evolutionary information, the development of de novo protein design workflows utilizing deep learning, and the application of generative models like RFdiffusion and RoseTTAFold All-Atom. The article also highlights the successes and applications of AI-driven protein design across diverse domains, such as enzyme engineering, antibody design, and vaccine development. Additionally, the review identifies current challenges and future directions in the field, emphasizing the need to address limitations in modeling conformational dynamics and designing proteins for in vivo functionality. The article concludes by underscoring the potential of AI-driven protein design to transform various aspects of science and technology, while also acknowledging the importance of interdisciplinary collaboration and the development of robust pipelines for the validation and optimization of designed proteins. Overall, this comprehensive review serves as a valuable resource for researchers and practitioners interested in understanding the current state and future prospects of AI-driven protein design.

Artificial intelligence (AI) refers to computer algorithms that replicate the cognitive function of humans. Machine learning is widely applicable using structured and unstructured data, while deep learning is derived from the neural networks of the human brain that process and interpret information. During the last decades, AI has been introduced in several aspects of healthcare. In this review, we aim to present the current application of AI in the neonatal intensive care unit. AI-based models have been applied to neurocritical care, including automated seizure detection algorithms and electroencephalogram-based hypoxic-ischemic encephalopathy severity grading systems. Moreover, AI models evaluating magnetic resonance imaging contributed to the progress of the evaluation of the neonatal developing brain and the understanding of how prenatal events affect both structural and functional network topologies. Furthermore, AI algorithms have been applied to predict the development of bronchopulmonary dysplasia and assess the extubation readiness of preterm neonates. Automated models have been also used for the detection of retinopathy of prematurity and the need for treatment. Among others, AI algorithms have been utilized for the detection of sepsis, the need for patent ductus arteriosus treatmnet, the evaluation of jaundice, and the detection of gastrointestinal morbidities. Finally, AI prediction models have been constructed for the evaluation of the neurodevelopmental outcome and the overall mortality of neonates. Although the application of AI in neonatology is encouraging, further research in AI models is warranted in the future including retraining clinical trials, validating the outcomes, and addressing serious ethics issues.

Distance Learning has become the new standard, especially after the pandemic and due to the technological advances, that are incorporated into the teaching procedure. At the same time, the augmented use of the internet has blurred the borders between distance and conventional learning. Students interact mainly through LMSs, leaving their digital traces that can be leveraged to improve the educational process. This work aims to propose a model that can capture the students' behaviors based on the clickstream data associated with the discussion forum and additionally to suggest interpretable patterns that will support education administrators and tutors in the decision-making process. To achieve our goal, we use Social Network Analysis (SNA) as networks represent complex interactions in a meaningful and easily interpretable way. Moreover, simple or complex network metrics are becoming available to provide valuable insights into the students’ social interaction. This study concludes that by leveraging the imprint of these actions in an LMS and using metrics of SNA, differences can be spotted in the communicational patterns that go beyond simple participation recording. Although HITS and PageRank algorithms were created with completely different targeting, it is shown that they can also reveal methodological features in students’ communicational approach.

Artificial Intelligence (AI) is becoming increasingly important, especially in the medical field. While AI has been used in medicine for some time, its growth in the last decade has been remarkable. Specifically, Machine Learning (ML) and Deep Learning (DL) techniques in medicine have been increasingly adopted thanks to the growing abundance of health-related data, improved suitability of such techniques for managing large data-sets, and more computational power. The Italian scientific community has been instrumental in advancing this research area. This article aims to conduct a comprehensive investigation of the ML and DL methodologies and applications used in medicine by the Italian research community in the last five years.

Documenting cultural heritage by using artificial intelligence (AI) is crucial for preserving the memory of the past and a key point for future knowledge. However, modern AI technologies make use of statistical learners that lead to self-empiricist logic, which, unlike human minds, use learned non-symbolic representations. Nevertheless, it seems that it is not the right way to progress in AI. If we want to rely on AI for these tasks, it is essential to understand what lies behind these models. Among the ways to discover AI there are the senses and the intellect. We could consider AI as an intelligence. Intelligence has an essence, but we do not know whether it can be considered “something” or “someone”. Important issues in the analysis of AI concern the structure of symbols -operations with which the intellectual solution is carried out- and the search for strategic reference points, aspiring to create models with human-like intelligence. For many years, humans, seeing language as innate, have carried out symbolic theories. Everything seems to have skipped with the advent of Machine Learning. In this paper, after a long analysis of history, the rule-based and the learning-based vision, we propose KERMIT as a unit of investigation for a possible meeting point between the different learning theories. Finally, we propose a new vision of knowledge in AI models based on a combination of rules, learning and human knowledge.

Using data-driven models to solve predictive maintenance problems has been prevalent for original equipment manufacturers (OEMs). However, such models fail to solve two tasks that OEMs are interested in: (1) Making the well-built failure prediction models working on existing scenarios (vehicles, working conditions) adaptive to target scenarios. (2) Finding out the failure causes, furthermore, determining whether a model generates failure predictions based on reasonable causes. This paper investigates a comprehensive architecture towards making the predictive maintenance system adaptive and interpretable by proposing (1) an ensemble model dealing with time-series data consisting of a long short-term memory (LSTM) neural network and Gaussian threshold to achieve failure prediction one week in advance and (2) an online transfer learning algorithm and a meta learning algorithm, which render existing models adaptive to new vehicles with limited data volumes. (3) Furthermore, the Local Interpretable Model-agnostic Explanations (LIME) interpretation tool and super-feature methods are applied to interpret individual and general failure causes. Vehicle data from Isuzu Motors, Ltd., are adopted to validate our method, which include time-series data and histogram data. The proposed ensemble model yields predictions with 100% accuracy for our test data on engine stalling problem and is more rapidly adaptive to new vehicles with smaller error following application of either online transfer learning or the meta learning method. The interpretation methods help elucidate the global and individual failure causes, confirming the model credibility.

We discuss the implementation of a suite of virtual diagnostics at the FACET-II facility currently under commissioning at SLAC National Accelerator Laboratory. The diagnostics will be used for prediction of the longitudinal phase space along the linac, spectral reconstruction of the bunch profile and non-destructive inference of transverse beam quality (emittance) using edge radiation at the injector dogleg and bunch compressor locations. These measurements will be folded in to adaptive feedbacks and ML-based reinforcement learning controls to improve the stability and optimize the performance of the machine for different experimental configurations. In this paper we describe each of these diagnostics with expected measurement results based on simulation data and discuss progress towards implementation in regular operations.

The importance of energy systems and its role in economics and politics is not hidden for anyone. This issue is not only important for the advanced industrialized countries, which are major energy consumers, but is also important for oil-rich countries. In addition to the nature of these fuels which contains polluting substances, the issue of their ending up has aggravated the growing concern. Biofuels can be used in different fields for energy production like electricity production, power production or for transportation. Various scenarios have been written about the estimated biofuels from different sources in the future energy system. The availability of biofuels for the electricity market, heating and liquid fuels is very important. Accordingly, the need for handling, modelling, decision making and future forecasting for biofuels can be one of the main challenges for scientists. Recently, machine learning and deep learning techniques have been popular in modeling, optimizing and handling the biodiesel production, consumption and its environmental impacts. The main aim of this study is to evaluate the ML and DL techniques developed for handling biofuels production, consumption and environmental impacts, both for modeling and optimization purposes. This will help for sustainable biofuel production for the future generations.

While the use of crime data has been widely advocated in the literature, its availability is often limited to large urban cities and isolated databases tend not to allow for spatial comparisons. This paper presents an efficient machine learning framework capable of predicting spatial crime occurrences, without using past crime as a predictor, and at a relatively high resolution: the U.S. Census Block Group level. The proposed framework is based on an in-depth multidisciplinary literature review allowing the selection of 188 best-fit crime predictors from socio-economic, demographic, spatial, and environmental data. Such data are published periodically for the entire United States. The selection of the appropriate predictive model was made through a comparative study of different machine learning families of algorithms, including generalized linear models, deep learning, and ensemble learning. The gradient boosting model was found to yield the most accurate predictions for violent crimes, property crimes, motor vehicle thefts, vandalism, and the total count of crimes. Extensive experiments on real-world datasets of crimes reported in 11 U.S. cities demonstrated that the proposed framework achieves an accuracy of 73 and 77% when predicting property crimes and violent crimes, respectively.

The prevalence of differential equations as a mathematical technique has refined the fields of control theory and constrained optimization due to the newfound ability to accurately model chaotic, unbalanced systems. However, in recent research, systems are increasingly more nonlinear and difficult to model using Differential Equations only. Thus, a newer technique is to use policy iteration and Reinforcement Learning, techniques that center around an action and reward sequence for a controller. Reinforcement Learning (RL) can be applied to control theory problems since a system can robustly apply RL in a dynamic environment such as the cartpole system (an inverted pendulum). This solution successfully avoids use of PID or other dynamics optimization systems, in favor of a more robust, reward-based control mechanism. This paper applies RL and Q-Learning to the classic cartpole problem, while also discussing the mathematical background and differential equations which are used to model the aforementioned system.

The world has been evolving with new technologies and advances day-by-day. With the advent of various learning technologies in every field, the research community is able to provide solution in every aspect of life with the applications of Artificial Intelligence, Machine Learning, Deep Learning, Computer Vision, etc. However, with such high achievements, it is found to lag behind the ability to provide explanation against its prediction. The current situation is such that these modern technologies are able to predict and decide upon various cases more accurately and speedily than a human, but failed to provide an answer when the question of why to trust its prediction is put forward. In order to attain a deeper understanding into this rising trend, we explore a very recent and talked-about novel contribution which provides rich insight on a prediction being made -- ``Explainability.'' The main premise of this survey is to provide an overview for researches explored in the domain and obtain an idea of the current scenario along with the advancements published to-date in this field. This survey is intended to provide a comprehensive background of the broad spectrum of Explainability.

Machine learning (ML) has emerged as a critical tool for making sense of the growing amount of genetic and genomic data available because of its ability to find complex patterns in high dimensional and heterogeneous data. While the complexity of ML models is what makes them powerful, it also makes them difficult to interpret. Fortunately, recent efforts to develop approaches that make the inner workings of ML models understandable to humans have improved our ability to make novel biological insights using ML. Here we discuss the importance of interpretable ML, different strategies for interpreting ML models, and examples of how these strategies have been applied. Finally, we identify challenges and promising future directions for interpretable ML in genetics and genomics.

The increasing trend of studying the innate softness of robotic structures and amalgamating it with the benefits of the extensive developments in the field of embodied intelligence has led to sprouting of a relatively new yet extremely rewarding sphere of technology. The fusion of current deep reinforcement algorithms with physical advantages of a soft bio-inspired structure certainly directs us to a fruitful prospect of designing completely self-sufficient agents that are capable of learning from observations collected from their environment to achieve a task they have been assigned. For soft robotics structure possessing countless degrees of freedom, it is often not easy (something not even possible) to formulate mathematical constraints necessary for training a deep reinforcement learning (DRL) agent for the task in hand, hence, we resolve to imitation learning techniques due to ease of manually performing such tasks like manipulation that could be comfortably mimicked by our agent. Deploying current imitation learning algorithms on soft robotic systems have been observed to provide satisfactory results but there are still challenges in doing so. This review article thus posits an overview of various such algorithms along with instances of them being applied to real world scenarios and yielding state-of-the-art results followed by brief descriptions on various pristine branches of DRL research that may be centers of future research in this field of interest.