The relationship between coping styles and subjective well-being has recently received considerable empirical and theoretical attention in the scientific literature. However, the mechanisms underlying this relationship have primarily remained unclear. The present research aimed to determine whether emotion regulation mediated the relationship between coping styles and subjective well-being. Our hypothesis is based on the integration of theoretical models among 1,247 Chinese college students. The SWB questionnaire, Ways of Coping Questionnaire, and Emotion Regulation Questionnaire were used to correlate SWB, emotion regulation (...) strategies, and coping styles, respectively. The random forest method was applied to predict life satisfaction and estimate the average variable importance to life satisfaction. The results indicated that positive coping can indirectly influence life satisfaction via cognitive reappraisal and indirectly influence expression suppression via positive affect. Negative coping can indirectly influence negative affect via expression suppression. Besides, negative coping was positively associated with both expression suppression and negative affect. Cognitive reappraisal was found to be positively associated with positive affect. The findings indicated that coping style is essential for the SWB of college students. These findings provide insight into how coping styles impact SWB and have implications for developing and assessing emotion regulation-based interventions. (shrink)

Sudden, broad-scale shifts in public opinion about social problems are relatively rare. Until recently, social scientists were forced to conduct post-hoc case studies of such unusual events that ignore the broader universe of possible shifts in public opinion that do not materialize. The vast amount of data that has recently become available via social media sites such as Facebook and Twitter—as well as the mass-digitization of qualitative archives provide an unprecedented opportunity for scholars to avoid such selection on the dependent (...) variable. Yet the sheer scale of these new data creates a new set of methodological challenges. Conventional linear models, for example, minimize the influence of rare events as “outliers”—especially within analyses of large samples. While more advanced regression models exist to analyze outliers, they suffer from an even more daunting challenge: equifinality, or the likelihood that rare events may occur via different causal pathways. I discuss a variety of possible solutions to these problems—including recent advances in fuzzy set theory and machine learning—but ultimately advocate an ecumenical approach that combines multiple techniques in iterative fashion. (shrink)

PurposeThe purpose of this study was to introduce an orthogonal experimental design to improve the efficiency of building and optimizing models for freezing of gait prediction.MethodsA random forest model was developed to predict FOG by using acceleration signals and angular velocity signals to recognize possible precursor signs of FOG. An OED was introduced to optimize the feature extraction parameters.ResultsThe main effects and interaction among the feature extraction hyperparameters were analyzed. The false-positive rate, hit rate, and mean prediction time (...) were 27%, 68%, and 2.99 s, respectively.ConclusionThe OED was an effective method for analyzing the main effects and interactions among the feature extraction parameters. It was also beneficial for optimizing the feature extraction parameters of the FOG prediction model. (shrink)

In the automatic detection of epileptic seizures, the monitoring of critically ill patients with time varying EEG signals is an essential procedure in intensive care units. There is an increasing interest in using EEG analysis to detect seizure, and in this study we aim to get a better understanding of how to visualize the information in the EEG time-frequency feature, and design and train a novel random forest algorithm for EEG decoding, especially for multiple-levels of illness. Here, we (...) propose an automatic detection framework for epileptic seizure based on multiple time-frequency analysis approaches; it involves a novel random forest model combined with grid search optimization. The short-time Fourier transformation visualizes seizure features after normalization. The dimensionality of features is reduced through principal component analysis before feeding them into the classification model. The training parameters are optimized using grid search optimization to improve detection performance and diagnostic accuracy by in the recognition of three different levels epileptic of conditions (healthy subjects, seizure-free intervals, seizure activity). Our proposed model was used to classify 500 samples of raw EEG data, and multiple cross-validations were adopted to boost the modeling accuracy. Experimental results were evaluated by an accuracy, a confusion matrix, a receiver operating characteristic curve and an area under the curve. The evaluations indicated that our model achieved the more effective classification than some previous typical methods. Such a scheme for computer-assisted clinical diagnosis of seizures has a potential guiding significance, which not only relieves the suffering of patient with epilepsy to improve quality of life, but also helps neurologists reduce their workload. (shrink)

With the continuous development of the stock market, designing a reasonable risk identification tool will help to solve the irrational problem of investors. This paper first selects the stocks with the most valuable investment value in the future through the random forest algorithm in the nine-factor model and then analyzes them by using the higher-order moment model to find that different investors’ preferences will make the weight of the portfolio change accordingly, which will eventually make the optimal return (...) and risk set of the composition of the portfolio change. The risk identification system designed in this paper can provide an effective risk identification tool for investors and help them make rational judgments. (shrink)

The hybridization of two or more energy sources into a single power station is one of the widely discussed solutions to address the demand and supply havoc generated by renewable production, heating power, and cooling power) and its energy storage issues. Hybrid energy sources work based on the complementary existence of renewable sources. The combined cooling, heating, and power is one of the significant systems and shows a profit from its low environmental impact, high energy efficiency, low economic investment, and (...) sustainability in the industry. This paper presents an economic model of a microgrid system containing the CCHP system and energy storage considering the energy coupling and conversion characteristics, the effective characteristics of each microsource, and energy storage unit is proposed. The random forest regression model was optimized by the gravitational search algorithm. The test results show that the GSA-RFR model improves prediction accuracy and reduces the generalization error. The detail of the MG network and the energy storage architecture connected to the other renewable energy sources is discussed. The mathematical formulation of energy coupling and energy flow of the MG network including wind turbines, photovoltaic, CCHP system, fuel cell, and energy storage devices are presented. The testing system has been analysed under load peak cutting and valley filling of energy utilization index, energy utilization rate, the heat pump, the natural gas consumption of the microgas turbine, and the energy storage unit. The energy efficiency costs were observed as 88.2% and 86.9% with heat pump and energy storage operation comparing with GSA-RFR-based operation costs as 93.2% and 93% in summer and winter season, respectively. The simulation results extended the rationality and economy of the proposed model. (shrink)

The most predominant kind of disease that is normal among ladies is breast cancer. It is one of the significant reasons among ladies, regardless of huge endeavors to stay away from it through screening developers. An automatic detection system for disease helps doctors to identify and provide accurate results, thereby minimizing the death rate. Computer-aided diagnosis has minimum intervention of humans and produces more accurate results than humans. It will be a difficult and long task that depends on the expertise (...) of pathologists. Deep learning methods proved to give better outcomes when correlated with ML and extricate the best highlights of the images. The main objective of this paper is to propose a deep learning technique in combination with a convolution neural network and long short-term memory with a random forest algorithm to diagnose breast cancer. Here, CNN is used for feature extraction, and LSTM is used for extracted feature detection. The experimental results show that the proposed system accomplishes 100% of accuracy, a sensitivity of 99%, recall of 99%, and an F1-score of 98% compared to other traditional models. As the system achieved correct results, it can help doctors to investigate breast cancer easily. (shrink)

With the rapid development of Internet of Things technology, RFID technology has been widely used in various fields. In order to optimize the RFID system hardware deployment strategy and improve the deployment efficiency, the prediction of the RFID system identification rate has become a new challenge. In this paper, a neighborhood rough set and random forest combination model is proposed to predict the identification rate of an RFID system. Firstly, the initial influencing factors of the RFID system identification (...) rate are reduced using neighborhood rough set theory combined with the principle of heuristic attribute reduction of neighborhood weighted dependency, thus obtaining a kernel factor subset. Secondly, a random forest prediction model is established based on the kernel factor subset, and a confusion matrix is established using out-of-bag data to evaluate the prediction results. The test is conducted under the constructed RFID experimental environment, whose results showed that the model can predict the identification rate of the RFID system in a fast and efficient way, and the classification accuracy can reach 90.5%. It can effectively guide the hardware deployment and communication parameter protocol setting of the system and improve the system performance. Compared with BP neural network and other prediction models, NRS-RF has shorter prediction time and faster calculation speed. Finally, the validity of the proposed model was verified by the RFID intelligent archives management platform. (shrink)

The multimedia technology and computer technology supported by the development of modern science and technology provide an important platform for the development of college physical education teaching activities. To better play the role of network auxiliary teaching platform in college sports teaching and improve the effectiveness of college sports teaching, the construction method of multimedia auxiliary teaching effect evaluation model based on the random number forest algorithm is proposed. Through the specification of the random forest algorithm (...) and the optimization of the teaching quality evaluation index, the auxiliary teaching level of the college physical education network is analyzed, and the evaluation of the multimedia auxiliary teaching effect of the physical education courses is completed. The experimental results verify the effectiveness of the evaluation model designed in this article, with a user satisfaction of 72%. Teachers and students can use the evaluation model to improve the teaching quality and teaching efficiency, improve the management work, and promote the scientific, standardization, and specialization of physical education teaching management in colleges and universities. (shrink)

Grounded in self-determination theory and the dualistic model of passion, the present study tested whether a social media intervention could promote harmonious passion and positive emotions related to exercise activities. A four-week intervention managed through an Instagram account was designed to promote more harmonious passion and less obsessive passion, as well as more positive emotions and less negative emotions related to participants’ favourite exercise activities. A web-based questionnaire was distributed to 518 young adults (mean age 26.5) before and after the (...) intervention. Participants were randomly assigned to an intervention group (N = 226) or control group (N = 292). The intervention did not predict change in passion for the activity. However, the intervention predicted more positive emotional outcomes from the activity, statistically controlled for emotions reported at baseline and negative emotions reported at follow-up. Results indicate that digital platforms may be relevant in promoting more physical activity in the population, through the facilitation of more positive emotions related to exercise. (shrink)

Recent studies have indicated that it is possible to protect individuals from HIV infection using passive infusion of monoclonal antibodies. However, in order for monoclonal antibodies to confer robust protection, the antibodies must be capable of neutralizing many possible strains of the virus. This is particularly challenging in the context of a highly diverse pathogen like HIV. It is therefore of great interest to leverage existing observational data sources to discover antibodies that are able to neutralize HIV viruses via residues (...) where existing antibodies show modest protection. Such information feeds directly into the clinical trial pipeline for monoclonal antibody therapies by providing information on whether and to what extent combinations of antibodies can generate superior protection and strategies for analyzing past clinical trials to identify in vivo evidence of antibody resistance. These observational data include genetic features of many diverse HIV genetic sequences, as well as in vitro measures of antibody resistance. The statistical learning problem we are interested in is developing statistical methodology that can be used to analyze these data to identify important genetic features that are significantly associated with antibody resistance. This is a challenging problem owing to the high-dimensional and strongly correlated nature of the genetic sequence data. To overcome these challenges, we propose an outcome-adaptive, collaborative targeted minimum loss-based estimation approach using random forests. We demonstrate via simulation that the approach enjoys important statistical benefits over existing approaches in terms of bias, mean squared error, and type I error. We apply the approach to the Compile, Analyze, and Tally Nab Panels database to identify AA positions that are potentially causally related to resistance to neutralization by several different antibodies. (shrink)

Colour has been shown to facilitate the recognition of scene images, but only when these images contain natural scenes, for which colour is ‘diagnostic’. Here we investigate whether colour can also facilitate memory for scene images, and whether this would hold for natural scenes in particular. In the first experiment participants first studied a set of colour and greyscale natural and man-made scene images. Next, the same images were presented, randomly mixed with a different set. Participants were asked to indicate (...) whether they had seen the images during the study phase. Surprisingly, performance was better for greyscale than for coloured images, and this difference is due to the higher false alarm rate for both natural and man-made coloured scenes. We hypothesized that this increase in false alarm rate was due to a shift from scrutinizing details of the image to recognition of the gist of the image. A second experiment, utilizing images without a nameable gist, confirmed this hypothesis as participants now performed equally on greyscale and coloured images. In the final experiment we specifically targeted the more detail-based perception and recognition for greyscale images versus the more gist-based perception and recognition for coloured images with a change detection paradigm. The results show that changes to images are detected faster when image-pairs were presented in greyscale than in colour. This counterintuitive result held for both natural and man-made scenes and thus corroborates the shift from more detailed processing of images in greyscale to more gist-based processing of coloured images. (shrink)

Colour has been shown to facilitate the recognition of scene images, but only when these images contain natural scenes, for which colour is ‘diagnostic’. Here we investigate whether colour can also facilitate memory for scene images, and whether this would hold for natural scenes in particular. In the first experiment participants first studied a set of colour and greyscale natural and man-made scene images. Next, the same images were presented, randomly mixed with a different set. Participants were asked to indicate (...) whether they had seen the images during the study phase. Surprisingly, performance was better for greyscale than for coloured images, and this difference is due to the higher false alarm rate for both natural and man-made coloured scenes. We hypothesized that this increase in false alarm rate was due to a shift from scrutinizing details of the image to recognition of the gist of the image. A second experiment, utilizing images without a nameable gist, confirmed this hypothesis as participants now performed equally on greyscale and coloured images. In the final experiment we specifically targeted the more detail-based perception and recognition for greyscale images versus the more gist-based perception and recognition for coloured images with a change detection paradigm. The results show that changes to images are detected faster when image-pairs were presented in greyscale than in colour. This counterintuitive result held for both natural and man-made scenes and thus corroborates the shift from more detailed processing of images in greyscale to more gist-based processing of coloured images. (shrink)

This study investigates the extent to which there is individuality in how structural variation is conditioned over time. Earlier research already classified the diachronically unstable gerund variation as involving a high fraction of mixed-usage speakers throughout the change, whereby the proportion of the conservative variant versus the progressive variant as observable in the linguistic output of individual language users superficially resembles the mean proportion as observable at the population level. However, this study sets out to show that there can still (...) be heterogeneity within such a centralized population in terms of how each individual conditions the observed variation. A random forest and conditional inference tree analysis of over 14,000 gerunds uttered by nineteen seventeenth-century authors is presented to show that, while the most important language-internal factors conditioning the gerund variation are adopted by (and shared between) all authors, we can still attest inter-individual variation (i) at lower levels of variable importance, and (ii) in the breadth of the range of contexts individual authors employ to condition the attested variation. (shrink)

Neuromarketing has gained attention to bridge the gap between conventional marketing studies and electroencephalography -based brain-computer interface research. It determines what customers actually want through preference prediction. The performance of EEG-based preference detection systems depends on a suitable selection of feature extraction techniques and machine learning algorithms. In this study, We examined preference detection of neuromarketing dataset using different feature combinations of EEG indices and different algorithms for feature extraction and classification. For EEG feature extraction, we employed discrete wavelet transform (...) and power spectral density, which were utilized to measure the EEG-based preference indices that enhance the accuracy of preference detection. Moreover, we compared deep learning with other traditional classifiers, such as k-nearest neighbor, support vector machine, and random forest. We also studied the effect of preference indicators on the performance of classification algorithms. Through rigorous offline analysis, we investigated the computational intelligence for preference detection and classification. The performance of the proposed deep neural network outperforms KNN and SVM in accuracy, precision, and recall; however, RF achieved results similar to those of the DNN for the same dataset. (shrink)

The knowledge extraction from data with noise or outliers is a complex problem in the data mining area. Normally, it is not easy to eliminate those problematic instances. To obtain information from this type of data, robust classifiers are the best option to use. One of them is the application of bagging scheme on weak single classifiers. The Credal C4.5 model is a new classification tree procedure based on the classical C4.5 algorithm and imprecise probabilities. It represents a type of (...) the so-calledcredal trees. It has been proven that CC4.5 is more robust to noise than C4.5 method and even than other previous credal tree models. In this paper, the performance of the CC4.5 model in bagging schemes on noisy domains is shown. An experimental study on data sets with added noise is carried out in order to compare results where bagging schemes are applied on credal trees and C4.5 procedure. As a benchmark point, the known Random Forest classification method is also used. It will be shown that the bagging ensemble using pruned credal trees outperforms the successful bagging C4.5 and RF when data sets with medium-to-high noise level are classified. (shrink)

Emotion judgments and five channels of physiological data were obtained from 60 participants listening to 60 music excerpts. Various machine learning (ML) methods were used to model the emotion judgments inclusive of neural networks, linear regression, and random forests. Input for models of perceived emotion consisted of audio features extracted from the music recordings. Input for models of felt emotion consisted of physiological features extracted from the physiological recordings. Models were trained and interpreted with consideration of the classic debate (...) in music emotion between cognitivists and emotivists. Our models supported a hybrid position wherein emotion judgments were influenced by a combination of perceived and felt emotions. In comparing the different ML approaches that were used for modeling, we conclude that neural networks were optimal, yielding models that were flexible as well as interpretable. Inspection of a committee machine, encompassing an ensemble of networks, revealed that arousal judgments were predominantly influenced by felt emotion, whereas valence judgments were predominantly influenced by perceived emotion. (shrink)

Neurodegenerative Parkinson's Disease (PD) is one of the common incurable diseases among the elderly. Clinical assessments are characterized as standardized means for PD diagnosis. However, relying on medical evaluation of a patient's status can be subjective to physicians' experience, making the assessment process susceptible to human errors. The use of ICT-based tools for capturing the status of patients with PD can provide more objective and quantitative metrics. In this vein, the Personalized Serious Game Suite (PGS) and intelligent Motor Assessment Tests (...) (iMAT), produced within the i-PROGNOSIS European project (www.i-prognosis.eu), are explored in the current study. More specifically, data from 27 patients with PD at Stage 1 (9) and Stage 3 (18) produced from their interaction with PGS/iMAT are analyzed. Five feature vector (FV) scenarios are set, including features from PGS or iMAT scores or their combination, after also taking into consideration the age of patients with PD. These FVs are fed into three machine learning classifiers, i.e., K-Nearest Neighbor (KNN), Support Vector Machines (SVM), and Random Forest (RF), to infer the stage of each patient with PD. A Leave-One-Out Cross-Validation (LOOCV) method is adopted for testing the classification performance. The experimental results show that a high (>90%) classification accuracy is achieved from both data sources (PGS/iMAT), justifying the effectiveness of PGS/iMAT to efficiently reflect the motor skill status of patients with PD and further potentiating PGS/iMAT enhancement with a machine learning a part to infer for the stage of patients with PD. Clearly, this integrated approach provides new opportunities for remote monitoring of the stage of patients with PD, contributing to a more efficient organization and set up of personalized interventions. (shrink)

Machine stability and energy efficiency have become major issues in the manufacturing industry, primarily during the COVID-19 pandemic where fluctuations in supply and demand were common. As a result, Predictive Maintenance (PdM) has become more desirable, since predicting failures ahead of time allows to avoid downtime and improves stability and energy efficiency in machines. One type of machine failure stands out due to its impact, machine overstrain, which can occur when machines are used beyond their tolerable limit. From the current (...) literature, there are little to no relevant works that focus on machine overstrain failure detection or prediction. Accordingly, the purpose of this paper is to implement and compare four Machine Learning (ML) algorithms for PdM applied to machine overstrain failures: Artificial Neural Network (ANN), Gradient Boosting, Random Forest and Support Vector Machine (SVM). Moreover, it proposes a training methodology for imbalanced data and the automatic optimization of hyperparameters, which aims to improve performance in the ML models. To evaluate the performance of the ML models, a synthetic dataset that simulates industrial machine data is used. The obtained results show the robustness of the proposed methodology, with the ANN and SVM models achieving a perfect recall score, with 98.95% and 98.85% in accuracy, respectively. (shrink)

Malware is a sophisticated, malicious, and sometimes unidentifiable application on the network. The classifying network traffic method using machine learning shows to perform well in detecting malware. In the literature, it is reported that this good performance can depend on a reduced set of network features. This study presents an empirical evaluation of two statistical methods of reduction and selection of features in an Android network traffic dataset using six supervised algorithms: Naïve Bayes, support vector machine, multilayer perceptron neural network, (...) decision tree, random forest, and K-nearest neighbors. The principal component analysis and logistic regression methods with p value were applied to select the most representative features related to the time properties of flows and features of bidirectional packets. The selected features were used to train the algorithms using binary and multiclass classification. For performance evaluation and comparison metrics, precision, recall, F-measure, accuracy, and area under the curve were used. The empirical results show that random forest obtains an average accuracy of 96% and an AUC-ROC of 0.98 in binary classification. For the case of multiclass classification, again random forest achieves an average accuracy of 87% and an AUC-ROC over 95%, exhibiting better performance than the other machine learning algorithms. In both experiments, the 13 most representative features of a mixed set of flow time properties and bidirectional network packets selected by LR were used. In the case of the other five classifiers, their results in terms of precision, recall, and accuracy, are competitive with those obtained in related works, which used a greater number of input features. Therefore, it is empirically evidenced that the proposed method for the selection of features, based on statistical techniques of reduction and extraction of attributes, allows improving the identification performance of malware traffic, discriminating it from the benign traffic of Android applications. (shrink)

This study focuses on a traditional business ethics question and aims to use advanced techniques to improve the performance of corporate fraud prediction. Based on the GONE framework, we adopt the machine learning model to predict the occurrence of corporate fraud in China. We first identify a comprehensive set of fraud-related variables and organize them into each category (i.e., Greed, Opportunity, Need, and Exposure) of the GONE framework. Among the six machine learning models tested, the Random Forest (RF) (...) model outperforms the other five models in corporate fraud prediction. Based on the RF model, we show that Exposure variables play a more important role in predicting corporate fraud than other input variables. These results highlight the importance of Exposure variables in corporate fraud prediction and promote the practical use of the machine learning model in solving business ethics questions. (shrink)

Crop cultivation is one of the oldest activities of civilization. For a long time, crop production was carried out based on knowledge passed from generation to generation. However, due to the rapid growth in the human population of the world, human knowledge-based cultivation is not enough to meet the demanding need. To address this issue, the usage of machine learning-based tools has been studied in this paper. An experiment has been carried out over 0.3 million data. This dataset identifies 46 (...) prominent parameters for cultivation, which is collected from the Department of Agriculture Extension, Bangladesh. Comparison between neural networks and numbers of machine learning algorithms has been carried out in this research. It is observed that the neural network outperforms the other methods by maintaining an average prediction accuracy of 96.06% for six different crops. Other contemporary machine learning algorithms, namely, support vector machine, random forest, and logistic regression, have average prediction accuracy of around 68.9%, 91.2%, and 62.39%, respectively. (shrink)

Construction cost estimation is one of the essential processes in construction management. Project cost is a complex engineering problem due to various factors affecting the construction industry. Accurate cost estimation is important in construction management and significantly impacts project performance. Artificial intelligence models have been effectively implemented in construction management studies in recent years owing to their capability to deal with complex problems. In this research, extreme gradient boosting is developed as an advanced input selector algorithm and coupled with three (...) AI models, including random forest, artificial neural network, and support vector machine for cost estimation. Datasets were gathered based on a survey conducted on 90 building projects in Iraq. Statistical indicators and graphical methods were used to evaluate the developed models. Several input predictors were used, and XGBoost highlighted inflation as the most crucial parameter. The results indicated that the best prediction was attained by XGBoost-RF using six input parameters, with r-squared and the mean absolute percentage error equal to 0.87 and 0.25, respectively. The comparison results revealed that all AI models showed good prediction performance when applied to datasets affected by more than two parameters. The outcomes of this research revealed an optimistic strategy that can help decision makers select the influencing parameters in the early phases of project management. Also, developing a prediction model with high precision results can assist the project’s estimators in decreasing the errors in the cost estimation process. (shrink)

An efficient intelligent fault diagnosis model was proposed in this paper to timely and accurately offer a dependable basis for identifying the rolling bearing condition in the actual production application. The model is mainly based on an improved butterfly optimizer algorithm- optimized kernel extreme learning machine model. Firstly, the roller bearing’s vibration signals in the four states that contain normal state, outer race failure, inner race failure, and rolling ball failure are decomposed into several intrinsic mode functions using the complete (...) ensemble empirical mode decomposition based on adaptive noise. Then, the amplitude energy entropies of IMFs are designated as the features of the rolling bearing. In order to eliminate redundant features, a random forest was used to receive the contributions of features to the accuracy of results, and subsets of features were set up by removing one feature in the descending order, using the classification accuracy of the SBOA-KELM model as the criterion to obtain the optimal feature subset. The salp swarm algorithm was introduced to BOA to improve optimization ability, obtain optimal KELM parameters, and avoid the BOA deteriorating into local optimization. Finally, an optimal SBOA-KELM model was constructed for the identification of rolling bearings. In the experiment, SBOA was validated against ten other competitive optimization algorithms on 30 IEEE CEC2017 benchmark functions. The experimental results validated that the SBOA was evident over existing algorithms for most function problems. SBOA-KELM employed for diagnosing the fault diagnosis of rolling bearings obtained improved classification performance and higher stability. Therefore, the proposed SBOA-KELM model can be effectively used to diagnose faults of rolling bearings. (shrink)

The application of machine learning algorithms to healthcare data can enhance patient care while also reducing healthcare worker cognitive load. These algorithms can be used to detect anomalous physiological readings, potentially leading to expedited emergency response or new knowledge about the development of a health condition. However, while there has been much research conducted in assessing the performance of anomaly detection algorithms on well-known public datasets, there is less conceptual comparison across unsupervised and supervised performance on physiological data. Moreover, while (...) heart rate data are both ubiquitous and noninvasive, there has been little research specifically for anomaly detection of this type of data. Considering that heart rate data are indicative of both potential health complications and an individual’s physical activity, this is a rich source of largely overlooked data. To this end, we employed and evaluated five machine learning algorithms, two of which are unsupervised and the remaining three supervised, in their ability to detect anomalies in heart rate data. These algorithms were then evaluated on real heart rate data. Findings supported the effectiveness of local outlier factor and random forests algorithms in the task of heart rate anomaly detection, as each model generalized well from their training on simulated heart rate data to real world heart rate data. Furthermore, results support that simulated data can help configure algorithms to a degree of performance when real labeled data are not available and that this type of learning might be especially helpful in initial deployment of a system without prior data. (shrink)

Electroencephalogram has been widely utilized in emotion recognition. Psychologists have found that emotions can be divided into conscious emotion and unconscious emotion. In this article, we explore to classify subliminal emotions with EEG signals elicited by subliminal face stimulation, that is to select appropriate features to classify subliminal emotions. First, multi-scale sample entropy, wavelet packet energy, and wavelet packet entropy of EEG signals are extracted. Then, these features are fed into the decision tree and improved random forest, respectively. (...) The classification accuracy with Ei and WpEn is higher than MSpEn, which shows that Ei and WpEn can be used as effective features to classify subliminal emotions. We compared the classification results of different features combined with the decision tree algorithm and the improved random forest algorithm. The experimental results indicate that the improved random forest algorithm attains the best classification accuracy for subliminal emotions. Finally, subliminal emotions and physiological proof of subliminal affective priming effect are discussed. (shrink)

In recent years, the work of organizations in the area of digitization has intensified significantly. This trend is also evident in the field of recruitment where job application tracking systems (ATS) have been developed to allow job advertisements to be published online. However, recent studies have shown that recruiting in most organizations is not inclusive, being subject to human biases and prejudices. Most discrimination activities appear early but subtly in the hiring process, for instance, exclusive phrasing in job advertisement discourages (...) qualified applicants from minority groups from applying. The existing works are limited to analyzing, categorizing and highlighting the occurrence of bias in the recruitment process. In this paper, we go beyond this and develop machine learning models for identifying and classifying biased and discriminatory language in job descriptions. We develop and evaluate a machine learning system for identifying five major categories of biased and discriminatory language in job advertisements, i.e., masculine-coded, feminine-coded, exclusive, LGBTQ-coded, demographic and racial language. We utilized the combination of linguistic features with recent state-of-the-art word embeddings representations as input features for various machine learning classifiers. Our results show that the machine learning classifiers were able to identify all the five categories of biased and discriminatory language with a decent accuracy. The Random Forest classifier with FastText word embeddings achieved the best performance with tenfolds cross-validation. Our system directly addresses the bias in the attraction phase of hiring by identifying and classifying biased and discriminatory language and thus encouraging recruiters to write more inclusive job advertisements. (shrink)

The stability of the power grid is concernment due to the high demand and supply to smart cities, homes, factories, and so on. Different machine learning and deep learning models can be used to tackle the problem of stability prediction for the energy grid. This study elaborates on the necessity of IoT technology to make energy grid networks smart. Different prediction models, namely, logistic regression, naïve Bayes, decision tree, support vector machine, random forest, XGBoost, k-nearest neighbor, and optimized (...) artificial neural network, have been applied on openly available smart energy grid datasets to predict their stability. The present article uses metrics such as accuracy, precision, recall, f1-score, and ROC curve to compare different predictive models. Data augmentation and feature scaling have been applied to the dataset to get better results. The augmented dataset provides better results as compared with the normal dataset. This study concludes that the deep learning predictive model ANN optimized with Adam optimizer provides better results than other predictive models. The ANN model provides 97.27% accuracy, 96.79% precision, 95.67% recall, and 96.22% F1 score. (shrink)

Recommending the identity of bidders in public procurement auctions has a significant impact in many areas of public procurement, but it has not yet been studied in depth. A bidders recommender would be a very beneficial tool because a supplier can search appropriate tenders and, vice versa, a public procurement agency can discover automatically unknown companies which are suitable for its tender. This paper develops a pioneering algorithm to recommend potential bidders using a machine learning method, particularly a random (...) forest classifier. The bidders recommender is described theoretically, so it can be implemented or adapted to any particular situation. It has been successfully validated with a case study: an actual Spanish tender dataset which has 102,087 tenders from 2014 to 2020 and a company dataset which has 1,353,213 Spanish companies. Quantitative, graphical, and statistical descriptions of both datasets are presented. The results of the case study were satisfactory: the winning bidding company is within the recommended companies group, from 24% to 38% of the tenders, according to different test conditions and scenarios. (shrink)

The objective of this study was to jointly analyze the importance of cognitive and financial factors in the accuracy of profit forecasting by analysts. Data from publicly traded Brazilian companies in 2019 were obtained. We used text analysis to assess the cognitive biases from the qualitative reports of analysts. Further, we analyzed the data using statistical regression learning methods and statistical classification learning methods, such as Multiple Linear Regression, k-dependence Bayesian, and Random Forest. The Bayesian inference and classification (...) methods allow an expansion of the research line, especially in the area of machine learning, which can benefit from the examples of factors addressed in this research. The results indicated that, among cognitive biases, optimism had a negative relationship with forecasting accuracy while anchoring bias had a positive relationship. Commonality, to a lesser extent, also had a positive relationship with the analyst’s accuracy. Among financial factors, the most important aspects in the accuracy of analysts were volatility, indebtedness, and profitability. Age of the company, fair value, American Depositary Receipts, performance, and loss were still important but on a smaller scale. The results of the RF models showed a greater explanatory power. This research sheds light on the cognitive as well as financial aspects that influence the analyst’s accuracy, jointly using text analysis and machine learning methods, capable of improving the explanatory power of predictive models, together with the use of training models followed by testing. (shrink)

With the rapid development of Internet technology and the reform of the education model, online education has been widely recognized and applied. In the process of online learning, various types of browsing behavior characteristic data such as learning engagement and attitude will be generated. These learning behaviors are closely related to academic performance. In-depth exploration of the laws contained in the data can provide teaching assistance for education administrators. In this paper, the random forest algorithm is used to (...) determine the importance of factors for the relationship between 11 learning behavior data and students' psychological quality test data, a total of 12-dimensional feature data and grades, and extracts six factors that have a greater impact on grades. Through the research of this paper, the method of random forest is innovatively used, and it is found that the psychological factor is one of the six important factors. This paper innovatively uses BP neural network as the prediction model, takes six important factors as input, and establishes a complete method of online learning performance prediction. The research in this paper can help teachers monitor students' learning status, detect abnormal learning behaviors and problems in time, and make timely and effective teaching interventions and adjustments in advance according to the abnormal status of students found. (shrink)

Twitter is a virtual social network where people share their posts and opinions about the current situation, such as the coronavirus pandemic. It is considered the most significant streaming data source for machine learning research in terms of analysis, prediction, knowledge extraction, and opinions. Sentiment analysis is a text analysis method that has gained further significance due to social networks’ emergence. Therefore, this paper introduces a real-time system for sentiment prediction on Twitter streaming data for tweets about the coronavirus pandemic. (...) The proposed system aims to find the optimal machine learning model that obtains the best performance for coronavirus sentiment analysis prediction and then uses it in real-time. The proposed system has been developed into two components: developing an offline sentiment analysis and modeling an online prediction pipeline. The system has two components: the offline and the online components. For the offline component of the system, the historical tweets’ dataset was collected in duration 23/01/2020 and 01/06/2020 and filtered by #COVID-19 and #Coronavirus hashtags. Two feature extraction methods of textual data analysis were used, n-gram and TF-ID, to extract the dataset’s essential features, collected using coronavirus hashtags. Then, five regular machine learning algorithms were performed and compared: decision tree, logistic regression, k-nearest neighbors, random forest, and support vector machine to select the best model for the online prediction component. The online prediction pipeline was developed using Twitter Streaming API, Apache Kafka, and Apache Spark. The experimental results indicate that the RF model using the unigram feature extraction method has achieved the best performance, and it is used for sentiment prediction on Twitter streaming data for coronavirus. (shrink)

Data mining, as an essential part of artificial intelligence, is a powerful digital technology, which makes businesses predict future trends and alleviate the process of decision-making and enhancing customer experience along their digital transformation journey. This research provides a practical implication – a case study - to provide guidance on analyzing information and predicting repairs in home appliances after sales services business. The main benefit of this practical comparative study of various classification algorithms, by using the Weka tool, is the (...) analysis of information and the prediction of repairs in the home appliances after sales services business. The comparison of algorithms is performed considering different parameters, such as the mean absolute error, root mean square error, relative absolute error and root relative squared error, receiver operating characteristic area, accuracy, Matthews’s correlation coefficient, precision-recall curve, precision, F-measure, recall and statistical criteria. Five classification algorithms such as the Naive Bayes, J48, random forest, K-Nearest Neighbor, and logistic regression were implemented in the dataset. J48 has proved to provide the best accuracy and the lowest error among the other examined algorithms applied to a home appliances after sales services dataset to predict repairs based on product guarantee period. The extracted information and results of an after sales services business by using data mining techniques prove to alleviate the process of streamlining decision-making and provide reliable predictions, especially for the customers, as well as increase businesses’ efficiency along their digital transformation journey. (shrink)

Twitter integrates with streaming data technologies and machine learning to add new value to healthcare. This paper presented a real-time system to predict breast cancer based on streaming patient’s health data from Twitter. The proposed system consists of two major components: developing an offline building model and an online prediction pipeline. For the first component, we made a correlation between the features to determine the correlation between features and reduce the number of features from the Breast Cancer Wisconsin Diagnostic dataset. (...) Two feature selection algorithms are recursive feature elimination and univariate feature selection algorithms which are applied to features after correlation to select the essential features. Four decision trees, logistic regression, support vector machine, and random forest classifier have been used on features after correlation and feature selection. Also, hyperparameter tuning and cross-validation have been applied with machine learning to optimize models and enhance accuracy. Apache Spark, Apache Kafka, and Twitter Streaming API are used to develop the second component. The best model with the highest accuracy obtained from the first component predicts breast cancer in real time from tweets’ streaming. The results showed that the best model is the random forest classifier which achieved the best accuracy. (shrink)

The use of ensemble learning, deep learning, and effective document representation methods is currently some of the most common trends to improve the overall accuracy of a text classification/categorization system. Ensemble learning is an approach to raise the overall accuracy of a classification system by utilizing multiple classifiers. Deep learning-based methods provide better results in many applications when compared with the other conventional machine learning algorithms. Word embeddings enable representation of words learned from a corpus as vectors that provide a (...) mapping of words with similar meaning to have similar representation. In this study, we use different document representations with the benefit of word embeddings and an ensemble of base classifiers for text classification. The ensemble of base classifiers includes traditional machine learning algorithms such as naïve Bayes, support vector machine, and random forest and a deep learning-based conventional network classifier. We analysed the classification accuracy of different document representations by employing an ensemble of classifiers on eight different datasets. Experimental results demonstrate that the usage of heterogeneous ensembles together with deep learning methods and word embeddings enhances the classification performance of texts. (shrink)

In recent years, social networks have made significant progress and the number of people who use them to communicate is increasing day by day. The vast amount of information available on social networks has led to the importance of using friend recommender systems to discover knowledge about future communications. It is challenging to choose the best machine learning approach to address the recommender system issue since there are several strategies with various benefits and drawbacks. In light of this, a solution (...) based on the stacking approach was put out in this study to provide a buddy recommendation system in social networks. Additionally, a decrease in system performance was caused by the large amount of information that was accessible and the inefficiency of some functions. To solve this problem, a particle swarm optimization algorithm to select the most efficient features was used in our proposed method. To learn the model in the objective function of the particle swarm algorithm, a hybrid system based on stacking is proposed. In this method, two random forests and Extreme Gradient Boosting had been used as the base classifiers. The results obtained from these base classifiers were used in the logistic regression algorithm, which has been applied sequentially. The suggested approach was able to effectively address this issue by combining the advantages of the applied strategies. The results of implementation and evaluation of the proposed system show the appropriate efficiency of this method compared with other studied techniques. (shrink)

This paper brings together cutting-edge, quantitative corpus methodologies and discourse analysis to explore the relationship between text complexity and subjectivity as descriptive features of opinionated language. We are specifically interested in how text complexity and markers of subjectivity and argumentation interact in opinionated discourse. Our contributions include the marriage of quantitative approaches to text complexity with corpus linguistic methods for the study of subjectivity, in addition to large-scale analyses of evaluative discourse. As our corpus, we use the Simon Fraser Opinion (...) and Comments Corpus, which comprises approximately 10,000 opinion articles and the corresponding reader comments from the Canadian online newspaper The Globe and Mail, as well as a parallel corpus of hard news articles also sampled from The Globe and Mail. Methodologically, we combine conditional inference trees with the analysis of random forests, an ensemble learning technique, to investigate the interplay between text complexity and subjectivity. Text complexity is defined in terms of Kolmogorov complexity, that is, the complexity of a text is measured based on its description length. In this approach, texts which can be described more efficiently are considered to be linguistically less complex. Thus, Kolmogorov complexity is a measure of structural surface redundancy. Our take on subjectivity is inspired by research in evaluative language, stance and Appraisal and defined as the expression of evaluation and opinion in language. Drawing on a sentiment analysis lexicon and the literature on stance markers, a custom set of subjectivity and argumentation markers is created. The results show that complexity can be a powerful tool in the classification of text into different text types, and that stance adverbials serve as distinctive features of subjectivity in online news comments. (shrink)

One of the important measures of quality of education is the performance of students in academic settings. Nowadays, abundant data is stored in educational institutions about students which can help to discover insight on how students are learning and to improve their performance ahead of time using data mining techniques. In this paper, we developed a student performance prediction model that predicts the performance of high school students for the next semester for five courses. We modeled our prediction system as (...) a multi-label classification task and used support vector machine (SVM), Random Forest (RF), K-nearest Neighbors (KNN), and Multi-layer perceptron (MLP) as base-classifiers to train our model. We further improved the performance of the prediction model using a state-of-the-art partitioning scheme to divide the label space into smaller spaces and used Label Powerset (LP) transformation method to transform each labelset into a multi-class classification task. The proposed model achieved better performance in terms of different evaluation metrics when compared to other multi-label learning tasks such as binary relevance and classifier chains. (shrink)

Seasonal outbreaks have several different periods that occur primarily during winter in temperate regions, while influenza may occur throughout the year in tropical regions, triggering outbreaks more irregularly. Similarly, dengue occurs in the star of the rainy season in early May and reaches its peak in late June. Dengue and flu brought an impact on various countries in the years 2017–2019 and streaming Twitter data reveals the status of dengue and flu outbreaks in the most affected regions. This research work (...) presents that Social Media Analysis can be used as a detector of the epidemic outbreak and to understand the sentiment of social media users regarding various diseases. Providing awareness about seasonal outbreaks through SMA is an effective approach for researchers and healthcare responders to detect the early outbreaks. The proposed model aims to find the sentiment about the disease in tweets, and the seasonal outbreaks-related tweets are classified into two classes as disease positive and disease negative. This work proposes a machine-learning-based approach to detect dengue and flu outbreaks in social media platform Twitter, using four machine learning algorithms: Random Forest, K-Nearest Neighbor, Support Vector Machine, and Decision Tree, with the help of Term Frequency and Inverse Document Frequency. For experimental analysis, two datasets are analyzed individually. The experimental results show that the RF classifier has outperformed the comparison models in terms of improved accuracy, precision, recall, F1-measure, and Receiver Operating Characteristic curve. The proposed work offers favorable performance with total precision, accuracy, recall, and F1-measure ranging from 84% to 88% for conventional machine learning techniques. (shrink)

Amblyopia, or lazy eye, is a neurological vision disorder that studies have shown to affect two to five percent of the population. Current methods of treatment produce the best visual outcome, if the condition is identified early in the patient's life. Several early screening procedures are aimed at finding the condition while the patient is a child, including an automated vision screening system. This paper aims to use artificial intelligence techniques to automatically identify children who are at risk for developing (...) the amblyopic condition and should therefore be referred to a specialist, i.e., pediatric ophthalmologist. Three techniques, namely, decision tree learning, random forest, and artificial neural network, are studied in this paper in terms of their effectiveness, using metrics of sensitivity, specificity, and accuracy. The features used by the techniques are extracted from images of patient eyes and are based on the color information. The efficacy of pixel color data is investigated with respect to the measurement of the rate of change of the color in the iris and pupil, i.e., color slope features. A 10-fold stratified cross validation procedure is used to compare the effectiveness of the three AI techniques in this medical application domain. (shrink)

Ataxia is a kind of external characteristics when the human body has poor coordination and balance disorder, it often indicates diseases in certain parts of the body. Many internal factors may causing ataxia; currently, observed external characteristics, combined with Doctor’s personal clinical experience play main roles in diagnosing ataxia. In this situation, different kinds of diseases may be confused, leading to the delay in treatment and recovery. Modern high precision medical instruments would provide better accuracy but the economic cost is (...) a non-negligible factor. In this paper, novel non-contact sensing technique is used to detect and distinguish sensory ataxia and cerebellar ataxia. Firstly, Romberg’s test and gait analysis data are collected by the microwave sensing platform; then, after some preprocessing, some machine learning approaches have been applied to train the models. For Romberg’s test, time domain features are considered, the accuracy of all the three algorithms are higher than 96%; for gait detection, Principal Component Analysis is used for dimensionality reduction, and the accuracies of Back Propagation neural Network, Support Vector Machine, and Random Forest are 97.8, 98.9, and 91.1%, respectively. (shrink)

Software defects prediction at the initial period of the software development life cycle remains a critical and important assignment. Defect prediction and correctness leads to the assurance of the quality of software systems and has remained integral to study in the previous years. The quick forecast of imperfect or defective modules in software development can serve the development squad to use the existing assets competently and effectively to provide remarkable software products in a given short timeline. Hitherto, several researchers have (...) industrialized defect prediction models by utilizing statistical and machine learning techniques that are operative and effective approaches to pinpoint the defective modules. Tree family machine learning techniques are well-thought-out to be one of the finest and ordinarily used supervised learning methods. In this study, different tree family machine learning techniques are employed for software defect prediction using ten benchmark datasets. These techniques include Credal Decision Tree, Cost-Sensitive Decision Forest, Decision Stump, Forest by Penalizing Attributes, Hoeffding Tree, Decision Tree, Logistic Model Tree, Random Forest, Random Tree, and REP-Tree. Performance of each technique is evaluated using different measures, i.e., mean absolute error, relative absolute error, root mean squared error, root relative squared error, specificity, precision, recall, F-measure, G-measure, Matthew’s correlation coefficient, and accuracy. The overall outcomes of this paper suggested RF technique by producing best results in terms of reducing error rates as well as increasing accuracy on five datasets, i.e., AR3, PC1, PC2, PC3, and PC4. The average accuracy achieved by RF is 90.2238%. The comprehensive outcomes of this study can be used as a reference point for other researchers. Any assertion concerning the enhancement in prediction through any new model, technique, or framework can be benchmarked and verified. (shrink)