Face recognition is a computationally challenging classification task. Deep convolutional neural networks (DCNNs) are brain‐inspired algorithms that have recently reached human‐level performance in face and object recognition. However, it is not clear to what extent DCNNs generate a human‐like representation of face identity. We have recently revealed a subset of facial features that are used by humans for face recognition. This enables us now to ask whether DCNNs rely on the same facial information and whether this human‐like representation (...) depends on a system that is optimized for face identification. In the current study, we examined the representation of DCNNs of faces that differ in features that are critical or non‐critical for human face recognition. Our findings show that DCNNs optimized for face identification are tuned to the same facial features used by humans for face recognition. Sensitivity to these features was highly correlated with performance of the DCNN on a benchmark face recognition task. Moreover, sensitivity to these features and a view‐invariant face representation emerged at higher layers of a DCNN optimized for face recognition but not for object recognition. This finding parallels the division to a face and an object system in high‐level visual cortex. Taken together, these findings validate human perceptual models of face recognition, enable us to use DCNNs to test predictions about human face and object recognition as well as contribute to the interpretability of DCNNs. (shrink)

As the medium of human-computer interaction, it is crucial to correctly and quickly interpret the motion information of surface electromyography. Deep learning can recognize a variety of sEMG actions by end-to-end training. However, most of the existing deep learning approaches have complex structures and numerous parameters, which make the network optimization problem difficult to realize. In this paper, a novel PSO-based optimized lightweight convolution neural network is designed to improve the accuracy and optimize the model with applications (...) in sEMG signal movement recognition. With the purpose of reducing the structural complexity of the deep neural network, the designed convolution neural network model is mainly composed of three convolution layers and two full connection layers. Meanwhile, the particle swarm optimization is used to optimize hyperparameters and improve the autoadaptive ability of the designed sEMG pattern recognition model. To further indicate the potential application, three experiments are designed according to the progressive process of body movements with respect to the Ninapro standard data set. Experiment results demonstrate that the proposed PLCNN recognition method is superior to the four other popular classification methods. (shrink)

Convolutional neural networks, which automatically learn features from raw data to approximate functions, are being increasingly applied to the end-to-end analysis of electroencephalographic signals, especially for decoding brain states in brain-computer interfaces. Nevertheless, CNNs introduce a large number of trainable parameters, may require long training times, and lack in interpretability of learned features. The aim of this study is to propose a CNN design for P300 decoding with emphasis on its lightweight design while guaranteeing high performance, on the effects (...) of different training strategies, and on the use of post-hoc techniques to explain network decisions. The proposed design, named MS-EEGNet, learned temporal features in two different timescales in an efficient and optimized way, and was validated on three P300 datasets. The CNN was trained using different strategies and was compared with several state-of-the-art algorithms. Furthermore, variants of the baseline MS-EEGNet were analyzed to evaluate the impact of different hyper-parameters on performance. Lastly, saliency maps were used to derive representations of the relevant spatio-temporal features that drove CNN decisions. MS-EEGNet was the lightest CNN compared with the tested SOA CNNs, despite its multiple timescales, and significantly outperformed the SOA algorithms. Post-hoc hyper-parameter analysis confirmed the benefits of the innovative aspects of MS-EEGNet. Furthermore, MS-EEGNet did benefit from transfer learning, especially using a low number of training examples, suggesting that the proposed approach could be used in BCIs to accurately decode the P300 event while reducing calibration times. Representations derived from the saliency maps matched the P300 spatio-temporal distribution, further validating the proposed decoding approach. This study, by specifically addressing the aspects of lightweight design, transfer learning, and interpretability, can contribute to advance the development of deep learning algorithms for P300-based BCIs. (shrink)

Speech recognition technology has played an indispensable role in realizing human-computer intelligent interaction. However, most of the current Chinese speech recognition systems are provided online or offline models with low accuracy and poor performance. To improve the performance of offline Chinese speech recognition, we propose a hybrid acoustic model of deep convolutional neural network, long short-term memory, and deep neural network. This model utilizes DCNN to reduce frequency variation and adds a batch normalization layer after its (...) convolutional layer to ensure the stability of data distribution, and then use LSTM to effectively solve the gradient vanishing problem. Finally, the fully connected structure of DNN is utilized to efficiently map the input features into a separable space, which is helpful for data classification. Therefore, leveraging the strengths of DCNN, LSTM, and DNN by combining them into a unified architecture can effectively improve speech recognition performance. Our model was tested on the open Chinese speech database THCHS-30 released by the Center for Speech and Language Technology of Tsinghua University, and it was concluded that the DLD model with 3 layers of LSTM and 3 layers of DNN had the best performance, reaching 13.49% of words error rate. (shrink)

The stability of the power grid is concernment due to the high demand and supply to smart cities, homes, factories, and so on. Different machine learning and deep learning models can be used to tackle the problem of stability prediction for the energy grid. This study elaborates on the necessity of IoT technology to make energy grid networks smart. Different prediction models, namely, logistic regression, naïve Bayes, decision tree, support vector machine, random forest, XGBoost, k-nearest neighbor, and optimized artificial (...) neural network, have been applied on openly available smart energy grid datasets to predict their stability. The present article uses metrics such as accuracy, precision, recall, f1-score, and ROC curve to compare different predictive models. Data augmentation and feature scaling have been applied to the dataset to get better results. The augmented dataset provides better results as compared with the normal dataset. This study concludes that the deep learning predictive model ANN optimized with Adam optimizer provides better results than other predictive models. The ANN model provides 97.27% accuracy, 96.79% precision, 95.67% recall, and 96.22% F1 score. (shrink)

Deep neural networks are said to be opaque, impeding the development of safe and trustworthy artificial intelligence, but where this opacity stems from is less clear. What are the sufficient properties for neural network opacity? Here, I discuss five common properties of deep neural networks and two different kinds of opacity. Which of these properties are sufficient for what type of opacity? I show how each kind of opacity stems from only one of these five (...) properties, and then discuss to what extent the two kinds of opacity can be mitigated by explainability methods. (shrink)

For efficient energy distribution, microgrids provide significant assistance to main grids and act as a bridge between the power generation and consumption. Renewable energy generation resources, particularly photovoltaics, are considered as a clean source of energy but are highly complex, volatile, and intermittent in nature making their forecasting challenging. Thus, a reliable, optimized, and a robust forecasting method deployed at MG objectifies these challenges by providing accurate renewable energy production forecasting and establishing a precise power generation and consumption matching at (...) MG. Furthermore, it ensures effective planning, operation, and acquisition from the main grid in the case of superior or inferior amounts of energy, respectively. Therefore, in this work, we develop an end-to-end hybrid network for automatic PV power forecasting, comprising three basic steps. Firstly, data preprocessing is performed to normalize, remove the outliers, and deal with the missing values prominently. Next, the temporal features are extracted using deep sequential modelling schemes, followed by the extraction of spatial features via convolutional neural networks. These features are then fed to fully connected layers for optimal PV power forecasting. In the third step, the proposed model is evaluated on publicly available PV power generation datasets, where its performance reveals lower error rates when compared to state-of-the-art methods. (shrink)

Legal text retrieval serves as a key component in a wide range of legal text processing tasks such as legal question answering, legal case entailment, and statute law retrieval. The performance of legal text retrieval depends, to a large extent, on the representation of text, both query and legal documents. Based on good representations, a legal text retrieval model can effectively match the query to its relevant documents. Because legal documents often contain long articles and only some parts are relevant (...) to queries, it is quite a challenge for existing models to represent such documents. In this paper, we study the use of attentive neural network-based text representation for statute law document retrieval. We propose a general approach using deep neural networks with attention mechanisms. Based on it, we develop two hierarchical architectures with sparse attention to represent long sentences and articles, and we name them Attentive CNN and Paraformer. The methods are evaluated on datasets of different sizes and characteristics in English, Japanese, and Vietnamese. Experimental results show that: (i) Attentive neural methods substantially outperform non-neural methods in terms of retrieval performance across datasets and languages; (ii) Pretrained transformer-based models achieve better accuracy on small datasets at the cost of high computational complexity while lighter weight Attentive CNN achieves better accuracy on large datasets; and (iii) Our proposed Paraformer outperforms state-of-the-art methods on COLIEE dataset, achieving the highest recall and F2 scores in the top-N retrieval task. (shrink)

Methods of machine learning (ML) are gradually complementing and sometimes even replacing methods of classical statistics in science. This raises the question whether ML faces the same methodological problems as classical statistics. This paper sheds light on this question by investigating a long-standing challenge to classical statistics: the reference class problem (RCP). It arises whenever statistical evidence is applied to an individual object, since the individual belongs to several reference classes and evidence might vary across them. Thus, the problem consists (...) in choosing a suitable reference class for the individual. I argue that deep neural networks (DNNs) are able to overcome specific instantiations of the RCP. Whereas the criteria of narrowness, reliability, and homogeneity, that have been proposed to determine a suitable reference class, pose an inextricable tradeoff to classical statistics, DNNs are able to satisfy them in some situations. On the one hand, they can exploit the high dimensionality in big-data settings. I argue that this corresponds to the criteria of narrowness and reliability. On the other hand, ML research indicates that DNNs are generally not susceptible to overfitting. I argue that this property is related to a particular form of homogeneity. Taking both aspects together reveals that there are specific settings in which DNNs can overcome the RCP. (shrink)

Recent breakthroughs in artificial intelligence have primarily resulted from training deep neural networks (DNNs) with vast numbers of adjustable parameters on enormous datasets. Due to their complex internal structure, DNNs are frequently characterized as inscrutable ``black boxes,'' making it challenging to interpret the mechanisms underlying their impressive performance. This opacity creates difficulties for explanation, safety assurance, trustworthiness, and comparisons to human cognition, leading to divergent perspectives on these systems. This chapter examines recent developments in interpretability methods for DNNs, (...) with a focus on interventionist approaches inspired by causal explanation in philosophy of science. We argue that these methods offer a promising avenue for understanding how DNNs process information compared to merely behavioral benchmarking and correlational probing. We review key interventionist methods and illustrate their application through practical case studies. These methods allow researchers to identify and manipulate specific computational components within DNNs, providing insights into their causal structure and internal representations. We situate these approaches within the broader framework of causal abstraction, which aims to align low-level neural computations with high-level interpretable models. While acknowledging current limitations, we contend that interventionist methods offer a path towards more rigorous and theoretically grounded interpretability research, potentially informing both AI development and computational cognitive neuroscience. (shrink)

Although the management and planning of water resources are extremely significant to human development, the complexity of implementation is unimaginable. To achieve this, the high-precision water consumption prediction is actually the key component of urban water optimization management system. Water consumption is usually affected by many factors, such as weather, economy, and water prices. If these impact factors are directly combined to predict water consumption, the weight of each perspective on the water consumption will be ignored, which will be greatly (...) detrimental to the prediction accuracy. Therefore, this paper proposes a deep neural network-based complex system for urban water management. The essence of it is to formulate a water consumption prediction model with the aid of principal component analysis and the integrated deep neural network, which is abbreviated as UWM-Id. The PCA classifies the factors affecting water consumption in the original data into three categories according to their correlation and inputs them into the neural network model. The results in the previous step are assigned weights and integrated into the form of fully connected layer. Finally, analyzing the sensitivity of the proposed UWM-Id and comparing its performance with a series of commonly used baseline methods for data mining, a large number of experiments have proved that UWM-Id has good performance and can be used for urban water management system. (shrink)

The number of comments/reviews for movies is enormous and cannot be processed manually. Therefore, machine learning techniques are used to efficiently process the user’s opinion. This research work proposes a deep neural network with seven layers for movie reviews’ sentiment analysis. The model consists of an input layer called the embedding layer, which represents the dataset as a sequence of numbers called vectors, and two consecutive layers of 1D-CNN for extracting features. A global max-pooling layer is used to (...) reduce dimensions. A dense layer for classification and a dropout layer are also used to reduce overfitting and improve generalization error in the neural network. A fully connected layer is the last layer to predict between two classes. Two movie review datasets are used and widely accepted by the research community. The first dataset contains 25,000 samples, half positive and half negative, whereas the second dataset contains 50,000 specimens of movie reviews. Our neural network model performs sentiment classification among positive and negative movie reviews called binary classification. The model achieves 92% accuracy on both datasets, which is more efficient than traditional machine learning models. (shrink)

An ideal vision model accounts for behavior and neurophysiology in both naturalistic conditions and designed lab experiments. Unlike psychological theories, artificial neural networks (ANNs) actually perform visual tasks and generate testable predictions for arbitrary inputs. These advantages enable ANNs to engage the entire spectrum of the evidence. Failures of particular models drive progress in a vibrant ANN research program of human vision.

Deep neural networks (DNNs) have had extraordinary successes in classifying photographic images of objects and are often described as the best models of biological vision. This conclusion is largely based on three sets of findings: (1) DNNs are more accurate than any other model in classifying images taken from various datasets, (2) DNNs do the best job in predicting the pattern of human errors in classifying objects taken from various behavioral datasets, and (3) DNNs do the best job (...) in predicting brain signals in response to images taken from various brain datasets (e.g., single cell responses or fMRI data). However, these behavioral and brain datasets do not test hypotheses regarding what features are contributing to good predictions and we show that the predictions may be mediated by DNNs that share little overlap with biological vision. More problematically, we show that DNNs account for almost no results from psychological research. This contradicts the common claim that DNNs are good, let alone the best, models of human object recognition. We argue that theorists interested in developing biologically plausible models of human vision need to direct their attention to explaining psychological findings. More generally, theorists need to build models that explain the results of experiments that manipulate independent variables designed to test hypotheses rather than compete on making the best predictions. We conclude by briefly summarizing various promising modeling approaches that focus on psychological data. (shrink)

Emotion-based sentimental analysis has recently received a lot of interest, with an emphasis on automated identification of user behavior, such as emotional expressions, based on online social media texts. However, the majority of the prior attempts are based on traditional procedures that are insufficient to provide promising outcomes. In this study, we categorize emotional sentiments by recognizing them in the text. For that purpose, we present a deep learning model, bidirectional long-term short-term memory, for emotion recognition that takes into (...) account five main emotions. We use our experimental assessments on the emotion dataset to accomplish the emotion categorization job. The datasets were evaluated and the findings revealed that, when compared to state-of-the-art methodologies, the proposed model can successfully categorize user emotions into several classifications. Finally, we assess the efficacy of our strategy using statistical analysis. This research’s findings help firms to apply best practices in the selection, management, and optimization of policies, services, and product information. (shrink)

The ability to conduct logical reasoning is a fundamental aspect of intelligent behavior, and thus an important problem along the way to human-level artificial intelligence. Traditionally, symbolic methods from the field of knowledge representation and reasoning have been used to equip agents with capabilities that resemble human reasoning qualities. More recently, however, there has been an increasing interest in applying alternative approaches based on machine learning rather than logic-based formalisms to tackle this kind of tasks. Here, we make use of (...) state-of-the-art methods for training deep neural networks to devise a novel model that is closely coupled to symbolic reasoning methods, and thus able to learn how to effectively perform basic ontology reasoning. This term describes an important and at the same time very natural kind of problem settings where the rules for conducting reasoning are specified alongside with the actual information. Many problems in practice may be viewed as such reasoning tasks, which is why the presented approach is applicable to a plethora of important real-world problems. To demonstrate the effectiveness of the suggested method, we present the outcomes of several experiments that have been conducted on both toy datasets as well as real-world data, which show that our model learned to perform precise reasoning on a number of diverse inference tasks that require comprehensive deductive proficiencies. Furthermore, it turned out that the suggested model suffers much less from different obstacles that prohibit symbolic reasoning. (shrink)

Depending on what we mean by “explanation,” challenges to the explanatory depth and reach of deep neural network models of visual and other forms of intelligent behavior may need revisions to both the elementary building blocks of neural nets (the explananda) and to the ways in which experimental environments and training protocols are engineered (the explanantia). The two paths assume and imply sharply different conceptions of how an explanation explains and of the explanatory function of models.

Bowers et al. argue that deep neural networks (DNNs) are poor models of biological vision because they often learn to rival human accuracy by relying on strategies that differ markedly from those of humans. We show that this problem is worsening as DNNs are becoming larger-scale and increasingly more accurate, and prescribe methods for building DNNs that can reliably model biological vision.

“Rationality” in Simon's “bounded rationality” is the principle that humans make decisions on the basis of step-by-step reasoning using systematic rules of logic to maximize utility. “Bounded rationality” is the observation that the ability of a human brain to handle algorithmic complexity and large quantities of data is limited. Bounded rationality, in other words, treats a decision maker as a machine carrying out computations with limited resources. Under the principle of embodied cognition, a cognitive mind is an interactive machine. Turing-Church (...) computations are not interactive, and interactive machines can accomplish things that no Turing-Church computation can accomplish. Hence, if “rationality” is computation, and “bounded rationality” is computation with limited complexity, then “embodied bounded rationality” is both more limited than computation and more powerful. By embracing interaction, embodied bounded rationality can accomplish things that Turing-Church computation alone cannot. Deep neural networks, which have led to a revolution in artificial intelligence, are both interactive and not fundamentally algorithmic. Hence, their ability to mimic some cognitive capabilities far better than prior algorithmic techniques based on symbol manipulation provides empirical evidence for the principle of embodied bounded rationality. (shrink)

Forecasting blood glucose values for patients can help prevent hypoglycemia and hyperglycemia events in advance. To this end, this study proposes an intelligent ensemble deep learning system to predict BG values in 15, 30, and 60 min prediction horizons based on historical BG values collected via continuous glucose monitoring devices as an endogenous factor and carbohydrate intake and insulin administration information as exogenous factors. Although there are numerous deep learning algorithms available, this study applied five algorithms, namely, recurrent (...) neural network, which is optimized for sequence data, and RNN-based algorithms, stacked LSTM, bidirectional LSTM, and gated recurrent unit). Then, a genetic algorithm was applied to the five prediction models to optimize their weights through ensemble techniques and to yield the final predicted BG values. The performance of the proposed model was compared to that of the autoregressive integrated moving average model as a baseline. The results show that the proposed model significantly outperforms the baseline in terms of the root mean square error and continuous glucose error grid analysis. For the valid 29 diabetic patients for the multivariate models, the RMSE was 11.08, 19.25, and 31.30 mg/DL for 15, 30, and 60 min PH, respectively. When the same data were applied to univariate models, the RMSE was 11.28, 19.99, and 33.13 mg/DL for 15, 30, and 60 min PH, respectively. Both the univariate and multivariate models showed a statistically significant difference compared with the baseline at a 5% statistical significance level. Instead of using a model with a single algorithm, applying a GA based on each output of a model with multiple algorithms was found to play a significant role in improving model performance. (shrink)

Deep Neural Networks (DNNs) are becoming increasingly important as scientific tools, as they excel in various scientific applications beyond what was considered possible. Yet from a certain vantage point, they are nothing but parametrized functions fθ(x)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{f}_{\varvec{\theta }}(\varvec{x})$$\end{document} of some data vector x\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{x}$$\end{document}, and their ‘learning’ is nothing but an iterative, algorithmic fitting of the parameters to data. Hence, what could be (...) special about them as a scientific tool or model? I will here suggest an integrated perspective that mediates between extremes, by arguing that what makes DNNs in science special is their ability to develop functional concept proxies (FCPs): Substructures that occasionally provide them with abilities that correspond to those facilitated by concepts in human reasoning. Furthermore, I will argue that this introduces a problem that has so far barely been recognized by practitioners and philosophers alike: That DNNs may succeed on some vast and unwieldy data sets because they develop FCPs for features that are not transparent to human researchers. The resulting breach between scientific success and human understanding I call the ‘Actually Smart Hans Problem’. (shrink)

Decades of psychological research have been aimed at modeling how people learn features and categories. The empirical validation of these theories is often based on artificial stimuli with simple representations. Recently, deep neural networks have reached or surpassed human accuracy on tasks such as identifying objects in natural images. These networks learn representations of real‐world stimuli that can potentially be leveraged to capture psychological representations. We find that state‐of‐the‐art object classification networks provide surprisingly accurate predictions of human similarity (...) judgments for natural images, but they fail to capture some of the structure represented by people. We show that a simple transformation that corrects these discrepancies can be obtained through convex optimization. We use the resulting representations to predict the difficulty of learning novel categories of natural images. Our results extend the scope of psychological experiments and computational modeling by enabling tractable use of large natural stimulus sets. (shrink)

Some how-possibly explanations have epistemic value because they are epistemically possible; we cannot rule out their truth. One paradoxical implication of that proposal is that epistemic value may be obtained from mere ignorance. For the less we know, then the more is epistemically possible. This chapter examines a particular class of problematic epistemically possible how-possibly explanations, viz. *epistemically opaque* how-possibly explanations. Those are how-possibly explanations justified by an epistemically opaque process. How could epistemically opaque how-possibly explanations have epistemic value if (...) they result from a process about which we lack knowledge or understanding? This chapter proposes three different strategies to salvage epistemic value from epistemic opacity, namely salvaging value from 1) functional transparency, 2) modal operator interpretation, and 3) pursuitworthiness. It illustrates using cases from deep neural network modeling. (shrink)

This study combines the discovery methods and training of innovative talents, China’s requirements for improving talent training capabilities, and analyses the relationship between the number of professional enrollments in colleges and universities and the demand for skills in specific places. The research learns the characteristics and training models of innovative talents, deep learning, neural networks, and related concepts of the seasonal difference Autoregressive Moving Average Model. These concepts are used to propose seasonal autoregressive integrated moving average back propagation. (...) Firstly, the SARIMA-BP artificially sets the weight parameter values and analyzes the model’s convergence speed, superiority, and versatility. Then, particle swarm optimization algorithm is used to pre-process the model and test its independence. The accuracy of the model is checked to ensure its proper performance. Secondly, the model analyzes and predicts the relationship between the number of professional enrollments of 10 colleges and universities in a specific place and the talent demand of local related enterprises. Moreover, the established model is optimized and tested by wavelet denoising. Independent testing is done to ensure the best possible performance of the model. Finally, the weight value will not significantly affect the model’s versatility obtained by experiments. The prediction results of professional settings and corporate needs reveal that: there is a moderate correlation between professional locations and corporate needs; colleges and universities should train professional talents for local enterprises and eliminate the practical education concepts. (shrink)

The predominance of machine learning based techniques in cognitive neuroscience raises a host of philosophical and methodological concerns. Given the messiness of neural activity, modellers must make choices about how to structure their raw data to make inferences about encoded representations. This leads to a set of standard methodological assumptions about when abstraction is appropriate in neuroscientific practice. Yet, when made uncritically these choices threaten to bias conclusions about phenomena drawn from data. Contact between the practices of multivariate pattern (...) analysis and philosophy of science can help to illuminate the conditions under which we can use artificial neural networks to better understand neural mechanisms. This paper considers a specific technique for MVPA called representational similarity analysis. I develop a theoretically-informed account of RSA that draws on early connectionist research and work on idealization in the philosophy of science. By bringing a philosophical account of cognitive modelling in conversation with RSA, this paper clarifies the practices of neuroscientists and provides a generalizable framework for using artificial neural networks to study neural mechanisms in the brain. (shrink)

How to enable the computer to accurately analyze the emotional information and story background of characters in Qin opera is a problem that needs to be studied. To promote the artistic inheritance and cultural emotion color dissemination of Qin opera, an emotion analysis model of Qin opera based on attention residual network is presented. The neural network is improved and optimized from the perspective of the model, learning rate, network layers, and the network itself, and then multi-head attention is (...) added to the ResNet to increase the recognition ability of the model. The convolutional neural network is optimized from the internal depth, and the fitting ability and stability of the model are enhanced through the ResNet model. Combined with the attention mechanism, the expression of each weight information is strengthened. The multi-head attention mechanism is introduced in the model and a multi-head attention ResNet, namely, MHAtt_ResNet, is proposed. The network structure can effectively identify the features of the spectrogram, improve the weight information of spectrogram features, and deepen the relationship between distant information in long-time series. Through experiments, the proposed model has high emotional classification accuracy for Qin opera, and with the increase of the number of data sets, the model will train a better classification effect. (shrink)

Radiography images are widely utilized in the health sector to recognize the patient health condition. The noise and irrelevant region information minimize the entire disease detection accuracy and computation complexity. Therefore, in this study, statistical Kolmogorov–Smirnov test has been integrated with wavelet transform to overcome the de-noising issues. Then the cat swarm-optimized deep belief network is applied to extract the features from the affected region. The optimized deep learning model reduces the feature training cost and time and improves (...) the overall disease detection accuracy. The network learning process is enhanced according to the AdaDelta learning process, which replaces the learning parameter with a delta value. This process minimizes the error rate while recognizing the disease. The efficiency of the system evaluated using image retrieval in medical application dataset. This process helps to determine the various diseases such as breast, lung, and pediatric studies. (shrink)

Cardiac disease is the leading cause of death worldwide. Cardiovascular diseases can be prevented if an effective diagnostic is made at the initial stages. The ECG test is referred to as the diagnostic assistant tool for screening of cardiac disorder. The research purposes of a cardiac disorder detection system from 12-lead-based ECG Images. The healthcare institutes used various ECG equipment that present results in nonuniform formats of ECG images. The research study proposes a generalized methodology to process all formats of (...) ECG. Single Shoot Detection MobileNet v2-based Deep Neural Network architecture was used to detect cardiovascular disease detection. The study focused on detecting the four major cardiac abnormalities with 98% accuracy results were calculated. The work is relatively rare based on their dataset; a collection of 11,148 standard 12-lead-based ECG images used in this study were manually collected from health care institutes and annotated by the domain experts. The study achieved high accuracy results to differentiate and detect four major cardiac abnormalities. Several cardiologists manually verified the proposed system’s accuracy result and recommended that the proposed system can be used to screen for a cardiac disorder. (shrink)

Psychologically faithful deep neural networks (DNNs) could be constructed by training with psychophysics data. Moreover, conventional DNNs are mostly monocular vision based, whereas the human brain relies mainly on binocular vision. DNNs developed as smaller vision agent networks associated with fundamental and less intelligent visual activities, can be combined to simulate more intelligent visual activities done by the biological brain.

Accurate and rapid defect identification based on pulsed eddy current testing plays an important role in the structural integrity and health monitoring of in-service equipment in the renewable energy system. However, in conventional data-driven defect identification methods, the signal feature extraction is time consuming and requires expert experience. To avoid the difficulty of manual feature extraction and overcome the shortcomings of the classic deep convolutional network, such as large memory and high computational cost, an intelligent defect recognition pipeline based (...) on the general Warblet transform method and optimized two-dimensional DCNN is proposed. The GWT method is used to convert the one-dimensional PECT signal to a 2D grayscale image used as the input of 2D DCNN. A compound method is proposed to optimize the baseline VGG16, a well-known DCNN, from four aspects including reducing the input size, adding batch normalization layer after every convolutional layer and fully connection layer, simplifying the FCs, and removing unimportant filters in Convs so as to reduce memory and computational costs while improving accuracy. Through a pulsed eddy current testing experiment considering interference factors including liftoff and noise, the following conclusion can be obtained. The time-frequency representation obtained by the GWT method not only has excellent ability in terms of the transient component analysis but also is less affected by the reduction of image size; the proposed optimized DCNN can accurately identify defect types without manual feature extraction. And compared to the baseline VGG16, the accuracy obtained by the optimized DCNN is improved by 7%, to about 99.58%, and the memory and computational cost are reduced by 98%. Moreover, compared with other well-known DCNNs, such as GoogLeNet, Inception V3, ResNet50, and AlexNet, the optimized network has significant advantages in terms of accuracy and computational cost, too. (shrink)

In today’s era of rapid development in science and technology, the development of digital technology has increasingly higher requirements for data processing functions. The matrix signal commonly used in engineering applications also puts forward higher requirements for processing speed. The eigenvalues of the matrix represent many characteristics of the matrix. Its mathematical meaning represents the expansion of the inherent vector, and its physical meaning represents the spectrum of vibration. The eigenvalue of a matrix is the focus of matrix theory. The (...) problem of matrix eigenvalues is widely used in many research fields such as physics, chemistry, and biology. A neural network is a neuron model constructed by imitating biological neural networks. Since it was proposed, the application research of its typical models, such as recurrent neural networks and cellular neural networks, has become a new hot spot. With the emergence of deep neural network theory, scholars continue to combine deep neural networks to calculate matrix eigenvalues. This article aims to study the estimation and application of matrix eigenvalues based on deep neural networks. This article introduces the related methods of matrix eigenvalue estimation based on deep neural networks, and also designs experiments to compare the time of matrix eigenvalue estimation methods based on deep neural networks and traditional algorithms. It was found that under the serial algorithm, the algorithm based on the deep neural network reduced the calculation time by about 7% compared with the traditional algorithm, and under the parallel algorithm, the calculation time was reduced by about 17%. Experiments are also designed to calculate matrix eigenvalues with Obj and recurrent neural networks (RNNS) models, which proves that the Oja algorithm is only suitable for calculating the maximum eigenvalues of non-negative matrices, while RNNS is commonly used in general models. (shrink)

Machine learning systems are making considerable inroads in society owing to their ability to recognize and predict patterns. However, the decision-making logic of some widely used machine learning models, such as deep neural networks, is characterized by opacity, thereby rendering them exceedingly difficult for humans to understand and explain and, as a result, potentially risky to use. Considering the importance of addressing this opacity, this paper calls for research that studies empirically and theoretically how machine learning experts and (...) users seek to attain machine learning explainability. Focusing on automated trading, we take steps in this direction by analyzing a trading firm’s quest for explaining its deep neural network system’s actionable predictions. We demonstrate that this explainability effort involves a particular form of human–machine interaction that contains both anthropomorphic and technomorphic elements. We discuss this attempt to attain machine learning explainability in light of reflections on cross-species companionship and consider it an example of human–machine companionship. (shrink)

Internet-of-Things (IoT) creates a significant impact in spectrum sensing, information retrieval, medical analysis, traffic management, etc. These applications require continuous information to perform a specific task. At the time, various intermediate attacks such as jamming, priority violation attacks, and spectrum poisoning attacks affect communication because of the open nature of wireless communication. These attacks create security and privacy issues while making data communication. Therefore, a new method autoencoder deep neural network (AENN) is developed by considering exploratory, evasion, causative, (...) and priority violation attack. The created method classifies the transmission outcomes used to predict the transmission state, whether it is jam data transmission or sensing data. After that, the sensing data is applied for network training that predicts the intermediate attacks. In addition to this, the channel access algorithm is used to validate the channel for every access that minimizes unauthorized access. After validating the channel according to the neural network, data have been transmitted over the network. The defined process is implemented, and the system minimizes different attacks on various levels of energy consumption. The effectiveness of the system is implemented using TensorFlow, and the system ensures the 99.02% of detection rate when compared with other techniques. (shrink)

In this study, the focus was on the development of green energy and future prediction for the consumption of current energy sources and green energy development using an improved deep learning algorithm. In addition to the analysis of the current energy consumption used for the natural gas and oil as fuel, deep neural network algorithm is used to train the system as well as to process the data obtained previously, ranging from literature from the year 2003 until (...) the year 2019, for consumption of fuel. Also, using the proposed algorithm to predict the development of green energy consumption till 2030 is presented in terms of solar and wind generators. The resulting study also focuses on depletion of energy currently used or pollution caused because of it. The green energy controlling issue can take effect by using multiple layers of handling different features extracted from different sources and then learning the system to control it.This study aims to take advantage of carbon emissions to reduce their impact and dependence in the future on environmentally friendly renewable energies. Predicting the correct and precise amount of energy consumption and increasing the amount of environmentally friendly energy lead to a healthy ecosystem. The expected green energy consumption in the future is almost 78.25 EJ in 2030 and will be, in total energy average, 56% in 2045. The aim is to reduce dependency on costly and environmentally harmful fuels. (shrink)

This paper mainly analyzes the theories related to the financial risk of the company and combines the principles of principal component analysis, particle swarm optimization algorithm, and artificial neural network to derive the financial risk index system of the company. To improve the accuracy of financial risk prediction, principal component analysis and particle swarm algorithm are applied to optimize the BP neural network model, the input data of the prediction model is improved, and the optimal initial weights and (...) thresholds are given to the BP neural network by using particle swarm algorithm search, whereby the financial risk prediction model of particle swarm optimization BP neural network is constructed. The empirical results show that the model constructed by BP neural network not only has a high accuracy rate for static financial risk evaluation but also has a better prediction effect. After training and testing, the BP neural network-based enterprise financial risk evaluation model can accurately determine the existing financial situation of enterprise financial management and has a good prediction effect. Our research method is a fusion of the processing of the two methods, which belongs to the first integration of results. (shrink)

Theoretical research into the emotional attributes of ideological and political education can improve our ability to understand human emotion and solve socio-emotional problems. To that end, this study undertook an analysis of emotion in ideological and political education by integrating a gate recurrent unit with an attention mechanism. Based on the good results achieved by BERT in the downstream network, we use the long focusing attention mechanism assisted by two-way GRU to extract relevant information and global information of ideological and (...) political education and emotion analysis, respectively. The two kinds of information complement each other, and the accuracy of emotion information can be further improved by combining neural network model. Finally, the validity and domain adaptability of the model were verified using several publicly available, fine-grained emotion datasets. (shrink)

In the area of machine learning, different techniques are used to train machines and perform different tasks like computer vision, data analysis, natural language processing, and speech recognition. Computer vision is one of the main branches where machine learning and deep learning techniques are being applied. Optical character recognition is the ability of a machine to recognize the character of a language. Pashto is one of the most ancient and historical languages of the world, spoken in Afghanistan and Pakistan. (...) OCR application has been developed for various cursive languages like Urdu, Chinese, and Japanese, but very little work is done for the recognition of the Pashto language. When it comes to handwritten character recognition, it becomes more difficult for OCR to recognize the characters as every handwritten character’s shape is influenced by the writer’s hand motion dynamics. The reason for the lack of research in Pashto handwritten character data as compared to other languages is because there is no benchmark dataset available for experimental purposes. This study focuses on the creation of such a dataset, and then for the evaluation purpose, a machine is trained to correctly recognize unseen Pashto handwritten characters. To achieve this objective, a dataset of 43000 images was created. Three Feed Forward Neural Network models with backpropagation algorithm using different Rectified Linear Unit layer configurations were trained and tested with this dataset. The simulation shows that Model 1 achieved accuracy up to 87.6% on unseen data while Model 2 achieved an accuracy of 81.60% and 3% accuracy, respectively. Similarly, loss was the lowest for Model 1 with 0.15 and 3.17 for training and testing, followed by Model 2 with 0.7 and 4.2 for training and testing, while Model 3 was the last with loss values of 6.4 and 3.69. The precision, recall, and f-measure values of Model 1 were better than those of both Model 2 and Model 3. Based on results, Model 1 is found to be the most efficient as compared to the other two models in terms of accuracy to recognize Pashto handwritten characters. (shrink)

As a brand-new marketing method, network marketing has gradually become one of the main ways and means for enterprises to improve profitability and competitiveness with its unique advantages. Using these marketing data to build a model can dig out useful information that the business is concerned about, and the company can then formulate marketing strategies based on this information. Sales forecasting is to speculate on the future based on historical sales. It is a tool for companies to determine production volume (...) and ensure the balance of product supply and sales. It can help companies make correct business decisions to maximize profits. The neural network can approximate the nonlinear function with arbitrary precision, and the time series prediction model based on the neural network can well reflect the nonlinear development trend of information. Based on the analysis of the shortcomings of the traditional BP network, this paper uses a genetic algorithm with good global search capabilities to improve the neural network. The thought and theory of optimizing the initial weight and threshold of the neural network of the GA algorithm are discussed in detail. While expounding the forecasting method, it uses specific examples to analyze the performance and characteristics of the GA-BP network in the enterprise network marketing forecasting. The results show that the GA-BP neural network is higher than the traditional BP neural network in terms of prediction accuracy and adaptability. (shrink)

Since entering the new century, People’s living standards are constantly improving, with the continuous improvement of living conditions, people are becoming more and more important in education, which is the embodiment of the enhancement of national strength. The education level is getting higher and higher, and a good education level needs a good teacher–student relationship. To solve these problems, we use the emotional cognition of God’s network to study the teacher–student relationship, and collect and analyze the data of the teacher–student (...) relationship. In this chapter, we use GABP neural network algorithm DHNN algorithm and discrete Hopfield neural network to make the collected data more convenient to be analyzed. The research shows that there is a close relationship between the educational level and the relationship between teachers and students in China, and a good relationship between teachers and students will promote the improvement of educational level. According to the research data, “face-to-face” is the most important way of interaction between tutors and postgraduates in various types of teacher–student relationship. QQ WeChat is also one of the main ways of interaction between students and teachers, which shows that the interaction between students and teachers is talking about the interaction between online and Internet. The education industry is becoming more and more important, and the teacher–student relationship is the most important part of the education industry. Good teacher–student relationship is helpful to cultivate students’ healthy personality. In view of the cold relationship between teachers and students at present, we need to make some measures the relationship between teachers and students and effectively use the relationship between teachers and students to promote the better development of the education industry. (shrink)

Human decision making shows systematic simplifications and deviations from the tenets of rationality (‘heuristics’) that may lead to suboptimal decisional outcomes (‘cognitive biases’). There are currently three prevailing theoretical perspectives on the origin of heuristics and cognitive biases: a cognitive-psychological, an ecological and an evolutionary perspective. However, these perspectives are mainly descriptive and none of them provides an overall explanatory framework for the underlying mechanisms of cognitive biases. To enhance our understanding of cognitive heuristics and biases we propose a (...) class='Hi'>neural network framework for cognitive biases, which explains why our brain systematically tends to default to heuristic (‘Type 1’) decision making. We argue that many cognitive biases arise from intrinsic brain mechanisms that are fundamental for the working of biological neural networks. In order to substantiate our viewpoint, we discern and explain four basic neural network principles: (1) Association, (2) Compatibility (3) Retainment, and (4) Focus. These principles are inherent to (all) neural networks which were originally optimized to perform concrete biological, perceptual, and motor functions. They form the basis for our inclinations to associate and combine (unrelated) information, to prioritize information that is compatible with our present state (such as knowledge, opinions and expectations), to retain given information that sometimes could better be ignored, and to focus on dominant information while ignoring relevant information that is not directly activated. The supposed mechanisms are complementary and not mutually exclusive. For different cognitive biases they may all contribute in varying degrees to distortion of information. The present viewpoint not only complements the earlier three viewpoints, but also provides a unifying and binding framework for many cognitive bias phenomena. (shrink)

Quilty-Dunn et al. argue that deep convolutional neural networks (DCNNs) optimized for image classification exemplify structural disanalogies to human vision. A different kind of artificial vision – found in reinforcement-learning agents navigating artificial three-dimensional environments – can be expected to be more human-like. Recent work suggests that language-like representations substantially improves these agents’ performance, lending some indirect support to the language-of-thought hypothesis (LoTH).