Supervised Learning

This research project utilized advanced computer algorithms to predict the outcomes of Premier League soccer matches. The dataset containing match data and odds from seasons was processed to handle missing information, select features and reduce complexity using Principal Component Analysis. To address imbalances, in the target variable Synthetic Minority Over sampling Technique (SMOTE) was employed. Various machine learning models such as RandomForest, DecisionTree, SVM, XGBoost and LightGBM were evaluated.

The rise of artificial intelligence (AI) has significantly impacted urban environments, facilitating the development of smart cities. This paper examines how AI technologies are reshaping urban ecosystems by fostering innovation and promoting sustainability. It explores the integration of AI in critical sectors such as transportation, energy management, waste management, and governance. The study also addresses challenges, including data privacy, ethical considerations, and the digital divide, offering insights into future research and policy directions. Smart cities serve as testbeds for innovative AI (...) applications, offering scalable solutions to urban challenges while advancing global sustainability goals. Urbanization presents challenges requiring innovative solutions. Artificial Intelligence (AI) is revolutionizing urban planning and smart city initiatives by enhancing efficiency, sustainability, and citizen-centric development. This paper explores how AI technologies contribute to. (shrink)

The proliferation of the Internet of Things (IoT) has transformed various industries by enabling smart environments and improving operational efficiencies. However, this expansion has introduced numerous security vulnerabilities, making IoT systems prime targets for cyberattacks. This paper proposes a machine learning-based intrusion detection framework tailored to the unique characteristics of IoT environments. The framework leverages feature engineering, advanced machine learning algorithms, and real-time anomaly detection to identify and mitigate security threats effectively. Experimental results demonstrate the efficacy of the proposed approach (...) in detecting diverse IoT-specific attacks, including denial-of-service (DoS), man-in-the-middle (MITM), and malware-based attacks. The Internet of Things (IoT) has revolutionized modern living by interconnecting devices and enabling seamless communication. However, the increasing reliance on IoT systems has exposed significant vulnerabilities, making them a prime target for security attacks. This paper proposes a machine learning-based intrusion detection framework to detect and mitigate security attacks in IoT environments. The framework integrates diverse machine learning algorithms to identify abnormal behavior and potential threats. Through comprehensive experiments and evaluations, this research demonstrates the efficacy of the proposed framework in terms of accuracy, scalability, and robustness. (shrink)

Several state-of-the-art machine and deep learning models in the mode of adversarial training, input transformation, self adaptive training, adversarial purification, zero-shot, one- shot, and few-shot meta learning had been proposed as a possible solution to an out-of-distribution problems by applying them to wide arrays of benchmark dataset across different research domains with varying degrees of performances, but investigating their performance on previously unseen out-of- distribution malware attack remains elusive. Having evaluated the poor performances of these state-of-the-art approaches in our previous (...) research on an out-of-distribution attack. In this research, we dived deeper to understand why they works better for other domain dataset but with poor performance on available benchmark malware dataset like Malimg, Malevis, Sorel, and Avast CTU malware dataset. We explored the both the embedding and vector spaces in datasets and compare them with that from other research domain, and find a surprising wide variation between the embedding and vector spaces in malware datasets. We assert that current state-of-the-art machine and deep learning models does not address the wide variation of embedding and vector spaces which are peculiar to malware dataset, hence their poor performance on out-of-distribution attack classification, and so concluded that addressing this variation in embedding and vector spaces will bring about substantial increase in detection of previously unseen out-of-distribution attack. (shrink)

Current state-of-the-art out-of-distribution algorithm does not address the variation in dynamic and static behavior between malware variants from the same family as evidence in their poor performance against an out-of-distribution malware attack. We aims to address this limitation by: 1) exploitation of the in-dimensional embedding space between variants from the same malware family to account for all variations 2) exploitation of the inter-dimensional space between different malware family 3) building a deep learning-based model with a shallow neural network with maximum (...) of two connected layers to overcome overfitting from the scratch 4) building a Bayesian inference based computation algorithm that intertwine with connected network and is able to create new and adjust existing data points in response to an exposure to new out-of-distribution variants of existing or new malware family which determines the extent at which model weight is adjusted which in turn triggers update on the gradient. Preliminary result of our proposed framework gave an accuracy of 81\% in the successful classification of a novel out-of-distribution malware attack, something that could not be achieve by any of the state-of-the-art algorithms on novel malware classification. (shrink)

Many philosophers hold that generics (i.e., unquantified generalizations) are pervasive in communication and that when they are about social groups, this may offend and polarize people because generics gloss over variations between individuals. Generics about social groups might be particularly common on Twitter (X). This remains unexplored, however. Using machine learning (ML) techniques, we therefore developed an automatic classifier for social generics, applied it to 1.1 million tweets about people, and analyzed the tweets. While it is often suggested that generics (...) are ubiquitous in everyday communication, we found that most tweets (78%) about people contained no generics. However, tweets with generics received more “likes” and retweets. Furthermore, while recent psychological research may lead to the prediction that tweets with generics about political groups are more common than tweets with generics about ethnic groups, we found the opposite. However, consistent with recent claims that political animosity is less constrained by social norms than animosity against gender and ethnic groups, negative tweets with generics about political groups were significantly more prevalent and retweeted than negative tweets about ethnic groups. Our study provides the first ML-based insights into the use and impact of social generics on Twitter. (shrink)

This paper argues that a notion of statistical explanation, based on Salmon’s statistical relevance model, can help us better understand deep neural networks. It is proved that homogeneous partitions, the core notion of Salmon’s model, are equivalent to minimal sufficient statistics, an important notion from statistical inference. This establishes a link to deep neural networks via the so-called Information Bottleneck method, an information-theoretic framework, according to which deep neural networks implicitly solve an optimization problem that generalizes minimal sufficient statistics. The (...) resulting notion of statistical explanation is general, mathematical, and subcausal. (shrink)