We present a novel architecture for an AI system that allows a priori knowledge to combine with deep learning. In traditional neural networks, all available data is pooled at the input layer. Our alternative neural network is constructed so that partial representations (invariants) are learned in the intermediate layers, which can then be combined with a priori knowledge or with other predictive analyses of the same data. This leads to smaller training datasets due to more efficient learning. In addition, because this architecture allows inclusion of a priori knowledge and interpretable predictive models, the interpretability of the entire system increases while the data can still be used in a black box neural network. Our system makes use of networks of neurons rather than single neurons to enable the representation of approximations (invariants) of the output.
LINK
Considering activity level propositions in the evaluation of forensic biology findings is becoming more common place. There are increasing numbers of publications demonstrating different transfer mechanisms that can occur under a variety of circumstances. Some of these publications have shown the possibility of DNA transfer from site to site on an exhibit, for instance as a result of packaging and transport. If such a possibility exists, and the case circumstances are such that the area on an exhibit where DNA is present or absent is an observation that is an important diagnostic characteristic given the propositions, then site to site transfer should be taken into account during the evaluation of observations. In this work we demonstrate the ways in which site to site transfer can be built into Bayesian networks when carrying out activity level evaluations of forensic biology findings. We explore the effects of considering qualitative vs quantitative categorisation of DNA results. We also show the importance of taking into account multiple individual’s DNA being transferred (such as unknown or wearer DNA), even if the main focus of the evaluation is the activity of one individual.
Estimating the remaining useful life (RUL) of an asset lies at the heart of prognostics and health management (PHM) of many operations-critical industries such as aviation. Mod- ern methods of RUL estimation adopt techniques from deep learning (DL). However, most of these contemporary tech- niques deliver only single-point estimates for the RUL without reporting on the confidence of the prediction. This practice usually provides overly confident predictions that can have severe consequences in operational disruptions or even safety. To address this issue, we propose a technique for uncertainty quantification (UQ) based on Bayesian deep learning (BDL). The hyperparameters of the framework are tuned using a novel bi-objective Bayesian optimization method with objectives the predictive performance and predictive uncertainty. The method also integrates the data pre-processing steps into the hyperparameter optimization (HPO) stage, models the RUL as a Weibull distribution, and returns the survival curves of the monitored assets to allow informed decision-making. We vali- date this method on the widely used C-MAPSS dataset against a single-objective HPO baseline that aggregates the two ob- jectives through the harmonic mean (HM). We demonstrate the existence of trade-offs between the predictive performance and the predictive uncertainty and observe that the bi-objective HPO returns a larger number of hyperparameter configurations compared to the single-objective baseline. Furthermore, we see that with the proposed approach, it is possible to configure models for RUL estimation that exhibit better or comparable performance to the single-objective baseline when validated on the test sets.
