In this post I give an overview of the theory, tools, frameworks and best practices I have found until now around the testing (and debugging) of machine learning applications. I will start by giving an overview of the specificities of testing machine learning applications.
LINK
Financial constraints and risk taking are two well-established determinants of firm performance, however, no research analyzes how these variables are connected in the context of a high risk environment. Using data from microfinance clients in Tanzania, we derive a novel financial constraints measure and incorporate a psychometric risk taking scale. Results confirm the importance of access to finance and risk attitudes for business development. Also, we provide preliminary evidence for an interaction between financial constraints and risk taking. Financial constraints “throw sand in the wheels” and protect risk taking entrepreneurs from the negative impact of risk taking on microenterprise performance.
DOCUMENT
Author supplied: "This paper gives a linearised adjustment model for the affine, similarity and congruence transformations in 3D that is easily extendable with other parameters to describe deformations. The model considers all coordinates stochastic. Full positive semi-definite covariance matrices and correlation between epochs can be handled. The determination of transformation parameters between two or more coordinate sets, determined by geodetic monitoring measurements, can be handled as a least squares adjustment problem. It can be solved without linearisation of the functional model, if it concerns an affine, similarity or congruence transformation in one-, two- or three-dimensional space. If the functional model describes more than such a transformation, it is hardly ever possible to find a direct solution for the transformation parameters. Linearisation of the functional model and applying least squares formulas is then an appropriate mode of working. The adjustment model is given as a model of observation equations with constraints on the parameters. The starting point is the affine transformation, whose parameters are constrained to get the parameters of the similarity or congruence transformation. In this way the use of Euler angles is avoided. Because the model is linearised, iteration is necessary to get the final solution. In each iteration step approximate coordinates are necessary that fulfil the constraints. For the affine transformation it is easy to get approximate coordinates. For the similarity and congruence transformation the approximate coordinates have to comply to constraints. To achieve this, use is made of the singular value decomposition of the rotation matrix. To show the effectiveness of the proposed adjustment model total station measurements in two epochs of monitored buildings are analysed. Coordinate sets with full, rank deficient covariance matrices are determined from the measurements and adjusted with the proposed model. Testing the adjustment for deformations results in detection of the simulated deformations."
MULTIFILE
From the article: Abstract Adjustment and testing of a combination of stochastic and nonstochastic observations is applied to the deformation analysis of a time series of 3D coordinates. Nonstochastic observations are constant values that are treated as if they were observations. They are used to formulate constraints on the unknown parameters of the adjustment problem. Thus they describe deformation patterns. If deformation is absent, the epochs of the time series are supposed to be related via affine, similarity or congruence transformations. S-basis invariant testing of deformation patterns is treated. The model is experimentally validated by showing the procedure for a point set of 3D coordinates, determined from total station measurements during five epochs. The modelling of two patterns, the movement of just one point in several epochs, and of several points, is shown. Full, rank deficient covariance matrices of the 3D coordinates, resulting from free network adjustments of the total station measurements of each epoch, are used in the analysis.
MULTIFILE
With summaries in Dutch, Esperanto and English. DOI: 10.4233/uuid:d7132920-346e-47c6-b754-00dc5672b437 "The subject of this study is deformation analysis of the earth's surface (or part of it) and spatial objects on, above or below it. Such analyses are needed in many domains of society. Geodetic deformation analysis uses various types of geodetic measurements to substantiate statements about changes in geometric positions.Professional practice, e.g. in the Netherlands, regularly applies methods for geodetic deformation analysis that have shortcomings, e.g. because the methods apply substandard analysis models or defective testing methods. These shortcomings hamper communication about the results of deformation analyses with the various parties involved. To improve communication solid analysis models and a common language have to be used, which requires standardisation.Operational demands for geodetic deformation analysis are the reason to formulate in this study seven characteristic elements that a solid analysis model needs to possess. Such a model can handle time series of several epochs. It analyses only size and form, not position and orientation of the reference system; and datum points may be under influence of deformation. The geodetic and physical models are combined in one adjustment model. Full use is made of available stochastic information. Statistical testing and computation of minimal detectable deformations is incorporated. Solution methods can handle rank deficient matrices (both model matrix and cofactor matrix). And, finally, a search for the best hypothesis/model is implemented. Because a geodetic deformation analysis model with all seven elements does not exist, this study develops such a model.For effective standardisation geodetic deformation analysis models need: practical key performance indicators; a clear procedure for using the model; and the possibility to graphically visualise the estimated deformations."
DOCUMENT
Introduction: Nursing education traditionally teaches skill acquisition in isolated practice drills and guided by step-by-step protocols. While these approaches may seem to provide a solid foundation, they do not adequately bridge the gap between a controlled learning environment and the reality of nursing practice. The constraints-led approach (CLA) is an applied theory, which explains that skill acquisition is a process of adjusting to the characteristics of a situation, instead of reproducing isolated, “ideal” movements out of context. Given that CLA has gained recognition as an effective learning method in various fields, it is worth investigating how CLA can be implemented for skill acquisition in nursing education. Methods: To gain insight into student experiences of several CLA-exercises, an explorative qualitative design was used. Ten longitudinal focus groups with nursing students (n = 11) were performed to gain deeper understanding of students’ experiences with an education course in which several “CLA-exercises” were integrated. In addition, the teachers (n = 3) involved were interviewed after the course was completed. Results: The students experienced the education course as enjoyable, challenging and reality-based. Also, the exercises motivated students to keep practicing. The students further appreciated the room for autonomy and self-organization. The teachers expressed enthusiasm for CLA-inspired education, noting the benefits of varied methods and the need for expert feedback and well-working practice materials. Conclusion: Both students and teachers felt confident that the students who completed this course were ready to apply the learned skills under supervision in clinical practice.
DOCUMENT
Despite changing attitudes towards animal testing and current legislation to protect experimental animals, the rate of animal experiments seems to have changed little in recent years. On May 15–16, 2013, the In Vitro Testing Industrial Platform (IVTIP) held an open meeting to discuss the state of the art in alternative methods, how companies have, can, and will need to adapt and what drives and hinders regulatory acceptance and use. Several key messages arose from the meeting. First, industry and regulatory bodies should not wait for complete suites of alternative tests to become available, but should begin working with methods available right now (e.g., mining of existing animal data to direct future studies, implementation of alternative tests wherever scientifically valid rather than continuing to rely on animal tests) in non-animal and animal integrated strategies to reduce the numbers of animals tested. Sharing of information (communication), harmonization and standardization (coordination), commitment and collaboration are all required to improve the quality and speed of validation, acceptance, and implementation of tests. Finally, we consider how alternative methods can be used in research and development before formal implementation in regulations. Here we present the conclusions on what can be done already and suggest some solutions and strategies for the future.
DOCUMENT
Electrification of transportation, communication, working and living continues worldwide. Televisions, telephones, servers are an important part of everyday life. These loads and most sustainable sources as well, have one thing in common: Direct Current. The Dutch research and educational programme ‘DC – road to its full potential’ studies the impact of feeding these appliances from a DC grid. An improvement in energy efficiency is expected, other benefits are unknown and practical considerations are needed to come to a proper comparison with an AC grid. This paper starts with a brief introduction of the programme and its first stages. These stages encompass firstly the commissioning, selection and implementation of a safe and user friendly testing facility, to compare performance of domestic appliances when powered with AC and DC. Secondly, the relationship between the DC-testing facility and existing modeling and simulation assignments is explained. Thirdly, first results are discussed in a broad sense. An improved energy efficiency of 3% to 5% is already demonstrated for domestic appliances. That opens up questions for the performance of a domestic DC system as a whole. The paper then ends with proposed minor changes in the programme and guidelines for future projects. These changes encompass further studying of domestic appliances for product-development purposes, leaving less means for new and costly high-power testing facilities. Possible gains are 1) material and component savings 2) simpler and cheaper exteriors 3) stable and safe in-house infrastructure 4) whilst combined with local sustainable generation. That is the road ahead. 10.1109/DUE.2014.6827758
DOCUMENT
Objectives: To investigate immediate changes in walking performance associated with three implicit motor learning strategies and to explore patient experiences of each strategy. Design: Participants were randomly allocated to one of three implicit motor learning strategies. Within-group comparisons of spatiotemporal parameters at baseline and post strategy were performed. Setting: Laboratory setting. Subjects: A total of 56 community-dwelling post-stroke individuals. Interventions: Implicit learning strategies were analogy instructions, environmental constraints and action observation. Different analogy instructions and environmental constraints were used to facilitate specific gait parameters. Within action observation, only videotaped gait was shown. Main measures: Spatiotemporal measures (speed, step length, step width, step height) were recorded using Vicon 3D motion analysis. Patient experiences were assessed by questionnaire. Results: At a group level, three of the four analogy instructions (n=19) led to small but significant changes in speed (d=0.088m/s), step height (affected side d=0.006m) and step width (d=–0.019m), and one environmental constraint (n=17) led to significant changes in step width (d=–0.040m). At an individual level, results showed wide variation in the magnitude of changes. Within action observation (n=20), no significant changes were found. Overall, participants found it easy to use the different strategies and experienced some changes in their walking performance. Conclusion: Analogy instructions and environmental constraints can lead to specific, immediate changes in the walking performance and were in general experienced as feasible by the participants. However, the response of an individual patient may vary quite considerably.
DOCUMENT
A formal description of a database consists of the description of the relations (tables) of the database together with the constraints that must hold on the database. Furthermore the contents of a database can be retrieved using queries. These constraints and queries for databases can very well be formalized. A formal description of a constraint or a query is necessary to describe the constraint or query unambiguously. In other words, a formal description leads to one and only one meaning of the constraint or query. To describe constraints and queries in a formal way we use predicate logic, set theory and tuple relational calculus. The tuple relational calculus is a calculus based on the use of tuple variables. A tuple variable is a variable that ranges over a named relation (i.e. a set of tuples of a relation). This paper describes the use of the relational calculus for databases. A description of the formal notation is given as well as a mapping of these expressions to SQL.
DOCUMENT