Home

APS
Downloads
Buy APS

Support
Register
Contact us

Knowledge Base of APS

Subscribe to the GEPList
 
Visit GEP

 

The APS Environment

Report
 
The Report Panel of APS 3.0 keeps a summary of all the relevant information of a run, organized into the following headings:

Comments
This heading is usually used to give a small description of the problem, the objectives, the kind of data used, their source, etc. Both the comments and the author's name are introduced by choosing Properties in the Run menu.

Statistics – Training
Under this heading are listed the values of all statistical functions used by APS 3.0 to evaluate the accuracy of your model on the training set. Depending on the problem category, these statistics include: mean squared error, root mean squared error, mean absolute error, relative squared error, root relative squared error, relative absolute error, correlation coefficient, R-square, classification error, classification accuracy, confusion matrix (true positives, true negatives, false positives, and false negatives), sensitivity, specificity, positive predictive value, and negative predictive value.

Also listed under this heading are more general run parameters such as best fitness, maximum fitness, number of calculation errors (they should always be zero, unless the seed was modified or the training set was changed after the model had been created), and number of outliers (when the fitness function is one of the following: Relative with SR, Relative/Hits, Absolute with SR, and Absolute/Hits).

A note of warning, though: All the parameters listed here refer to the model last evaluated in the Results Panel, so make sure that they do refer to the model you are interested in (usually the active model, highlighted in yellow in the History heading).

Statistics – Testing
Under this heading are listed the values of all statistical functions used by APS 3.0 to evaluate the accuracy of your model on the testing set, that is, the efficiency of your model at predicting unknown behavior. Depending on the problem category, these statistics include: mean squared error, root mean squared error, mean absolute error, relative squared error, root relative squared error, relative absolute error, correlation coefficient, R-square, classification error, classification accuracy, confusion matrix (true positives, true negatives, false positives, and false negatives), sensitivity, specificity, positive predictive value, and negative predictive value.

Also listed under this heading are more general run parameters such as best fitness, maximum fitness, number of calculation errors, and number of outliers (when the fitness function is one of the following: Relative with SR, Relative/Hits, Absolute with SR, and Absolute/Hits).

Note again that all the parameters listed here refer to the model last evaluated in the Results Panel, so make sure that they do refer to the model you are interested in (usually the active model, highlighted in yellow in the History heading).

Data
Under this heading are listed the number of samples in the training set actually used during training (remember that APS 3.0 allows you to choose a smaller sub-set of the training set to use during training), the number of testing samples used to test the generalizing capabilities of your model (again, not all the samples on the testing set were necessarily used to test your model), and the number of terminals or independent variables in your data.

Function Set
Under this heading are listed all the functions used to create your model, together with the symbols used to represent them in Karva notation, their weights and arities.

Note that the highest value of arity in your function set determines the structure of each gene, making the length of the tail t grow according to the equation:

t = h (n-1) + 1

where h is the length of the head and n is maximum arity.

Settings
Under this heading there are five entries: General Settings, Complexity Increase, Fitness Function, Genetic Operators, and Numerical Constants. Under General Settings are listed the number of chromosomes, number of genes, head size, and linking function. Under Complexity Increase are listed the number of Generations Without Change, the Number of Tries, and Max. Complexity. The name of the fitness function and all the relevant parameters for its design are given below the entry Fitness Function. Under Genetic Operators are listed the rates of all the genetic operators used to create genetic variation. And, finally, all the parameters relevant to the manipulation of random numerical constants are listed under Numerical Constants.

Data Sources
Under this heading the paths to the input files (training and testing files) used to create your model are given so that their origin could be easily identified.

File Path
Under this heading the path to the gep file that was used to save your model is given so that it can be easily traced for future reference.

History
Under this heading are listed all the best-of-generation models, including obviously the best-of-run model, discovered during the evolutionary process. Note, however, that the notation "best-of-run" and "best-of-generation" refers to the performance of these models on the training set, which could be slightly different on the testing set. This is why APS 3.0 allows you to analyze the performance of all these models on the testing set and, if appropriate, choose the best model based on these results. APS 3.0 gives you the possibility of highlighting in yellow one of these models (the active model) and we advise you to use this feature to highlight the best one. Note also that, for a quick reference, the fitness and the R-square of all these models obtained both on the training and testing sets are also given, although, for the testing set, they must be evaluated in the History Panel.

For brevity sake, all the best-of-generation models are represented in the compact Karva notation, but you can translate any one of them into a more canonical representation by activating any of these models in the History Panel and then translate it into the language of your choice in the Model Panel.

Home | Contents | Previous | Next