loadLearnerForCoder - Reconstruct model object from saved model for code generation - MATLAB (original) (raw)

Reconstruct model object from saved model for code generation

Syntax

Description

To generate C/C++ code for the object functions of machine learning models (including predict, random,knnsearch, rangesearch,isanomaly, and incremental learning functions), use saveLearnerForCoder, loadLearnerForCoder, andcodegen (MATLAB Coder). After training a machine learning model, save the model by using saveLearnerForCoder. Define an entry-point function that loads the model by usingloadLearnerForCoder and calls an object function. Then usecodegen or the MATLAB® Coder™ app to generate C/C++ code. Generating C/C++ code requires MATLAB Coder.

For functions that support single-precision C/C++ code generation, use saveLearnerForCoder, loadLearnerForCoder, andcodegen (MATLAB Coder); specify the name-value argument'DataType','single' when you call theloadLearnerForCoder function.

This flow chart shows the code generation workflow for the object functions of machine learning models. Use loadLearnerForCoder for the highlighted step.

Code generation workflow for the object function of a machine learning model. Step 1: Train a model. Step 2: Save the model. Step 3 (highlighted): Define an entry-point function. Step 4: Generate code. Step 5: Verify the generated code.

Fixed-point C/C++ code generation requires an additional step that defines the fixed-point data types of the variables required for prediction. Create a fixed-point data type structure by using the data type function generated by generateLearnerDataTypeFcn, and use the structure as an input argument of loadLearnerForCoder in an entry-point function. Generating fixed-point C/C++ code requires MATLAB Coder and Fixed-Point Designer™.

This flow chart shows the fixed-point code generation workflow for thepredict function of a machine learning model. UseloadLearnerForCoder for the highlighted step.

Fixed-point code generation workflow. Step 1: Train a model. Step 2: Save the model. Step 3: Define the fixed-point data types. Step 4 (highlighted): Define an entry-point function. Step 5 (optional): Optimize the fixed-point data types. Step 6: Generate code. Step 7: Verify the generated code.

[Mdl](#bvcl05n-1-CompactMdl) = loadLearnerForCoder([filename](#bvcl05n-1-filename)) reconstructs a model (Mdl) from the model stored in the MATLAB formatted binary file (MAT file) named filename. You must create the filename file by using saveLearnerForCoder.

example

[Mdl](#bvcl05n-1-CompactMdl) = loadLearnerForCoder([filename](#bvcl05n-1-filename),'DataType','single') reconstructs a single-precision model (Mdl) from the model stored in the MATLAB formatted binary file (MAT file) namedfilename.

example

[Mdl](#bvcl05n-1-CompactMdl) = loadLearnerForCoder([filename](#bvcl05n-1-filename),'DataType',[T](#mw%5F78b80ada-e975-4178-bbae-9a42362f4e64)) returns a fixed-point version of the model stored in filename. The structure T contains the fields that specify the fixed-point data types for the variables required to use the predict function of the model. Create T using the function generated by generateLearnerDataTypeFcn.

Use this syntax in an entry-point function, and use codegen to generate fixed-point code for the entry-point function. You can use this syntax only when generating code.

example

Examples

collapse all

After training a machine learning model, save the model by using saveLearnerForCoder. Define an entry-point function that loads the model by using loadLearnerForCoder and calls the predict function of the trained model. Then use codegen (MATLAB Coder) to generate C/C++ code.

This example briefly explains the code generation workflow for the prediction of machine learning models at the command line. For more details, see Code Generation for Prediction of Machine Learning Model at Command Line. You can also generate code using the MATLAB Coder app. See Code Generation for Prediction of Machine Learning Model Using MATLAB Coder App for details. To learn about the code generation for finding nearest neighbors using a nearest neighbor searcher model, see Code Generation for Nearest Neighbor Searcher.

Train Model

Load Fisher's iris data set. Remove all observed setosa irises data so that X and Y contain data for two classes only.

load fisheriris inds = ~strcmp(species,'setosa'); X = meas(inds,:); Y = species(inds);

Train a support vector machine (SVM) classification model using the processed data set.

Mdl is a ClassificationSVM object, which is a linear SVM model. The predictor coefficients in a linear SVM model provide enough information to predict labels for new observations. Removing the support vectors reduces memory usage in the generated code. Remove the support vectors from the linear SVM model by using the discardSupportVectors function.

Mdl = discardSupportVectors(Mdl);

Save Model

Save the SVM classification model to the file SVMIris.mat by using saveLearnerForCoder.

saveLearnerForCoder(Mdl,'SVMIris');

Define Entry-Point Function

Define an entry-point function named classifyIris that does the following:

Accept iris flower measurements with columns corresponding to meas, and return predicted labels.
Load a trained SVM classification model.
Predict labels using the loaded classification model for the iris flower measurements.

function label = classifyIris(X) %#codegen %CLASSIFYIRIS Classify iris species using SVM Model % CLASSIFYIRIS classifies the iris flower measurements in X using the SVM % model in the file SVMIris.mat, and then returns class labels in label. Mdl = loadLearnerForCoder('SVMIris'); label = predict(Mdl,X); end

Add the %#codegen compiler directive (or pragma) to the entry-point function after the function signature to indicate that you intend to generate code for the MATLAB algorithm. Adding this directive instructs the MATLAB Code Analyzer to help you diagnose and fix violations that would result in errors during code generation.

Note: If you click the button located in the upper-right section of this example and open this example in MATLAB®, then MATLAB® opens the example folder. This folder includes the entry-point function file.

Generate Code

Generate code for the entry-point function using codegen (MATLAB Coder). Because C and C++ are statically typed languages, you must determine the properties of all variables in the entry-point function at compile time. Pass X as the value of the -args option to specify that the generated code must accept an input that has the same data type and array size as the training data X. If the number of observations is unknown at compile time, you can also specify the input as variable-size by using coder.typeof (MATLAB Coder). For details, see Specify Variable-Size Arguments for Code Generation and Specify Types of Entry-Point Function Inputs (MATLAB Coder).

codegen classifyIris -args {X}

Code generation successful.

codegen generates the MEX function classifyIris_mex with a platform-dependent extension.

Verify Generated Code

Compare the labels classified using predict, classifyIris, and classifyIris_mex.

label1 = predict(Mdl,X); label2 = classifyIris(X); label3 = classifyIris_mex(X); verify_label = isequal(label1,label2,label3)

isequal returns logical 1 (true), which means all the inputs are equal. The labels classified all three ways are the same.

This example briefly explains the single-precision code generation workflow for the prediction of machine learning models at the command line. For more details, see Code Generation for Prediction of Machine Learning Model at Command Line. You can also generate code using the MATLAB Coder app. See Code Generation for Prediction of Machine Learning Model Using MATLAB Coder App for details.

Train Model

Load the fisheriris data set. Create X as a numeric matrix that contains four measurements for 150 irises. Create Y as a cell array of character vectors that contains the corresponding iris species.

load fisheriris X = meas; Y = species;

Train a naive Bayes classifier using predictors X and class labels Y.

Mdl is a trained ClassificationNaiveBayes classifier.

Save Model

Save the naive Bayes classification model to the file naiveBayesIris.mat by using saveLearnerForCoder.

saveLearnerForCoder(Mdl,'naiveBayesIris');

Define Entry-Point Function

Define an entry-point function named classifyIrisSingle that does the following:

Accept iris flower measurements with columns corresponding to petal measurements, and return predicted labels.
Load a trained naive Bayes classification model.
Predict labels using the single-precision loaded classification model for the iris flower measurements.

type classifyIrisSingle.m

function label = classifyIrisSingle(X) %#codegen % CLASSIFYIRISSINGLE Classify iris species using single-precision naive % Bayes model % CLASSIFYIRISSINGLE classifies the iris flower measurements in X using the % single-precision naive Bayes model in the file naiveBayesIris.mat, and % then returns the predicted labels in label. Mdl = loadLearnerForCoder('naiveBayesIris','DataType','single'); label = predict(Mdl,X); end

Note: If you click the button located in the upper-right section of this example and open this example in MATLAB, then MATLAB opens the example folder. This folder includes the entry-point function file.

Generate Code

Xpred = single(X); codegen classifyIrisSingle -args Xpred

Code generation successful.

codegen generates the MEX function classifyIrisSingle_mex with a platform-dependent extension.

Verify Generated Code

Compare the labels classified using predict, classifyIrisSingle, and classifyIrisSingle_mex.

label1 = predict(Mdl,X); label2 = classifyIrisSingle(X); label3 = classifyIrisSingle_mex(Xpred); verify_label = isequal(label1,label2,label3)

isequal returns logical 1 (true), which means all the inputs are equal. The labels classified all three ways are the same. If the generated MEX function classifyIrisSingle_mex and the function predict do not produce the same classification results, you can compute the percentage of incorrectly classified labels.

sum(strcmp(label3,label1)==0)/numel(label1)*100

After training a machine learning model, save the model using saveLearnerForCoder. For fixed-point code generation, specify the fixed-point data types of the variables required for prediction by using the data type function generated by generateLearnerDataTypeFcn. Then, define an entry-point function that loads the model by using both loadLearnerForCoder and the specified fixed-point data types, and calls the predict function of the model. Use codegen (MATLAB Coder) to generate fixed-point C/C++ code for the entry-point function, and then verify the generated code.

Before generating code using codegen, you can use buildInstrumentedMex (Fixed-Point Designer) and showInstrumentationResults (Fixed-Point Designer) to optimize the fixed-point data types to improve the performance of the fixed-point code. Record minimum and maximum values of named and internal variables for prediction by using buildInstrumentedMex. View the instrumentation results using showInstrumentationResults; then, based on the results, tune the fixed-point data type properties of the variables. For details regarding this optional step, see Fixed-Point Code Generation for Prediction of SVM.

Train Model

Load the ionosphere data set and train a binary SVM classification model.

load ionosphere Mdl = fitcsvm(X,Y,'KernelFunction','gaussian');

Mdl is a ClassificationSVM model.

Save Model

Save the SVM classification model to the file myMdl.mat by using saveLearnerForCoder.

saveLearnerForCoder(Mdl,'myMdl');

Define Fixed-Point Data Types

Use generateLearnerDataTypeFcn to generate a function that defines the fixed-point data types of the variables required for prediction of the SVM model.

generateLearnerDataTypeFcn('myMdl',X)

generateLearnerDataTypeFcn generates the myMdl_datatype function.

Create a structure T that defines the fixed-point data types by using myMdl_datatype.

T = myMdl_datatype('Fixed')

T = struct with fields: XDataType: [0×0 embedded.fi] ScoreDataType: [0×0 embedded.fi] InnerProductDataType: [0×0 embedded.fi]

The structure T includes the fields for the named and internal variables required to run the predict function. Each field contains a fixed-point object, returned by fi (Fixed-Point Designer). The fixed-point object specifies fixed-point data type properties, such as word length and fraction length. For example, display the fixed-point data type properties of the predictor data.

ans =

[]

      DataTypeMode: Fixed-point: binary point scaling
        Signedness: Signed
        WordLength: 16
    FractionLength: 14

    RoundingMethod: Floor
    OverflowAction: Wrap
       ProductMode: FullPrecision

MaxProductWordLength: 128 SumMode: FullPrecision MaxSumWordLength: 128

Define Entry-Point Function

Define an entry-point function named myFixedPointPredict that does the following:

Accept the predictor data X and the fixed-point data type structure T.
Load a fixed-point version of a trained SVM classification model by using both loadLearnerForCoder and the structure T.
Predict labels and scores using the loaded model.

function [label,score] = myFixedPointPredict(X,T) %#codegen Mdl = loadLearnerForCoder('myMdl','DataType',T); [label,score] = predict(Mdl,X); end

Note: If you click the button located in the upper-right section of this example and open the example in MATLAB®, then MATLAB opens the example folder. This folder includes the entry-point function file.

Generate Code

The XDataType field of the structure T specifies the fixed-point data type of the predictor data. Convert X to the type specified in T.XDataType by using the cast (Fixed-Point Designer) function.

X_fx = cast(X,'like',T.XDataType);

Generate code for the entry-point function using codegen. Specify X_fx and constant folded T as input arguments of the entry-point function.

codegen myFixedPointPredict -args {X_fx,coder.Constant(T)}

Code generation successful.

codegen generates the MEX function myFixedPointPredict_mex with a platform-dependent extension.

Verify Generated Code

Pass predictor data to predict and myFixedPointPredict_mex to compare the outputs.

[labels,scores] = predict(Mdl,X); [labels_fx,scores_fx] = myFixedPointPredict_mex(X_fx,T);

Compare the outputs from predict and myFixedPointPredict_mex.

verify_labels = isequal(labels,labels_fx)

verify_labels = logical 1

isequal returns logical 1 (true), which means labels and labels_fx are equal.

If you are not satisfied with the comparison results and want to improve the precision of the generated code, you can tune the fixed-point data types and regenerate the code. For details, see Tips in generateLearnerDataTypeFcn, Data Type Function, and Fixed-Point Code Generation for Prediction of SVM.

Input Arguments

collapse all

Name of the MAT file that contains the structure array representing a model object, specified as a character vector or string scalar. You must create the filename file using saveLearnerForCoder.loadLearnerForCoder reconstructs the model stored in thefilename file at compile time.

The extension of the filename file must be.mat. If filename has no extension, then loadLearnerForCoder appends.mat.

If filename does not include a full path, thenloadLearnerForCoder loads the file from the current folder.

The following tables show the models you can save usingsaveLearnerForCoder and whether each model supports fixed-point and single-precision code generation.

Classification Model Object

Nearest Neighbor Searcher Object

Model	Model Object	Fixed-Point Code Generation Support	Single-Precision Code Generation Support
Exhaustive nearest neighbor searcher	ExhaustiveSearcher	No	No
Nearest neighbor searcher using _K_d-tree	KDTreeSearcher	No	No

Anomaly Detection Object

Model Model Object Fixed-Point Code Generation Support Single-Precision Code Generation Support

Isolation forest IsolationForest No Yes

One-class SVM OneClassSVM No Yes

Model	Model Object	Fixed-Point Code Generation Support	Single-Precision Code Generation Support
Isolation forest	IsolationForest	No	Yes
One-class SVM	OneClassSVM	No	Yes

Example: 'Mdl'

Data Types: char | string

Fixed-point data types, specified as a structure. This argument is for fixed-point C/C++ code generation.

Create T using a function generated by generateLearnerDataTypeFcn. For details about the generated function and the structure T, see generateLearnerDataTypeFcn and Data Type Function.

You can use this argument when the model in the filename file is an SVM model, a decision tree model, and an ensemble of decision trees.

Data Types: struct

Output Arguments

Limitations

When Mdl is CompactLinearModel —Suppose you train a linear model by using fitlm and specifying 'RobustOpts' as a structure with an anonymous function handle for theRobustWgtFun field, use saveLearnerForCoder to save the model, and then useloadLearnerForCoder to load the model. In this case, loadLearnerForCoder cannot restore the Robust property into the MATLAB Workspace. However, loadLearnerForCoder can load the model at compile time within an entry-point function for code generation.
When Mdl is CompactClassificationSVM orCompactClassificationECOC — If you usesaveLearnerForCoder to save a model that is equipped to predict posterior probabilities, and use loadLearnerForCoder to load the model, then loadLearnerForCoder cannot restore theScoreTransform property into the MATLAB Workspace. However, loadLearnerForCoder can load the model, including the ScoreTransform property, within an entry-point function at compile time for code generation.

Tips

For single-precision code generation for a Gaussian process regression (GPR) model or a support vector machine (SVM) model, use standardized data by specifying 'Standardize',true when you train the model.

Algorithms

saveLearnerForCoder prepares a machine learning model (Mdl) for code generation. The function removes some unnecessary properties.

For a model that has a corresponding compact model, thesaveLearnerForCoder function applies the appropriatecompact function to the model before saving it.
For a model that does not have a corresponding compact model, such asClassificationKNN, ClassificationKernel,ClassificationLinear, RegressionKernel,RegressionLinear, ExhaustiveSearcher,KDTreeSearcher, IsolationForest, andOneClassSVM, the saveLearnerForCoder function removes properties such as hyperparameter optimization properties, training solver information, and others.

loadLearnerForCoder loads the model saved bysaveLearnerForCoder.

Alternative Functionality

Use a coder configurer created by learnerCoderConfigurer for the models listed in this table.
After training a machine learning model, create a coder configurer of the model. Use the object functions and properties of the configurer to configure code generation options and to generate code for the predict and update functions of the model. If you generate code using a coder configurer, you can update model parameters in the generated code without having to regenerate the code. For details, see Code Generation for Prediction and Update Using Coder Configurer.

Extended Capabilities

Version History

Introduced in R2019b