Pipeline.SharedReadWrite$ (Spark 3.5.5 JavaDoc) (original) (raw)

• Object

• • org.apache.spark.ml.Pipeline.SharedReadWrite$

• Enclosing class:
  Pipeline

public static class Pipeline.SharedReadWrite$
extends Object

• • Field Summary

  Fields

  Modifier and Type	Field and Description
  static Pipeline.SharedReadWrite$	MODULE$ Static reference to the singleton instance of this Scala object.

  • Constructor Summary

  Constructors

  Constructor and Description
  SharedReadWrite$()

  • Method Summary

  All Methods Instance Methods Concrete Methods

  Modifier and Type	Method and Description
  String	getStagePath(String stageUid, int stageIdx, int numStages, String stagesDir) Get path for saving the given stage.
  scala.Tuple2<String,PipelineStage[]>	load(String expectedClassName,SparkContext sc, String path) Load metadata and stages for a Pipeline or PipelineModel
  void	saveImpl(Params instance,PipelineStage[] stages,SparkContext sc, String path) Save metadata and stages for a Pipeline or PipelineModel - save metadata to path/metadata - save stages to stages/IDX_UID
  void	validateStages(PipelineStage[] stages) Check that all stages are Writable

     * ### Methods inherited from class Object  
     `equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait`

• • Field Detail

     * #### MODULE$  
     public static final [Pipeline.SharedReadWrite$](../../../../org/apache/spark/ml/Pipeline.SharedReadWrite$.html "class in org.apache.spark.ml") MODULE$  
     Static reference to the singleton instance of this Scala object.  

  • Constructor Detail

    * #### SharedReadWrite$  
    public SharedReadWrite$()  

  • Method Detail

    * #### validateStages  
    public void validateStages([PipelineStage](../../../../org/apache/spark/ml/PipelineStage.html "class in org.apache.spark.ml")[] stages)  
    Check that all stages are Writable  
    * #### saveImpl  
    public void saveImpl([Params](../../../../org/apache/spark/ml/param/Params.html "interface in org.apache.spark.ml.param") instance,  
                         [PipelineStage](../../../../org/apache/spark/ml/PipelineStage.html "class in org.apache.spark.ml")[] stages,  
                         [SparkContext](../../../../org/apache/spark/SparkContext.html "class in org.apache.spark") sc,  
                         String path)  
    Save metadata and stages for a [Pipeline](../../../../org/apache/spark/ml/Pipeline.html "class in org.apache.spark.ml") or [PipelineModel](../../../../org/apache/spark/ml/PipelineModel.html "class in org.apache.spark.ml") \- save metadata to path/metadata - save stages to stages/IDX\_UID  
    Parameters:  
    `instance` \- (undocumented)  
    `stages` \- (undocumented)  
    `sc` \- (undocumented)  
    `path` \- (undocumented)  
    * #### load  
    public scala.Tuple2<String,[PipelineStage](../../../../org/apache/spark/ml/PipelineStage.html "class in org.apache.spark.ml")[]> load(String expectedClassName,  
                                                     [SparkContext](../../../../org/apache/spark/SparkContext.html "class in org.apache.spark") sc,  
                                                     String path)  
    Parameters:  
    `expectedClassName` \- (undocumented)  
    `sc` \- (undocumented)  
    `path` \- (undocumented)  
    Returns:  
    (UID, list of stages)  
    * #### getStagePath  
    public String getStagePath(String stageUid,  
                               int stageIdx,  
                               int numStages,  
                               String stagesDir)  
    Get path for saving the given stage.