Interface SupportsSaveToBLOB

All Superinterfaces:
AutoCloseable, Closeable, Operator, OperatorPipelineV3, Serializable, org.apache.spark.sql.api.java.UDF2<org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>,Boolean,Void>, Writer

@DeveloperApi @FeatureBeforeCall public interface SupportsSaveToBLOB extends Writer
The mix-in interface for Writer. Dataset writers can implement this interface to support saving datasets to object storage; for instance, using df.write.format("delta").option("key", "value").save(path). This feature is invoked before applying Writer's call function.
  • Method Summary

    Modifier and Type
    Method
    Description
    save(String path)
    Sets the target storage path where the DataFrame will be saved.

    Methods inherited from interface java.io.Closeable

    close

    Methods inherited from interface com.atgenomix.seqslab.piper.plugin.api.Operator

    getName, getOperatorContext

    Methods inherited from interface org.apache.spark.sql.api.java.UDF2

    call

    Methods inherited from interface com.atgenomix.seqslab.piper.plugin.api.writer.Writer

    getDataSource, init
  • Method Details

    • save

      Writer save(String path)
      Sets the target storage path where the DataFrame will be saved.
      Parameters:
      path - target storage path
      Returns:
      The writer object itself