Package com.atgenomix.seqslab.piper.plugin.api.loader

Interface SupportsScanPartitions

All Superinterfaces:
AutoCloseable, Closeable, Loader, Operator, OperatorPipelineV3, Serializable, org.apache.spark.sql.api.java.UDF0<Iterator<org.apache.spark.sql.Row>>
@DeveloperApi @FeatureBeforeCall public interface SupportsScanPartitions extends Loader
A mix-in interface for Loader. Dataset loaders can implement this interface to support transformation of partitioned datasets read by SeqsLab.

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    setPartition(Iterator<org.apache.spark.sql.Row> partition)
    Set the partition loaded by SeqsLab for applying Loader's call function.

    Methods inherited from interface java.io.Closeable

    close

    Methods inherited from interface com.atgenomix.seqslab.piper.plugin.api.loader.Loader

    init, readSchema

    Methods inherited from interface com.atgenomix.seqslab.piper.plugin.api.Operator

    getName, getOperatorContext

    Methods inherited from interface org.apache.spark.sql.api.java.UDF0

    call

  • Method Details

    • setPartition

      void setPartition(Iterator<org.apache.spark.sql.Row> partition)
      Set the partition loaded by SeqsLab for applying Loader's call function.
      Parameters:
      partition - Iterator for the partition