Package com.atgenomix.seqslab.piper.plugin.api.loader

Interface SupportsHadoopDFS

All Superinterfaces:
AutoCloseable, Closeable, Loader, Operator, OperatorPipelineV3, Serializable, org.apache.spark.sql.api.java.UDF0<Iterator<org.apache.spark.sql.Row>>
@DeveloperApi @FeatureBeforeCall public interface SupportsHadoopDFS extends Loader
A mix-in interface for Loader. Dataset loaders can implement this interface to indicate it supports reading files and directories from storages compatible with Hadoop Distributed File System. SeqsLab will try to obtain and pass hdfs://authority/path source URI when initializing the loader.

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    setConfiguration(Map<String,String> configuration)
    Sets Hadoop configuration

    Methods inherited from interface java.io.Closeable

    close

    Methods inherited from interface com.atgenomix.seqslab.piper.plugin.api.loader.Loader

    init, readSchema

    Methods inherited from interface com.atgenomix.seqslab.piper.plugin.api.Operator

    getName, getOperatorContext

    Methods inherited from interface org.apache.spark.sql.api.java.UDF0

    call

  • Method Details

    • setConfiguration

      void setConfiguration(Map<String,String> configuration)
      Sets Hadoop configuration
      Parameters:
      configuration - Configuration properties as a Map