All Classes and Interfaces

Class	Description
Collector	The operator responsible for retrieving command outputs from local file system and returning a DataFrame.
CollectorSupport	Factory object responsible for creating Collector operators.
DataSource	The main interface responsible for representing an accessible data source in SeqsLab.
DeveloperApi	An API intended for developers.
Dimension	Indicates the computing resource requirements, types of workload and pipeline structures that an operator supports.
Dimensions	Indicates the computing resource requirements, types of workload and pipeline structures that an operator supports.
Executor	The operator responsible for preprocessing (localizing) input dataframe as a managed table for Spark SQL command or saving to local files for shell script execution.
ExecutorSupport	Factory object responsible for creating Executor operators.
FeatureAfterCall	An annotation indicates pipeline operator features that will be checked and invoked after calling operator function.
FeatureBeforeCall	An annotation indicates pipeline operator features that will be checked and invoked prior to calling operator function.
Formatter	An operator responsible for formatting input datasets, such as converting schema, adding or deleting columns, and encoding domain specific object.
FormatterSupport	Factory object responsible for creating Formatter operators.
Loader	The operator responsible for loading (reading) a dataset into in-memory DataFrame or copying to local host file system from a specific data source, e.g.
LoaderSupport	Factory object responsible for creating Loader operators.
Operator	An operator that processes Spark DataFrame and produces a new DataFrame.
OperatorContext	An object used in pipeline operations to represent a persistent set of properties, inputs, and outputs.
OperatorPipelineV3	The base contract interface for SeqsLab operator pipeline v3.
Pipeline	An interface represents a complete configuration of workflow task including input parameters, dataset connection, as well as localization, computation, and delocalization workload processes.
PipelineTask	An interface represents the localization, computation, and delocalization workload processes in a pipeline task of a given variable identified by FQN (Fully Qualified Name).
PiperContext	An object used in all operations of a workflow task execution.
PiperPlugin	A plugin that can be dynamically loaded into a SeqsLab piper application.
PiperValue	An interface represents value of primitive types, e.g.
PiperValue.Type	Concrete types of all supported workflow parameters
PluginContext	An object returned when initializing this SeqsLab piper.
SupportsAggregation	A mix-in interface for Collector.
SupportsCopyToLocal	A mix-in interface for Loader.
SupportsFileLocalization	A mix-in interface for Executor.
SupportsGroupWithinPartitions	A mix-in interface for Transformer.
SupportsHadoopDFS	A mix-in interface for Loader.
SupportsOrdering	A mix-in interface for Transformer.
SupportsReadPartitions	A mix-in interface for Loader.
SupportsRepartitioning	A mix-in interface for Collector.
SupportsSaveToBLOB	The mix-in interface for Writer.
SupportsSaveToHTTP	The mix-in interface for Writer.
SupportsSaveToJDBC	The mix-in interface for Writer.
SupportsScanPartitions	A mix-in interface for Loader.
SupportsTableLocalization	A mix-in interface for Executor.
SupportsUDF1<T1,R>	A mix-in interface for Formatter.
SupportsUDF2<T1,T2,R>	A mix-in interface for Formatter.
SupportsUDF3<T1,T2,T3,R>	A mix-in interface for Formatter.
SupportsUDF4<T1,T2,T3,T4,R>	A mix-in interface for Formatter.
SupportsUDF5<T1,T2,T3,T4,T5,R>	A mix-in interface for Formatter.
Transformer	The operator responsible for repartitioning, and additionally sorting, DataFrames loaded by Loader to optimize downstream data processing.
TransformerSupport	Factory object responsible for creating Transformer operators.
Writer	The operator responsible for delocalizing/saving command output DataFrame to storage or repositories, e.g.
WriterSupport	Factory object responsible for creating Writer operators.