Class

com.actian.spark_vector.vector.VectorOps

VectorRDDOps

Related Doc: package VectorOps

Permalink

implicit class VectorRDDOps extends AnyRef

Wrapper class to expose Vector operations on RDDs

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. VectorRDDOps
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new VectorRDDOps(rdd: RDD[Row])

    Permalink

    rdd

    input RDD

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  10. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  11. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  12. def loadVector(schema: StructType, tableColumnMetadata: Seq[ColumnMetadata], writeConf: VectorEndpointConf): Unit

    Permalink

    Load into a Vector table from the given RDD.

    Load into a Vector table from the given RDD.

    This method should be used when the VectorEndpointConf is known ahead of time (e.g. was communicated through a separate channel)

    schema

    RDD schema

    tableColumnMetadata

    A list of ColumnMetadata structures, one for each column of the given table describing the schema of the Vector table

    writeConf

    Write configuration to be used to connect to the DataStream API

  13. def loadVector(schema: StructType, vectorProps: VectorConnectionProperties, table: String, preSQL: Option[Seq[String]] = None, postSQL: Option[Seq[String]] = None, fieldMap: Option[Map[String, String]] = None, createTable: Boolean = false): Long

    Permalink

    Load a target Vector table from this RDD.

    Load a target Vector table from this RDD.

    schema

    Input RDD schema

    vectorProps

    connection properties to the Vector instance

    table

    name of the table to load

    preSQL

    set of SQL statements to execute before loading begins

    postSQL

    set of SQL statements to run after loading completes successfully. This SQL is executed only if the load works. The load is not rolled back if executing the postSQL fails.

    fieldMap

    map of input field names to target columns (optional)

    createTable

    if true, generates and executes a SQL create table statement based on the RDD schema

    returns

    a LoaderResult instance which contains results of the load operation

  14. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  15. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  16. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  17. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  18. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  19. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  20. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  21. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped