Package

software.uncharted.sparkpipe.ops.core

rdd

Permalink

package rdd

Common operations for manipulating RDDs

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. rdd
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. def cache[A](rdd: RDD[A]): RDD[A]

    Permalink

    cache() the specified RDD

    cache() the specified RDD

    returns

    the input RDD, after calling cache()

  2. object docs

    Permalink

    Stub object necessary due to https://issues.scala-lang.org/browse/SI-8124

    Stub object necessary due to https://issues.scala-lang.org/browse/SI-8124

    Documentation for ops.core.rdd can be found at software.uncharted.sparkpipe.ops.core.rdd

    Attributes
    protected[this]
    See also

    software.uncharted.sparkpipe.ops.core.rdd

  3. package io

    Permalink

    Input/output operations for RDDs, based on the SparkContext.textFile API

  4. def toDF[A <: Product](sparkSession: SparkSession)(rdd: RDD[A])(implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[A]): DataFrame

    Permalink

    Convert a suitable RDD to a DataFrame

    Convert a suitable RDD to a DataFrame

    A

    The record type of the RDD. Must be <: Product

    sparkSession

    a SparkSession

    rdd

    the input RDD

    returns

    a DataFrame constructed from rdd

Inherited from AnyRef

Inherited from Any

Ungrouped