spark.timeseries

HdfsRuns

object HdfsRuns extends AnyRef

A program to detect interesting non-idle portions of an energy measurement file and separate them into Runs. Write a file with the Runs. Assumes the file exists on a Hadoop DFS at hdfs://cloudtech11.hpc.cs.helsinki.fi:54310/user/lagerspe/fileName where fileName is given as a command line argument. Results are written to a file in the same HDFS directory.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. Hide All
  2. Show all
  1. HdfsRuns
  2. AnyRef
  3. Any
Visibility
  1. Public
  2. All

Value Members

  1. def != (arg0: AnyRef): Boolean

    Attributes
    final
    Definition Classes
    AnyRef

  2. def != (arg0: Any): Boolean

    Attributes
    final
    Definition Classes
    Any

  3. def ## (): Int

    Attributes
    final
    Definition Classes
    AnyRef → Any

  4. def == (arg0: AnyRef): Boolean

    Attributes
    final
    Definition Classes
    AnyRef

  5. def == (arg0: Any): Boolean

    Attributes
    final
    Definition Classes
    Any

  6. def ArrayRunMapper (run: Run[Double]): (Double, Double, Double, Double)

    Maps energy measurement runs into their (start, end, duration, total_energy) - tuples.

  7. def arrayTest (sc: SparkContext, fileName: String, idleThresh: String): RDD[(Double, Double, Double, Double)]

    runs ArrayRunMapper on Runs detected using the specified idleThresh from the file fileName.

    runs ArrayRunMapper on Runs detected using the specified idleThresh from the file fileName.

    fileName

    The file with energy data.

    idleThresh

    the threshold for activity.

  8. def asInstanceOf [T0] : T0

    Attributes
    final
    Definition Classes
    Any

  9. def clone (): AnyRef

    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws()

  10. def eq (arg0: AnyRef): Boolean

    Attributes
    final
    Definition Classes
    AnyRef

  11. def equals (arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  12. def finalize (): Unit

    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws()

  13. def getClass (): java.lang.Class[_]

    Attributes
    final
    Definition Classes
    AnyRef → Any

  14. def hashCode (): Int

    Definition Classes
    AnyRef → Any

  15. def isInstanceOf [T0] : Boolean

    Attributes
    final
    Definition Classes
    Any

  16. def main (args: Array[String]): Unit

    Program main entry point.

    Program main entry point. Takes the Spark master, the file name and the idle threshold as command line arguments.

    args

    Command line arguments.

  17. def ne (arg0: AnyRef): Boolean

    Attributes
    final
    Definition Classes
    AnyRef

  18. def notify (): Unit

    Attributes
    final
    Definition Classes
    AnyRef

  19. def notifyAll (): Unit

    Attributes
    final
    Definition Classes
    AnyRef

  20. def synchronized [T0] (arg0: ⇒ T0): T0

    Attributes
    final
    Definition Classes
    AnyRef

  21. def toString (): String

    Definition Classes
    AnyRef → Any

  22. def wait (): Unit

    Attributes
    final
    Definition Classes
    AnyRef
    Annotations
    @throws()

  23. def wait (arg0: Long, arg1: Int): Unit

    Attributes
    final
    Definition Classes
    AnyRef
    Annotations
    @throws()

  24. def wait (arg0: Long): Unit

    Attributes
    final
    Definition Classes
    AnyRef
    Annotations
    @throws()

Inherited from AnyRef

Inherited from Any