Runs Spark with the master args(0)
.
Runs Spark with the master args(0)
. Assigns log messages stored in the file args(1)
into buckets by hour. Save the bucketed messages into HDFS, into the same directory as the input file.
args(2)
needs to be specified, but is currently unused. In the future,
it may be used to set the size of a bucket in minutes.
Command line arguments.
Bucket supercomputer logs (such as http://www.cs.sandia.gov/~jrstear/logs/) into hour buckets using the RunRDD class and BucketDetector.