BigSnarf blog

Infosec FTW

Monthly Archives: October 2014

Apache Spark Streaming and AWS Kinesis integration in version 1.1.0

Screen Shot 2014-10-11 at 2.06.17 AM

https://spark.apache.org/docs/latest/streaming-kinesis-integration.html

http://people.apache.org/~pwendell/spark-1.1.0-rc4-docs/streaming-kinesis.html

https://github.com/apache/spark/blob/master/extras/kinesis-asl/src/main/scala/org/apache/spark/examples/streaming/KinesisWordCountASL.scala

https://github.com/bigsnarfdude/spark/tree/master/extras/kinesis-asl