BigSnarf blog

Infosec FTW

Monthly Archives: June 2014

D3.js – Crossfilter – Chart Porn

MetaDATA BigDATA

metaDATA

bigDATA

IPython Notebook, Apache Spark, Honeynet Forensic Challenge 10

Screen Shot 2014-06-14 at 9.51.47 AM

Screen Shot 2014-06-14 at 9.51.59 AM

 

 Get the code: 

https://github.com/bigsnarfdude/PythonSystemAdminTools/blob/master/auth_log_analysis_spark.ipynb

View Online:

http://nbviewer.ipython.org/github/bigsnarfdude/PythonSystemAdminTools/blob/master/auth_log_analysis_spark.ipynb

View the Forensic Challenge:

https://www.honeynet.org/node/781

FC5 Dataset

http://honeynet.org/files/sanitized_log.zip

Hello World – Analysis of StackOverflow dataset using Apache Spark Job Server

Screen Shot 2014-06-13 at 8.32.54 PM

curl --data-binary @target/scala-2.10/spark-jobserver-examples_2.10-1.0.0.jar localhost:8090/jars/sparking
curl 'localhost:8090/jars'
curl 'localhost:8090/contexts'
curl -X POST 'localhost:8090/contexts/users-context'
curl -X POST 'localhost:8090/jobs?appName=sparking&classPath=sparking.jobserver.GetOrCreateUsers&context=users-context'
curl 'localhost:8090/jobs/<insertJobNumberHere>'

https://github.com/bigsnarfdude/spark-jobserver-examples

Cisco enters the big data security analytics with OpenSOC

Screen Shot 2014-06-13 at 4.39.41 PM

Using machine learning for anomaly detection is not new but …