BigSnarf blog

Infosec FTW

Category Archives: Tools

Compile Apache Spark with Kinesis Support

Creating Kinesis Stream in pictures

 

signInAWSconsole

 

 

logInScreenKinesis

awsLandingPage

createStreamButton

createKinesisEventStream

waitingCreatingStreem

streamCreatedFeedback

 

Netflix Security tool – FIDO

fido-scoring

FIDO is an orchestration layer that automates the incident response process by evaluating, assessing and responding to malware and other detected threats.

http://techblog.netflix.com/2015/05/introducing-fido-automated-security.html

Tracking attackers using heatmap visualization with Google Maps v3 and Heatmap Layer

Screen Shot 2015-05-07 at 9.02.12 AM

Tools to assess hacked machines

JSON ETL to Parquet using Apache Spark

Process logs with Kinesis, S3, Apache Spark on EMR, Amazon RDS

Apache Spark Streaming and AWS Kinesis integration in version 1.1.0

OpenSOC Machine Learning

Screen Shot 2014-09-26 at 3.26.58 PM Screen Shot 2014-09-26 at 3.23.34 PM Screen Shot 2014-09-26 at 3.22.05 PM Screen Shot 2014-09-26 at 3.20.43 PM

Self Hosted Maven repo on S3

s3cmd mb s3://www.example.mavenrepo
s3cmd ws-create s3://www.example.mavenrepo
mkdir com
cd com
mkdir amazonaws
cd amazonaws/
mkdir amazon-kinesis-connector
cd amazon-kinesis-connector
mkdir 1.0.0
cd com/amazonaws/amazon-kinesis-connector/1.0.0/
s3cmd -P sync /home/ubuntu/com/amazonaws/amazon-kinesis-connector/1.0.0 s3://www.example.mavenrepo/snapshots/com/amazonaws/amazon-kinesis-connector/1.0.0/



"AWS Snapshots" at "http://www.example.mavenrepo.s3.amazonaws.com/snapshots"

			
Follow

Get every new post delivered to your Inbox.

Join 50 other followers