Visualizing Bar Chart Data Using iPython Notebook with d3.js

 

https://github.com/dgleebits/PythonSystemAdminTools/blob/master/d3jsBarChart.ipynb

Great visualization and drill down capability with this d3.js based library

http://nickqizhu.github.com/dc.js/

Analyzing DNS records with iPython Pandas and Matplotlib – 2 methods

 

http://nbviewer.ipython.org/urls/raw.github.com/dgleebits/PythonSystemAdminTools/master/pandasAuthLogAnalysis.ipynb

http://nbviewer.ipython.org/github/ClickSecurity/data_hacking/blob/master/dga_detection/DGA_Domain_Detection.ipynb

Installing CDH4 Hadoop cluster on CentOS from scratch with Cloudera Manager 4

Step 1 – Obtain software and prep hardware:

• Macbook Pro with 8GB ram
• VMware Fusion Version 3.1.4 (683826)
• Download CentOS-6.2-x86_64-LiveDVD.iso
• Watch http://www.youtube.com/watch?v=CobVqNMiqww&feature=player_detailpage
• Documents http://www.centos.org/docs/5/html/Deployment_Guide-en-US/ch-networkscripts.html

Step 2 – Install CentOS6 from iso in Fusion

Step 3 – Set up networking

1. configure networking

a) vi /etc/resolv.conf # add lines
search example.com
nameserver 192.168.1.254

b) vi /etc/sysconfig/network # add lines
NETWORKING=YES
HOSTNAME=n1.example.com
GATEWAY=192.168.1.254

c) vi /etc/sysconfig/network-scripts/ifcfg-eth0 # add lines
DEVICE=eth0
ONBOOT=yes
PROTO=static
IPADDR=192.168.1.201
NETMASK=255.255.255.0
DNS1=192.168.1.254

d) vi /etc/sysconfig/network-scripts/ifcfg-eth1 # add lines
DEVICE=eth1
ONBOOT=yes
PROTO=static
IPADDR=192.168.1.202
NETMASK=255.255.255.0
DNS1=192.168.1.254

e) vi /etc/hosts # add lines
192.168.1.201 n1.example.com n1
192.168.1.202 n2.example.com n2
192.168.1.203 n3.example.com n3
192.168.1.204 n4.example.com n4

f) /etc/init.d/network restart

2. turn off firewall
a) chkconfig iptables off

3. turn off selinux
a) vi /etc/selinux/config # from enabled to disabled

4. test network connectivity to remote host,n1,n2,n3 and n4

5. turn off yum fast mirror fetch
a) vi /etc/yum/pluginconf.d/fastestmirror.conf #disable with 0

6. install vmware tools
mount /dev/cdrom /media
cd /media
cp VMwareTools-<xxxx>.tar.gz /tmp
cd /tmp
tar zxvf VMwareTools-<xxxx>.tar.gz
cd /vmware-tools-distrib
./vmware-install.pl -d

Step 4 – Commit Firewall Disable

Step 5 – Reboot

Step 6 – su root and edit /etc/resolv.conf

 

Step 7 – edit /etc/sysconfig/network

Step 8 – edit selinux config and change selinux=disabled

curl -O http://archive.cloudera.com/cm4/installer/latest/cloudera-manager-installer.bin