BigSnarf blog

Infosec FTW

Obsessed with my Kaggle score – it’s just a number

screen-shot-2016-09-22-at-11-14-07-pm

“a state in which someone thinks about something constantly or frequently especially in a way that is not normal”

screen-shot-2016-09-26-at-1-06-27-pm

Three models grid search on 2 ubuntu boxes with a GTX1070 each

screen-shot-2016-10-01-at-7-57-02-am

First model I used was a ConvNet (CNN) with multiple Recurrent (RNN) layers on top.

Apparently, this is a common structure NN in speech. The CCN–>RNN tries to exploit temporal relationships within the data. In addition with the 2D structure of the spectrograms.

Imagine for each vertical line in the spectrogram as a timestep, the RNN is an attempt to  model the relationships between those timesteps.

The second model, I ripped out the RNN and replaced it with LSTM.  The third model, I tried to increase the RNN layers.

The fourth model combines all the electrodes in batches of 64. Fifth model is straight MLP in Tensorflow and Sixth model is straight CNN Tensorflow.

img_4689

screen-shot-2016-10-14-at-12-16-23-am

AWS p2.xlarge is a pain, just to try out a pretrained VGG model need 12gb GPU

screen-shot-2016-10-14-at-3-43-05-pm

Bad Data – Leaderboard hackingScreen Shot 2016-10-27 at 3.12.04 AM.png

img_4707

screen-shot-2016-10-29-at-6-01-12-pm

screen-shot-2016-10-29-at-11-49-26-am

screen-shot-2016-10-29-at-7-56-51-pm

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: