Chicago-Style Deep Learning

by allenlu2007

 

所謂的 Chicago style deep learning 其實就是簡化的標準 deep learning net.

沒有 pooling layer, 也沒有 normal contrast layer (black and white)

A feed-forward network of DAG (directed acyclic graph).  

藍色是定值。橙色是 dynamic data (weight and bias)。灰色是 function.

NewImage

 

Forward Prop

General description

NewImage

 

NewImage

NewImage

 

Backward Prop

NewImage

NewImage

NewImage

 

ReLU

Forward prop

NewImage

Backward prop

NewImage

 

 

Dense (fully connected)

 

NewImage

NewImage

NewImage

NewImage

NewImage

NewImage

 

 

 

 

 

 

 

 

 

 

 

Advertisements