[Pose Estimation] Pose Estimation & Heatmap 관련 Git & 논문

 

 

Pose Estimation 관련 Git

 

 

 

 

DeeperCut Part Detectors :: https://github.com/eldar/deepcut-cnn (Caffe)

 

관련 논문 : 

[1] DeeperCut: A Deeper, Stronger, and Faster Multi-Person Pose Estimation Model

[2] DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimation

 

 

 

 

 

 

 

DeepPose (Stg-1) on TensorFlow ::  https://github.com/asanakoy/deeppose_tf

asanakoy/deeppose_tf

관련 논문 :  

[1] DeepPose: Human Pose Estimation via Deep Neural Networks

DeepPose: Human Pose Estimation via Deep Neural Networks

 

 

 

 

 

 

 

 

 

 

 

 

Human Pose Estimation by Deep Learning :: 

https://github.com/HYPJUDY/human-pose-estimation-by-deep-learning 

HYPJUDY/human-pose-estimation-by-deep-learning

 

A simple regression based implementation/VGG16 of pose estimation with tensorflow

 

drawing image 01060538.png
coordinate of point # 1 : ( 137 , 68 )
coordinate of point # 2 : ( 136 , 80 )
coordinate of point # 3 : ( 138 , 105 )
coordinate of point # 4 : ( 121 , 90 )
coordinate of point # 5 : ( 107 , 102 )
coordinate of point # 6 : ( 87 , 114 )
coordinate of point # 7 : ( 152 , 90 )
coordinate of point # 8 : ( 168 , 105 )
coordinate of point # 9 : ( 189 , 118 )
coordinate of point # 10 : ( 133 , 131 )
coordinate of point # 11 : ( 130 , 163 )
coordinate of point # 12 : ( 128 , 201 )
coordinate of point # 13 : ( 146 , 130 )
coordinate of point # 14 : ( 149 , 161 )
coordinate of point # 15 : ( 153 , 199 )

관련 포스팅 : 

https://hypjudy.github.io/2017/05/04/pose-estimation/

[Tensorflow] Human Pose estimation by Deep Learning

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

CPM :: https://github.com/psycharo/cpm/blob/master/example.ipynb

psycharo/cpm

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Human Pose Estimation with TensorFlow ::  https://github.com/eldar/pose-tensorflow

eldar/pose-tensorflow

 

관련 논문 : 

[1] DeeperCut: A Deeper, Stronger, and Faster Multi-Person Pose Estimation Model

[2] Articulated Multi-person Tracking in the Wild

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Heatmap 관련 Git

 

 

 

Caffe-heatmap :: https://github.com/tpfister/caffe-heatmap

tpfister/caffe-heatmap

관련 논문 :

[1] Flowing ConvNets for Human Pose Estimation in Videos

 

 

 

 

ROLO :: https://github.com/Guanghan/ROLO (is short for Recurrent YOLO, using Heatmap)

관련 논문 : 

[1] Spatially Supervised Recurrent Convolutional Neural Networks for Visual Object Tracking

 

 

 

 

CNN-heatmap :: https://github.com/mrgloom/CNN-heatmap

 

1. Visualizing and Understanding Convolutional Networks
https://arxiv.org/pdf/1311.2901v3.pdf
https://neukom.dartmouth.edu/docs/bbat-wacv2016.pdf
http://cs231n.github.io/understanding-cnn/

2. Net surgery trick
http://cs231n.github.io/convolutional-networks/#convert
https://github.com/BVLC/caffe/blob/master/examples/net_surgery.ipynb

https://leonardoaraujosantos.gitbooks.io/artificial-inteligence/content/image_segmentation.html
https://arxiv.org/pdf/1502.02766v3.pdf
https://arxiv.org/pdf/1411.4038v2.pdf
http://www.cv-foundation.org/openaccess/content_cvpr_2015/papers/Long_Fully_Convolutional_Networks_2015_CVPR_paper.pdf
https://arxiv.org/pdf/1605.06211v1.pdf

`convert fully connected layers to their
    equivalent convolutional layers, since the weights are the same and only
    the shapes are different.`

3. Global average pooling layer
Network In Network
https://arxiv.org/pdf/1312.4400.pdf

4. Learning Deep Features for Discriminative Localization
http://cnnlocalization.csail.mit.edu/
https://github.com/jacobgil/keras-cam

5. Grad-CAM: Gradient-weighted Class Activation Mapping
https://github.com/ramprs/grad-cam
http://gradcam.cloudcv.org/
https://arxiv.org/pdf/1610.02391v2.pdf

6. Is object localization for free? – Weakly Supervised Object Recognition with Convolutional Neural Networks
http://www.di.ens.fr/willow/research/weakcnn/
http://www.di.ens.fr/willow/research/cnn/

1. Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
https://arxiv.org/pdf/1312.6034v2.pdf

2. Top-down NeuralAttention by Excitation Backprop (c-MWP)
https://arxiv.org/pdf/1608.00507v1.pdf
http://cs-people.bu.edu/jmzhang/excitationbp.html

3. Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer
https://arxiv.org/pdf/1612.03928v1.pdf
https://github.com/szagoruyko/attention-transfer

4. Visualizing Deep Neural Network Decisions: Prediction Difference Analysis
https://openreview.net/pdf?id=BJ5UeU9xx
https://github.com/lmzintgraf/DeepVis-PredDiff
A New Method to Visualize Deep Neural Networks
https://icmlviz.github.io/assets/papers/23.pdf

5. Self-Taught Object Localization with Deep Network
https://arxiv.org/pdf/1409.3964.pdf

6. Shallow and Deep Convolutional Networks for Saliency Prediction
https://github.com/imatge-upc/saliency-2016-cvpr

 

Tensorflow codebase:

GAP-CAM
https://github.com/jazzsaxmafia/Weakly_detector

Grad-CAM
https://github.com/Ankush96/grad-cam.tensorflow

 

 

 

 

 

 

 

 

 

 

 

 

 

 

관련 논문 

 

 

 

[1] Toshev, Alexander, and Christian Szegedy. "Deeppose: Human pose estimation via deep neural networks." Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2014.

 

[2] Bulat, Adrian, and Georgios Tzimiropoulos. "Human pose estimation via convolutional part heatmap regression." European Conference on Computer Vision. Springer International Publishing, 2016.

 

[3] Pfister, Tomas, et al. "Deep convolutional neural networks for efficient pose estimation in gesture videos." Asian Conference on Computer Vision. Springer, Cham, 2014.

 

[4] Belagiannis, Vasileios, and Andrew Zisserman. "Recurrent human pose estimation." Automatic Face & Gesture Recognition (FG 2017), 2017 12th IEEE International Conference on. IEEE, 2017.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

관련 자료

 

Human Pose Estimation by Deep Learning : 

https://www.slideshare.net/plutoyang/human-pose-estimation-by-deep-learning

Human Pose Estimation by Deep Learning