awesome-deep-learning-finetune-experience
This repository not only contains experience about parameter finetune, but also other in-practice experience such as model ensemble (boosting, bagging and stacking) in Kaggle or other competitions.
Welcome pull request!
General
- My Neural Network isn't working! What should I do?
- williamFalcon/DeepRLHacks: Hacks for training RL systems from John Schulman's lecture at Deep RL Bootcamp (Aug 2017)
- 淺談深度學習中的代碼效率問題
Course
- How to Win a Data Science Competition: Learn from Top Kagglers | Coursera
Stacking & Boosting & Ensemble
- 模型融合方法概述| 知乎專欄
- 如何在Kaggle 首戰中進入前10% | Wille
- Introduction to Ensembling/Stacking in Python | Kaggle
- 一文讀懂集成學習（附學習資源） | 數據派THU
Hyper-parameter search
- Scikit-learn hyperparameter search wrapper | skopt API documentation
GAN
- 生成對抗網絡綜述：從架構到訓練技巧，看這篇論文就夠了| 機器之心[英文原文]
Computer Vision
Image Classification
- [CVPR 2017] Squeeze-and-Excitation networks (ILSVRC 2017 winner) at CVPR2017
- 專欄| Momenta詳解ImageNet 2017奪冠架構SENet
- [FAIR 2017] Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
- Kaggle Invasive Species Monitor competition : 3rd place solution overview
multi-label classification
- Kaggle亞馬遜比賽冠軍專訪：利用標籤相關性來處理分類問題| 雷鋒網
Detection
- 天池醫療AI大賽第一季宜遠智能_HKBU團隊Rank7 解決方案（含代碼） [code]
Movie Description
- [LSMDC 2016] 1st place: Video Description by Combining Strong Representation and a Simple Nearest Neighbor Approach. Gil Levi, Dotan Kaufman, Lior Wolf (Tel Aviv University), Tal Hassner (University of Southern California) [slides]
Movie Annotation and Retrieval
- [LSMDC 2016] 1st place: Video Captioning and Retrieval Models with Semantic Attention. YoungJae Yu, Hyungjin Ko, Jongwook Choi, Gunhee Kim (Seoul National University) [slides]
- [LSMDC 2016] 2st place: Video Description by Combining Strong Representation and a Simple Nearest Neighbor Approach. Gil Levi, Dotan Kaufman, Lior Wolf (Tel Aviv University), Tal Hassner (University of Southern California)
Movie Fill-in-the-Blank
[LSMDC 2016] 1st place: Video Captioning and Retrieval Models with Semantic Attention. YoungJae Yu, Hyungjin Ko, Jongwook Choi, Gunhee Kim (Seoul National University)
[LSMDC 2016] 2st place: Video Fill in the Blank with Merging LSTMs. Amir Mazaheri, Dong Zhang, Mubarak Shah (University of Central Florida)
Speech
- 10686 一次CTC-RNN 調參經歷| 知乎專欄
Feature Engineering
