Categories
DigitalProductSchool
My life in Digital Product School - week 8/9/10
The 8/9/10th week retropect at Digital Product School
In DigitalProductSchool, Feb 24, 2020Digital Product School week 5
The 5th week retropect at Digital Product School
In DigitalProductSchool, Feb 09, 2020Digital Product School week 4
The 4th week retropect at Digital Product School
In DigitalProductSchool, Feb 01, 2020Digital Product School week 1
The 1th week retropect at Digital Product School
In DigitalProductSchool, Jan 11, 2019People in the World
Jeremy Howard
This is journey to find out ‘who am I trying to be?’
In People in the World, Dec 15, 2019Julia Evans
This is journey to find out ‘who am I trying to be?’
In People in the World, Nov 20, 2019Elif Shafak
This is journey to find out ‘who am I trying to be?’
In People in the World, Nov 05, 2019Retrospect
Retrospect of ACL 2020 paper writing
2020 Annual Conference of the Association for Computational Linguistics
In Retrospect, Jan 29, 2020Retrospective on Pycon 2019 Korea (CoC Committee)
When I was volunteer, it seems like busy and hectic to managing that crowded conference.In my experience, to get things moving, it needs hierarchy.But it didn’t. Organizers emphasized...
In Retrospect, Nov 05, 2019Resource
4 reasons took much time to setting GPU for fast.ai than I expected
Motivation
In Resource, Feb 05, 2020Why am I not listed as a contributor?!
From the end of last year, big changes have witnessed in NLP research.Embracing an unprecedented growth, I started to study new exciting results and advances.In doing so, I noticed I’...
In Resource, Jan 10, 2020toy-project
Fastai.NLP
fastai.v3
Part2 Transformer from scatch | fastai 2019 course -v3
Most of the code and model architecture come from a paper Attention is all you need and a repository of fastai
In fastai.v3, Dec 22, 2021Part2 lesson 11, 07a Layer-wise Sequential Unit Variance Initialization | fastai 2019 course -v3
Image source and original paper: link
In fastai.v3, Nov 12, 2021Part2 lesson 11, 09 Optimizer | fastai 2019 course -v3
Image source : link
In fastai.v3, Nov 09, 2021Part2 lesson 11, 08 datablock | fastai 2019 course -v3
Image source: fastai-data-block(Finally) we moved on to imagenette whose entire dataset might unfit to your RAM, so we grab each mini-batch as we need it.
In fastai.v3, Oct 14, 2021Part2 lesson 10, 07 batchnorm | fastai 2019 course -v3
Image Source: DeepLizard Youtube video
In fastai.v3, Sep 24, 2021Part2 lesson 10, 06 ConvNet cuda hooks | fastai 2019 course -v3
Direct link to answer: link
In fastai.v3, Sep 22, 2021Part2 lesson 10, 5ab, closure&decorator, early stopping
Direct link to answer: link
In fastai.v3, Aug 25, 2021Part2 lesson 9, 01 matmul & 02 fully-connected | fastai 2019 course -v3
Quick code manual (to review), https://github.com/fastai/course-v3/tree/master/nbs/dl2/01 & 02
In fastai.v3, Apr 23, 2021Part2 lesson 10, 05 anneal | fastai 2019 course -v3
Image reference: https://arxiv.org/pdf/1608.03983v5.pdf
In fastai.v3, Apr 22, 2021Sylvain Gugger at a joint NYC AI & ML x NYC PyTorch on 03/20/2019
Note from Sylvain Gugger’s talk at a joint NYC AI & ML x NYC PyTorch on 03/20/2019. Video / Slide </br>
In fastai.v3, Jul 23, 2020Part2 lesson 10, 04 callbacks | fastai 2019 course -v3
Since fastai instructor people highly emphasized to copy the code from scratch, I’ve been using that approach.It was fine with Part1, but from Part2, applying same strategy which was ...
In fastai.v3, Jul 21, 2020Part2 lesson 9, 03_minibatch_training | fastai 2019 course -v3
This session is highly related to what is torch.nn really? by Jeremy Howard.
In fastai.v3, Jul 14, 2020Part1 lesson7 | fastai 2019 course-v3
Note of lesson7 : Deep Learning Part 1 of Spring 2019 at USF, version 3 course
In fastai.v3, Apr 29, 2020[Q&A] Image Segmentation, using Unet with Driving Video data
This post is about my questions while I was studying USF Deep Learning course about image segmentation task.All the answers are from the course, source code, library document, or docu...
In fastai.v3, Apr 02, 2020Gradient backward, Chain Rule, Refactoring
This note is divided into 4 section. Section1: What is the meaning of ‘deep-learning from foundations?’ Section2: What’s inside Pytorch Operator? Section3: Implem...
In fastai.v3, Mar 02, 2020Implement forward&backward pass from scratch
This note is divided into 4 section. Section1: What is the meaning of ‘deep-learning from foundations?’ Section2: What’s inside Pytorch Operator? Section3: Implement forward&ba...
In fastai.v3, Mar 01, 2020What's inside Pytorch Operator?
This note is divided into 4 section. Section1: What is the meaning of ‘deep-learning from foundations?’ Section2: What’s inside Pytorch Operator? Section3: Implement forward&ba...
In fastai.v3, Mar 01, 2020What is the meaning of 'deep-learning from foundations?'
This note is divided into 4 section. Section1: What is the meaning of ‘deep-learning from foundations?’ Section2: What’s inside Pytorch Operator? Section3: Implement forward&ba...
In fastai.v3, Feb 29, 2020fastai.v4
Part1 lesson7 note | fastai 2020 course-v4
Note of lesson7 : Deep Learning Part 1 of Spring 2020 at USF
In fastai.v4, Apr 29, 2020Part1 lesson6 note | fastai 2020 course-v4
Note of lesson6 : Deep Learning Part 1 of Spring 2020 at USF
In fastai.v4, Apr 23, 2020cs224n
CS224N | Winter2019 | Assignment 3 Solution
CS224n, 2019W - Assignment3 Solution
In cs224n, Jun 18, 2020CS224N: NLP with Deep Learning | Winter2019 | Lecture5
Lecture 5: Dependency Parsing
In cs224n, Jun 10, 2020CS224N: NLP with Deep Learning | Winter2019 | Lecture2
Images: Vector directions related to word classes (Rohde et al. 2005)
In cs224n, Jun 05, 2020CS224N: NLP with Deep Learning | Winter2019 | Lecture1
Introduction and Word Vectors
In cs224n, May 30, 2020QnA
[Question] Tracking status of of learning
Most contents of this QnA series are based on my own trouble, curiosity and sometimes for reminding.</br>
In QnA, Jun 05, 2020[Answer] Tracking status of of learning
Most contents of this QnA series are based on my own trouble, curiosity and sometimes for reminding.</br>But, if you discovered this article through organic search and If you go...
In QnA, Jun 05, 2020Featured
-
Part2 Transformer from scatch | fastai 2019 course -v3
In fastai.v3, -
Part2 lesson 11, 07a Layer-wise Sequential Unit Variance Initialization | fastai 2019 course -v3
In fastai.v3, -
Part2 lesson 11, 09 Optimizer | fastai 2019 course -v3
In fastai.v3, -
Part2 lesson 10, 06 ConvNet cuda hooks | fastai 2019 course -v3
In fastai.v3, -
Part2 lesson 10, 04 callbacks | fastai 2019 course -v3
In fastai.v3, -
Part2 lesson 9, 03_minibatch_training | fastai 2019 course -v3
In fastai.v3, -
Part2 lesson 9 Note | fastai 2019 course -v3
In fastai.v3, -
[Q&A] Image Segmentation, using Unet with Driving Video data
In fastai.v3, -
Why am I not listed as a contributor?!
In Resource, -
Jeremy Howard
In People in the World,