Homepage
Open in app
Sign in
Get started
Deep Learning
Python
R
Reading Lists
Data Analysis
Tagged in
Deep Learning
Veritable
Towards human-centered AI.
https://veritable.pw
More information
Followers
971
Elsewhere
More, on Medium
Deep Learning
Ceshine Lee
in
Veritable
Jun 18, 2021
[Notes] Gradient Checkpointing with BERT
A brief analysis of huggingface’s implementation
Read more…
21
Ceshine Lee
in
Veritable
Apr 17, 2021
[Paper] Adafactor: Adaptive Learning Rates with Sublinear Memory Cost
Essential for fine-tuning T5…
Read more…
4
Ceshine Lee
in
Veritable
Mar 23, 2021
[Paper] Rethinking Cooperative Rationalization: Introspective Extraction and Complement Control
Read more…
6
Ceshine Lee
in
Veritable
Feb 22, 2021
Reducing the SentencePiece Vocabulary Size of Pretrained NLP Models
Useful for fine-tuning on a subset…
Read more…
40
Ceshine Lee
in
Veritable
Jan 23, 2021
[PyTorch Lightning] Log Training Losses when Accumulating Gradients
The global step is not what you…
Read more…
26
Ceshine Lee
in
Veritable
Dec 30, 2020
Generating Synthetic Tabular Data Using GAN
A case study: detecting credit fraud
Read more…
25
Ceshine Lee
in
Veritable
Dec 8, 2020
[Paper] Are We Really Making Much Progress?
A Worrying Analysis of Recent Neural Recommendation…
Read more…
5
Ceshine Lee
in
Veritable
Oct 19, 2020
[Tensorflow] Training CV Models on TPU without Using Cloud Storage
If your dataset is small enough
Read more…
2
Ceshine Lee
in
Veritable
Aug 27, 2020
[Paper] Language-agnostic BERT Sentence Embedding
Improving accuracy for low-resource languages
Read more…
7
Ceshine Lee
in
Veritable
Jul 26, 2020
[Paper] Training Question Answering Models From Synthetic Data
Generate questions and answers from…
Read more…
10