1 Repositories
Python SmallInitEmb Libraries
SmallInitEmb - LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
SmallInitEmb LayerNorm(SmallInit(Embedding)) in a Transformer I find that when t
11 Dec 25, 2022
11 Dec 25, 2022