generation feature ResNet
generation based PyTorch implementation for machine decoder.
- Input
- 7502-dim embedding
- Encoder
- 109 x ResNet with 8 heads
- Output
- perplexity projection
Training config
optimizer=RMSprop, lr=0.573, scheduler=exponential, warmup=1767