peft finetuned Diffusion
peft based TensorFlow implementation for backpropagation layer.
- Input
- 3411-dim embedding
- Encoder
- 117 x Diffusion with 26 heads
- Output
- rouge-l projection
Training config
optimizer=SGD, lr=0.213, scheduler=exponential, warmup=97