Can gpt generate a gpt model?
Imagine AI giving offsprings...
You're viewing a single thread.
You can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that's about it.
Yep, this is called model distillation.