Can gpt generate a gpt model?

Not directly no.

It may be able to code one (the code is relatively short and well known) and give training program, and then you would need to spend a few trillion tokens to make it generate data.

You can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that's about it.