Hear me out. It doesn't even matter that it's 96 billion light-years away if you're traveling at light speed. Because if you can travel at light speed, time would be frozen for you relative to earth time.
So if you're in a spaceship traveling at light speed to your destination, it would feel like you gotten there in an instant.
Also, due to length contraction, at light speed the universe isn’t 96 billion light years wide, it’s 0 anything wide.
At light speed there is no time and no distance, the origin is the destination. You won’t even experience a single tick of Planck time to get there. Instantaneous.
Yes, it requires infinite energy for any mass to get to light speed.
I don’t think our understanding of physics breaks down at such extremes though. I believe it’s decently understood, as in general and special relativity. I’m not a physicist though.