Yes, you will need to book on an event day.

We had coffee there after doing a stadium tour recently & found prices were not silly but that was not a game day. Great views over the river.