Stuck Loading if adding shared calendar with free/busy only permissions

I have a calendar shared with my account that shows only free and busy times. I want to be able to show those times on the calendar as well, but if I add that calendar, it stays in the loading state. A shared calendar I have view permissions to works as expected.