You should discuss this particular issue directly with your IELTS center. I'm positive they will have no problem delaying your speaking exam for few hours.
On my speaking exam day I witnessed an employee of the IELTS center call one candidate who failed to show up at the scheduled time. Over...