I just found this thread as I was tired of the delay too. I have always had Siri disabled, but despite that I think it still had the hotkey reserved. What fixed the delay for me was actually re-enabling Siri, setting to a new hotkey I'll never use, then disabling it again. It's a silly solution, but hopefully it can help someone else!