Just a heads up for others.
I had a problem where every time I launched Alfred remote after the first connection it couldn't connect to my Mac until I disabled then re-enabled the Alfred remote server. It would then connect fine, 9 times out of 10.
On my Mac I have two network interfaces on and connected at the same time, one ethernet and one wifi (I prefer our company's wired network but leave wifi on for OS X/iOS hand off). The ethernet was set at the top of the order in OS X network settings. I changed the order to wifi first and this fixed the issue.
Hope this helps.