Problem solved. Unsure what exactly solved it, but here what I did:
While Alfred 2 was not automatically started, its files were still around. I deleted it.
Apple just pushed El Capitan 10.11.5 today. I installed that
Of course there was a restart
It then worked...