Saw this previously when I updated to Big Sur. Went away after deleting contacts files.
Just had same issue reappear now, after upgrading Alfred to 4.3 [1205]. It may or may not be related to the upgrade as I also did other things before I noticed Alfred + Spotlight + Contacts was broken. This is what worked for me, with a restart immediately after deleting the Contacts files:
https://discussions.apple.com/docs/DOC-10581
2. In that folder you will find three files,
addressbook-v22.abcddb
addressbook-v22.abcddb-wal
addressbook-v22.abcddb-shm
Move all of these files to the trash.