How do I prevent company-mode from giving a completion list when there are no matches?

Sorry to ask this here, I couldn't find the setting in the readme. When I finish typing any word in SLIME and go to push enter, it has already loaded the "no matches, so here's everything" list of completions, so I need to move back a character and forward just to get rid of the list. It's killing me. Here's an example picture, me typing 'foo, and the list loads for... some reason? https://preview.redd.it/it687gaolul81.jpg?width=390&format=pjpg&auto=webp&s=82339b8113b971e0bde36de880c9ceddf8fe49b5

You are not alone. I get the same behavior in SLY and have not been able to figure it out