When viewing the Products page icons for deleted stores will still be displayed. This can be confusing as it looks as though these products are still linked to that deleted store.

To remove an existing store head to Settings>Stores, check the store and hit Archive Store