Rest of my process is in this Topic 
here 
If you list the Status of any swatch samples as “Wishlist” then the default view for all the Fabrics will NOT show the samples - thus not clogging up the view (if you don’t want them visible all the time) .