Can I make product attachments visible to only a particular customer group in magento?

You can do that on a global level by accessing Configuration -> Product Attachments:

Alternatively, product attachments visibility by customer group can be changed on a product level on the Product Attachments tab: