Can I assign, remove or replace a website for a number of products in bulk in magento?

Yes, you can do it via the “Update Attributes” action. Choose it on the product grid and then add or remove products from websites according to your needs: