Wipe it down every single time if you want it to actually last. Glue might grab dust but that's a weak bond just waiting to fail. You're adding a crumbly layer between the adhesive and the solid surface. It might hold for a week when you need it to hold for years. That extra minute of cleaning saves you from redoing the whole job later when it lets go. Trust me, nothing designed to stick works better on a dirty floor.