How to Finish a Basement: Framing and Insulating Run a bead of acrylic caulk around each section of foam to form an airtight barrier. Fill gaps larger than 1/4 in. with expanding foam sealant.