A second property (even if lived in by the owner for several months of the year and not a rental property) is considered an investment property in the eyes of the IRS. Therefore, the capital gains tax exclusion does not apply to second or vacation homes. All sales profits are subject to capital gains tax, which can be new to many owners when it's