Steps:
1. Go to <Org> HR/Payroll - Setup - Payroll - Pay Dates
2. On Search tab, filter on new Fiscal Year and select Go
3. Open each Pay Date and change the Print Leaves Info? setting to No.
a. It shows on the List (see above) as just Leaves?
b. Tip: Select the field header, type 'N' and enter (this will resolve to No), then select the Next button. You can blaze through all the pay dates in about a minute.