Package pata_rb532_cf separately and update kernel config