rb532: remove the gpio spi driver patch