layerscape: remove kernel 5.4 dependences