broadcom-wl: Pass physical address to wl_attach