cfi: Add support for strangely endianness broken SoC implementations