The correct approach depends on whether the driver source code is intended to create a fully out of tree module or something that's either already in the kernel (and just needs an amended config) or are appended/patched into the kernel. In either case you start by creating a working LE image: Compile [LibreELEC.wiki]
Then you either tweak the kernel config, add patches to the linux kernel, or create a new driver package. We can't really instruct further without knowing what drivers you're interested in.
NB: You cannot build drivers on Armbian and just copy them over.