Should work. Given the driver can't handle more than ~2.1 amps it's not capable of hurting four XMLs in series. Fixed voltage is never the ideal way to drive at high currents, and you'll never know with any remote precision how much current is actually being used, but it should run.
I'd dial down the power supply all way first, then after connecting slowly turn it up. Won't hurt the LED's but I wouldn't be surprised if somewhere in the adjustable voltage range the driver starts to fault and either dims or starts flickering. Obviously you want to be turned down from this point.