A magnet will not cause any problems to your USB drive.
Nor will it even cause problems with an external hard drive. I've since lost the photo, but once to settle this argument when discussing the Olight S10 which also has a magnet in the tail, I stuck it to an external hard drive that my Mac...