When driving a single LED, it is usually easy to tell what kind of driver you're using. Drivers/modules labeled in the 3-9, 3-18, or similar voltages are all buck drivers, which means they step down voltage using a comparator, a switch, and an inductor. In order to work, they need to have an input a volt or two above the voltage of the output, or a few tenths of a volt for a more efficient one.
Since LEDs typically operate from 3.3-3.6V when drawing higher currents, the combined voltages of the batteries must be between 3.5-4.0V depending on the driver in order for the switching power supply to actually switch. This means that once the voltage of the battery falls below a certain point on a 3-9V driver/module, the driver is set up to bypass the "buck" part of the circuitry and will drive the LED directly from the battery. This is typically dimmer than using a current-regulated circuit, and will only work until the protection circuit in either the battery or driver kicks in (or the battery over-discharges and catches fire).
While it is possible to a construct a power supply that both steps up and steps down voltage as needed (a buck-boost converter), I've yet to see one in a hand-held flashlight since they are less efficient, more expensive, and have very limited use.