4.5mm at 5m would not be bad divergence at all for a purely diverging laser, but it would depend on the initial dot size for a converging one. First off, what laser are you talking about? Is this a WL greenie? Is so, which one. Pulsar, Glowtorch, Aries, ebayser, etc?
To get the dot size small, just use a magnifying glass or some other converging lens to bring the beam to a point at that distance. If you want to do it using optics at the laser side of the 5m, its a bit more difficult, but a combo of a diverging and converging lens, where the converging lens is less powerful than the diverging, may be used to try upcollimating the beam so that it focuses at that distance. If you're asking to get the beam 1mm all around though, that just isn't possible, sorry.