Welcome!
I'm thinking a bright flashlight for self defense
That's problematic on a couple of levels, and many people here with more training than me will tell you it's not a good idea. So I'm sticking to suggestions purely about lighting.
First off, can you give us a little more information?
How far will you be walking between battery changes/charges? What battery format are you using in the P12? CR123A x2 or 18650? Got a good charger?
Will you be hiking at night?
Are you doing activities where carry weight is a moderate, a major or a critical consideration?
When I'm traveling for extended periods, I like to have as much redundancy as possible. I try to keep all my battery formats the same, I try to have multiple charging options, and I like to carry three lights. Those are a pocket-size flashlight, a larger light for distance work, and a headlamp. I buy mostly Fenix and Zebralight products, so that's what I'm most comfortable recommending, but Olight, Nitecore and other companies make solid lights. These days my travel kit is a Zebralight H52fw 1xAA headlamp, a Zebralight SC52w 1xAA pocket light, and a Thrunite TN4A (neutral white) 4xAA thrower. In short, that's what
I'd take, but that collection will set you back closer to $200 if you include batteries.
The P12 is a good start. (Personally, I'd leave the Ultrafire in the car, or at home, and never count on it to work when I needed it.) The next thing I'd buy would be a headlamp. If you've never owned a good headlamp, it's going to change your life. For cooking dinner, setting up a tent, changing a flat tire (God forbid), there's nothing more convenient.
If you're using 18650 in the P12, and you don't mind having one of those strapped to your head (some people do), then I'd take a look at the
Fenix HL60R. It's an 18650 headlamp with in-light USB recharging. I don't own it, so I'm basing my recommendation on the on-paper specs, but it has a number of camping-friendly features. It would also offer you a redundant charging option for 18650.
If you're using CR123A in the P12, then take a look at the Fenix HL50 headlamp. It accepts both AA and CR123A, can function as a hand-held flashlight, and has a lovely neutral white beam. I own it, and love it. (It has one critical flaw, which is that it's prone to accidental activation. I keep mine in a small pouch for that reason.) The ability to take multiple battery types is a really nice feature when you're on the road.
Zebralight makes excellent headlamps in either 18650 or CR123A formats; they're a little bit more expensive and will eat into your budget somewhat.
With the headlamp question settled for $50-60 or so, then I'd look for a pocket-sized light. If you're using CR123A, the Fenix E15 (2016 version) is a great little 1x CR123A option. It's been on my keys since Christmas, and I really like it. Super light weight, and only $30. The Olight S1 Baton is another very popular CR123A option.
You could also consider a lantern as your third light. Again, I'd recommend a Fenix product, the CL25R. 18650 or 2x CR123A, USB rechargeable, and a great set of camping-oriented features. I gave my dad one for Christmas, and he absolutely loves it when he's traveling. $60.
Hope that helps!