That saw is designed to cut wood - as you found out, it will cut metal. The problem is that ALL saws for metal cutting (high-speed dry saw, low-speed cold saw, etc) clamp the part securely in a vise. If you can make or adapt some type of clamp, you can saw safely.
"But it works OK with no clamp" ... and it will until the blade gets just a little dull, you apply more downward pressure to make it feed, & the blade rips the part from your hand:shakehead
If you're going to cut Al on a regular basis, a small cold saw is the first choice ... my 9" Wilton is made in Italy, and built like a tank - but then, every cold saw is like that:
Just over 50 kilos, so it is somewhat portable. The blade turns at a screaming 52 rpm, and leaves a near-mirror finish on Al, steel, Ti, etc.