Hello Akajimmy,
You need a voltmeter. The + end goes on the + end of the battery and the - end goes on the - end of the battery. Be sure to choose a suitable range before taking the measurement.
Voltmeters are available at hardware stores, electronic stores, and on line, and come in a variety of price ranges.
Tom