The handle of my manual pump does not fit correctly.

The handle may not have been assembled correctly. Make sure to snap the handle into the hinge; this should allow the handle to pivot up and down freely.