A protein complex, that caps one or both ends of the proteasome core complex and regulates entry into, or exit from, the proteasome core complex.