Any process that modulates the frequency, rate or extent of excitatory postsynaptic potential (EPSP). EPSP is a process that leads to a temporary increase in postsynaptic potential due to the flow of positively charged ions into the postsynaptic cell