A synapse in which an action potential in the presynaptic cell reduces the probability of an action potential occurring in the postsynaptic cell.