To let pass, to leave alone, to let go.
To do without, to abandon, to renounce.
To refrain from, to abstain from, to pass up, to withgo.
"I wouldn't forgo something, unless I'm convinced that it's detrimental in some way or another."