Elihu told Job he was “adding rebellion to (his) sin.”
We all sin. And sin separates us from God. When we sin, God convicts. We take God out of it when we call it simply a guilty conscience without considering where it came from. The guilt you feel comes from the hand of a loving God who wants you to repent. It’s His gentle way of restoring us to Him.
But we get pretty good at either learning to live with a guilty conscience, or denying it and refusing to feel guilty, telling ourselves things like: He started it. They deserved it. It’s no big deal. At least I didn’t kill someone.
Refusing to deal with sin is rebellion against God. Which is a sin in itself. Now you have two sins to confess, two sins to feel guilty about instead of just one. Every time you refuse to repent you add another sin, and another, and another.
Consider guilt a blessed emotion. Those feelings are meant to draw you to God. Don’t dismiss them. Don’t stuff them deep inside. Don’t rationalize them or minimize them. Let guilt do what it’s intended to do.
Ask God to forgive you. Repent of the sin you feel guilty about. Turn from that sin and toward God who loves you enough to make guilt a blessed emotion that can lead to forgiveness, and sweet fellowship with your Heavenly Father.