In some cases, what you suggest might be possible; some people do feel guilty about things they've done that aren't really wrong, or that they aren't responsible for. But frankly, I don't think that's your problem.
Instead, your problem is a very serious one -- and one I hope you'll take very seriously. It is this: When we ignore God and continually turn our backs on Him, our conscience becomes calloused and hardened, and in time we no longer hear its warnings. We may even deceive ourselves into thinking that nothing is wrong, and that God doesn't care what we're doing.
But that is a very dangerous attitude, because it isn't true. More than that, it means we may end up spending the rest of our lives apart from God, and we will enter eternity unprepared for God's judgment. The Bible warns us not to be like this, because "It is a dreadful thing to fall into the hands of the living God" (Hebrews 10:31).
My prayer is that you will face your need of God's forgiveness, and repent of your sins and commit your life to Jesus Christ. God loves you; He loves you so much that He sent His Son into the world to die for you. Don't ignore Him any longer, but discover the joy and peace He has for you by asking Christ to come into your life today. The Bible's promise is true: "In Your presence is fullness of joy; At Your right hand are pleasures forevermore" (Psalm 16:11, NKJV).