The real question is what God wants you to do about accepting this position and that's why I hope the first thing you do is pray and ask Him to guide you according to His will. If it is God's will for you to accept this position, then it would be wrong for you to turn it down.
I can't help but feel, however, that you actually are wrestling with a larger issue, even if you don't realize it. That is the question of what place Christ has in your life. Let me put it this way: If you were to make a list of the top 10 things that are important to you, and then ranked them in order of importance, where would Christ be? Would He be first, or would He be somewhere down the list or even missing?
In other words, if Christ is only one of many interests you have and not as important as others then I doubt if God wants you to take this responsibility in your church. The first church officers appointed in the New Testament were "known to be full of the Spirit and wisdom" (Acts 6:3).
Ask God to help you examine your life, and to face honestly what place Christ has in your life. Then ask Him to be your Savior and Lord. The Bible says, "Let us throw off everything that hinders and the sin that so easily entangles, and let us run with perseverance the race marked out for us" (Hebrews 12:1).