Yes, it definitely should concern you -- and your husband, as well. I'm not a doctor or other expert in such matters, of course, but your husband's binge drinking certainly proves that he's not in control of his drinking, but his drinking is in control of him. The Bible warns that "a man is a slave to whatever has mastered him" (2 Peter 2:19).
What can you do? First, talk frankly with your husband about this problem and urge him to face his need for help to overcome it. If you need other family members or friends to join with you, don't be ashamed to ask them. Sometimes alcoholics will only admit their need for help if others confront them directly and demand they seek help. Your pastor or doctor should be able to direct you to agencies or organizations in your community that may be able to assist him.
I also urge you to turn to God for the wisdom, help and patience you need. God knows all about your situation, and He loves you and your husband and doesn't want to see him destroy his life and the life of your family. Pray for your husband, and encourage him to open his heart and life to Christ's love and transforming power.
Don't assume that your husband will get better on his own. He probably won't; if anything, his situation may only get worse. But God is able to heal the hurt in his heart that he's trying to numb with alcohol, and with your prayers and encouragement it can happen.