Don't think it's much of a shame. As long as you're able to communicate and convey information, you'll get by. Of course, whether you're able to speak fluently or not depends on your upbringing and educational background. I've come across many instances where people feel ashamed that they're unable to converse well in spoken English. But many times I find myself respecting those who clearly aren't very fluent, but still have the courage to try. The point is not whether you can speak well and show off, rather, it's showing that you accept the fact that you have lots of room for improvement and your determination to try.