Pretty tough if it's the latter, but you can improve it.
You can step out, raise your hand a bit more often with input, you can volunteer to get the next assignment instead of letting it pass by, and you can read and study privately to bolster your knowledge and awareness of a subject so that you have more to say.
Reputations are hard to change, so don't expect any overnight improvements. But keep at it. When you're known for more than average, you'll rise to the top.
How have you managed to change what you're known for?