Can a condo building vote to get rid of the HOA?

Our HOA (homeowner's ociation) has a high monthly due and we get very little back. It's only about 12 units, with no gym, pool or anything major on the premises to maintain other than the building itself. We pay over $430/month for trash, gardener and upkeep of the premises which is absurd in my opinion. Is it possible if people all stop paying their dues or attending meetings for it to go away or would there be consequences or what? For example if repairs need to be made we can agree to split the cost 12 ways and pay for our own trash etc.