How can I purchase bitcoin with cash?

I’ve read that bitcoin was created as a currency that does away with middle men and service fees and banks altogether. But it seems that you have to have a bank account to purchase bitcoin - which seems to avoid the purpose in the first place. Any suggestions would be helpful.