It's two different scales. A poor community will have its rich people.
Sure, but the poorer the community is, the lesser rich people it will have, and, if a product has to be smuggled, probably only a few of the rich people will use it (and the poor ones cannot afford it). I assume that if most rich (and so, probably influential) people are interested in this product, they will find a way to make it available without smuggling, even if that means changing laws.
So, to have a consumer pool that can make smuggling any product proffitable (at least in lot quantities, as lesser than that it would be better to just sneak it in), I asume a community must be rich enough as to have a decent patrol, at least enough to make smugglers think it twice before confronting it with violence.