Yes StanCason is correct. You're interpreting the rules incorrectly. City walls only increase the amount of cards you can hold without the robber making you dump half of them (2 per wall)