Cardiff and Swansea don't come under the FA's jurisdiction (they are governed by the Welsh FA), so they shouldn't have been excluded. You should also note from BUFC's history, we played in the West Midlands League.
It's not like Waltham on the Wolds is the other side of the country.