You can include the address in your search, but this is an experimental feature and may not work exactly as you require or expect and is not officially released. That being said, you can try a search like:-
John Smith location:"high Street, london"
or
location:"high Street, london" John Smith
hope that helps