relative pronouns "which" and "where" difference?

Could you please explain me why do we sometimes use "which" instead of "where" for location As in " This is the restaurant which we have dinner"

It was something like that My example maybe wrong but I'm sure that I saw "which" with location.