I was recently admitted to the Top 10 Universities in Math Ph.D. The department is really strong at the Number Theory, I am primarily interested in the Number Theory so it is a good thing. I will be most likely find some faculties that research the Number Theory and wrote a Ph.D thesis on that(provided things go well).
Although, I am also interested in Mathematical Physics. Potentially in the future, I would like to study topics between to Mathematical Physics (for example Mirror symmetries) and Number Theory. Having said that at the University, no one studies Mirror Symmetry, KdV equation, Hitchin System, or Geometric Langlands(there are experts of usual Langlands though)... This means that almost no faculties researches on the topic that I am curious about it.
So my question is in this case should I abandon my curiosity about Physics, and simply focused on Number Theory? Or even there is no facilities are researching on Mathematical Physics, is it worth to keep study it? In this case how to self-study it as a graduate student?