This question was asked a long time ago, but remains on the unanswered queue. The comments suggest two different approaches.
First, this question has been asked at least twice before here:
A journal with higher IF but general scope, or a journal with less IF but specialized scope?
How to decide between sending paper to a specialized journal or to a journal with broader audience?
Many people hate the idea of impact factor as a metric by which journals (and hence researchers) are judged. But, the sad fact is that this metric still is used in some places, e.g., I have seen it mentioned by external letters on tenure and promotion cases. Hence, all things being equal, if you can get the paper published in the higher impact journal, that might be better for your career. If you are worried about the paper not being "seen" enough by specialists if you publish it in the higher impact journal, you can fix that by uploading a preprint (in math, we use arXiv for this), giving talks about the research, emailing your paper to relevant people, etc.
I echo what was said at the second linked thread above, that what matters MUCH more than impact factor is whether or not the journal has an editor who would be sympathetic to this specific submission. I also echo the advice to look at what other papers they have published recently to see if they do tend to publish papers like the one you've written. Lastly, think about how long the review process takes. Sometimes a more general journal is harder to publish in and you might lose time waiting for a negative referee report, if you misjudged the fit of your paper to that journal. If you are in a hurry to get published, the specialized journal might be a better option (but, check about waiting times there too; it's a bit random which journals tend to make authors wait a long time and which get reports quickly).