While, as Jon Custer says in a comment, we aren't qualified to direct you, I'll give a bit of advice to help you think about it.
It is hardly worth spending your life doing anything that you don't enjoy. Your life isn't a "first run".
Since this is the US, though I don't know which field, I'll note that almost all academic positions involve teaching and mentoring. It is what we do to prepare the next wave of practitioners of the art. You need to be "special" in some way to avoid it. But most of the specials do it anyway. What do I mean by special? If your research is so important and you are the only one qualified to do it, then, yes, you can probably convince the administration that you should be excused from all other university participation to do it. If you were months away from curing the common cold, or cancer, sure. But the people who do that, also realize that not only their results, but their methods and ways of thought are important to pass on to the next generation, and so do, usually, mentor students.
But if you are good enough to fund yourself completely through grants, so that the University doesn't need to pay you, then you can most likely set your own working conditions. Of course, you may not need the university association at all in such a situation. Darwin, for example, funded himself pretty well, though that is harder now. But constantly writing the next grant can also take quite a lot out of you.
Alternatively, if you are so bad as a teacher that students drop you like a poison toad, then the administration will be reluctant to assign you to courses. But will also be unlikely to provide many rewards, and may even try to rid themselves of an unproductive member. Yes, unproductive, even if your research is "pretty good" (but see the superstar exception above).
But before you decide, find something that you do like and find a way to do that. Presumably you like research. If you can find a good research position you should probably explore that before you make any final decisions.
It is also possible to improve as a teacher/mentor. Doing so may actually make it more enjoyable. Whether this comes "at the expense" of your research or not depends on a lot of things. But your mind won't stop working just because you have to also prepare classes.
You will find, however, that there are trade-offs. Every job has good and bad parts. If the good parts outweigh the bad, it may be worth continuing. It isn't likely ever to be ideal. So, look very carefully at the options.
If you decide to stay, and still want to avoid student contact, you can, over time, probably work to minimize it by (a) working toward superstar status, and/or (b) taking whatever opportunities arise as they arise. This can be sabbaticals, of course, but also unpaid leaves that are funded by some grant or outside organization. If you do enough consulting, perhaps you can use the current university association to work toward the day that you can, like Darwin, self fund yourself and your research.
And if you do decide to go, try to do it gracefully, without burning bridges. Your goals in the future may change and you may want to keep open the option of returning to academia.
But be aware the the US university has a complex mission that involves teaching students. It tends to disfavor those who don't really want to participate in that mission.