I've discussed the following elsewhere here. It was CS, but, I think, fundamentally the same.
Many (most?) people have a sort of natural ability in some subjects and it gets them through school to some level. But it ends for nearly all (all?) at some point. Such people have no real need to "learn how to learn". And, seeing something once or twice is all they need to pass the required exams. But then, they hit the wall. Some fail completely at this point and I think that the later they learn the following lessons the harder it is to recover, though I have no experimental evidence of this.
I noticed the same behavior you describe in a class. I asked one of the students why he wasn't taking notes and he pointed to his head, indicating no need. I thought about that for a while and decided that the behavior was self defeating and self limiting, so I spent a class period changing the rules.
Being tenured (and trusted by chair and dean), I first scared them a bit by suggesting that if they weren't really interested in learning the material then we could all agree that they would get F's and could then spend their time elsewhere doing other things that mattered more to them. This caused a bit of a stir in the halls as you would guess, and I don't recommend it for everyone. And a chat with the department head would probably be wise before trying anything like this.
But, I also taught them how to take notes in class and to work to capture the most important messages. I like index cards for big ideas, since they can be carried about for review, shuffled, sorted, combined, extended (if not filled up initially), etc. I bought a big set of cards and handed out a small deck and a rubber band to each student.
For a few weeks, I would end lectures a few minutes early and ask, either specific students or generally, "What is a big idea from today's lecture?", having told them I was expecting up to three such big ideas captured on their index cards. I would agree publicly or not.
I would also start each lecture with the same question-response system. A former teacher (this was math) would start each and every lecture with a five minute quiz based entirely on the previous lecture: "Please take out a sheet of paper...". We hated that guy, but the "stick" was effective even though those quick quizzes were a minor part of the grade.
Learning requires reinforcement and feedback. Few people learn with a single introduction to a big idea. To learn actually requires rewiring the brain (hence repetition/reinforcement). And we sometimes make mistakes in our integration (hence feedback).
See The Art of Changing the Brain by James E Zull for a run-down on the science behind the reinforcement/rewiring/feedback ideas.
See also: Active Learning in general, and how to foster and require it.
Notes: You can't ethically ignore the inactive students. You still have a responsibility for their learning, while still recognizing that some students just won't care or respond.
I'd suggest requiring attendance. If the scale is right, you can also use other active learning ides such as pairing (tripling) students to explore ideas, etc.
If you have a doctorate in math, note that most of your students are not like yourself: driven to learn math. Many students take a few math courses for other purposes and are perfectly satisfied with a modest grade.