Although there are a couple of people who practice this taboo of adding references without actually referring them, it is ill-advised.
Nevertheless, references to established books add credibility to your work.If your teacher insists to refer a book, then refer it in your work, then cite it.
Referring it doesn't necessarily mean you have to include in your work any textual content that the cited material provides. You may refer here and here to get an idea of when you could/should cite a material. In addition, you may appropriately cite a source
- if you believe that the content of the source would help the reader to understand the foundation/extension of your work.
- if you have derived an idea based on the content mentioned in the source.
- if the source supports the claim you wish to establish
- if it contains an application/use-case of any method you propose