You did reference it, it is in the document, so of course it goes into the bibliography.
Imagine the other way round: Someone reads the text, finds it interesting, sees that there are more to be found about this topic in a source and then can't find said source...