Remember that the reference in the text is "only" a flag to enable the reader to find the important information, the reference, in your reference list. With the "author-year" form the in text information provides a knowledgeable reader with a flag that can make the reference known without looking into the reference list but in a system where references are provided with only numbers (Vancouver style). So the important information is in the reference list.
With that background, it is clear that referencing the authors of the chapters is the way to go. If no clear author exists for chapter the compilation or book editor can be referenced but adding the specific chapter number in the reference (assuming the chapter IS numbered). There is no major point in adding the chapter number to a reference pointing to a chapter given by its author. All such information will be given in the references. Even if more than one chapter has been written by a specific author (team) you can still provide only the usual "author-year" but label the references, for example, (Smith et. al 2000a), (Smith et. al 2000b) etc. All will be explained in the reference list.
So as a conclusion, use references as if the chapters where articles in a journal but be careful by providing all necessary information about full publication information of the chapter (number and name of chapter) as well as book editor, title, publisher etc. in the reference list. Please refer to journal instructions (equiv.) for details.