No, not all journals that charge to publish are predatory journals. Some genuine open access journals charge article processing fees. For example, the journals by Copernicus, by the European Geophysical Union (EGU), charge moderate article processing fees. These cover the costs of the publisher, which then makes the articles available open access free of charge.
To label a journal as predatory you need other (additional) criteria.