Depends on howthe prestige of the conference or journal that you have got it from. If it was a 20 person workshop I would say no but if it was the paper of the year award in a leading journal or best paper in the leading conference in your field then it is definitely an indicator of the relevance of your research and recognition of your contribution and its quality. It is one of the factors that my faculty looks into when hiring so the quality of the publications, where they were published and these awards do matter.