Absolutely. It is so important that you make sure you are hiring someone qualified and trustworthy. After all, this person is going to be handling sensitive business information and is responsible for providing accurate information.
Here are a couple of things I make sure to ask when hiring a new bookkeeper or accountant. I ask about their educational background and their work experience. Did they go to school for accounting? Have they worked for businesses that are similar to mine? This helps me gain some insight as to whether they are the right fit for the job.
I also ask for references or reviews of their work. This sort of word-of-mouth knowledge is crucial as it shows how others who have worked with them feel about their service. If you need a place to start, this site helped me find book keeping in Kent.