Yes, Canaris had some knowledge of the Holocaust. He received reports of mass killings in the East in 1942 and 1943. He also learned that some Jewish prisoners were being used as forced labor. Canaris did not take any action to stop the Holocaust, but he did report what he knew to his superiors.
Unmasking Wilhelm Canaris: A Quiz on the Intriguing Life of Germany's Enigmatic Admiral