Besides ensuring the accuracy of your work, careful note-taking helps to avoid inadvertent plagiarism. You can find many concrete, useful recommendations in:
In particular, review the sections on note-taking and paraphrasing.
To see how this can impact a scholar's work and reputation, read up on the plagiarism controversy that surrounded the well-regarded historian Doris Kearns Goodwin.