Why can't I see my own health records?

Someone told me that if I went into my Dr.'s office and asked them to hand over MY health records, that they wouldn't give them to me. Why the hell not? They are my records about me. I don't understand this.