Lady Gaga had to "endure a lot" during her early days of fame and admitted that it "hardened" her as a person.