Upon Potter's death, he was taken to his aunt and uncle's house in Surrey. According to sources, they were the only living family members he had left. He was left in the care of Muggles, news that those close to him took with outrage. His Transfiguration Professor, Madam Minerva McGonagall, describes her feelings upon getting knowledge on where he would be spending his childhood.

"Of course, like anyone, I was completely outraged. I was there when he was left on the doorstep! Albus [Dumbledore] said it would be best for him, said he would leave a letter. I'd have thought it would be impossible for the entire situation to be explained by letter. I mean, think about it. 'Dear Mrs. Dursley, Your sister is dead, and we're leaving her son with you until he is old enough. Good day!' It all seems a bit ridiculous..."

Apparently, the Dursleys lied to Potter about his parents, stating that they died, and Harry got his scar, in a car crash. They also stated that Potter's father, James was an "unemployed drunk".

His street wasn't completely devoid of any sort of person related to the Wizarding community, though. Mrs. Arabella Figg, a Squib, lived just up the street from the Dursleys. Harry had no knowledge of Mrs. Figg's Wizarding history until the summer of 1994, when he had a particularly nast run-in with two dementors. Apparently, Mrs. Figg was sworn into secrecy by Albus Dumbledore, who wanted her to keep an eye on Potter.

During Potter's Muggle school days at St. Grogory's Primary School, he performed uncontrolled magic, such as turning his teacher's wig blue, accidentally Apparating on top of the school's roof, and Shrinking a sweater his aunt tried to fit on her. If Potter had not gone to Hogwarts, he would have gone to Stonewall High, a Muggle Secondary School.