The Citizens went in at the break a goal down following Nicolas Otamendi's own goal on the stroke of half time.
Raheem Sterling's fortunate late victor gave City the three points after they recovered from the shock of falling behind to a Nicolas Otamendi own goal on the stroke of half-time.More news: Nassar pleads guilty to sexual assault charges: "I'm so horribly sorry"
"The Premier League is so tough, now winter has come, we knew they were so aggressive so strong, but we are so happy for the way we won."
"There were minimal corrections from the first half because we played quite well in the first half, we created more chances than we had in the second half but that is a Premier League game so when I've spoken many times that we're not going to finish unbeaten - it's impossible".
"We spoke about us needing this kind of situation to happen", said Guardiola. "The guys competed amazingly, which is why we won". So, the gaps are nearly impossible but we found them, most of the time, and that's why I'm so, so pleased.
"But if you fight to avoid that mentally and in the way we want to play, that's fantastic".More news: Texas Tech defeats Texas 27-23
Manchester City came up against Huddersfield twice last season - the Terriers held them to a 0-0 draw in the FA Cup fifth round, however, lost 5-1 in the Etihad Stadium replay.
Raheem Sterling proved the difference maker as it was the England global who won the penalty which Aguero duly put past Lossl in the Huddersfield goal.
Former Everton player David Unsworth has been in temporary charge since Ronald Koeman was sacked on October 23, but has managed just one win during his seven-game tenure.More news: Antonio Conte bemoans lack of preparation time for Liverpool match