Lolley fired a low effort into the bottom right corner from 25 yards past former Town keeper Simon Eastwood on 84 minutes.
He latched on to a loose ball in the middle after Oscar Gobern had headed the ball into space.
It came just a minute after Town had the second of two goals controversially ruled out for offside.
Gobern played in Scannell down the left and his cross was tapped in by Nahki Wells only for the flag to go up.
In the first half Ishmael Miller had a header from a Jacob Butterfield cross chalked off in a clearer cut decision than the later one.
Huddersfield started brightly but conceded two goals in five minutes mid-way through the first half.
Rookie home defender Joe Wilkinson, 19, had an unfortunate role in both goals on his debut.
Former Huddersfield striker Jordan Rhodes surged forward on 26 minutes and his shot fell for kindly for Rudy Gestede.
Wilkinson tried to block Gestede’s effort but instead the ball looped up and bounced into the net.
Gestede has now scored five times in three matches after a hat-trick at Nottingham Forest and a goal against Millwall.
Strike partner Rhodes made it 2-0 with a trademark header after a Wilkinson blunder on 31 minutes.
A cross was going out of play when the defender intervened – with Rhodes punishing the lapse by crashing a header into the top corner.
In the process he became the first Blackburn player since Alan Shearer to score 20 goals in three successive seasons.
Rhodes left Huddersfield in 2012 for a club record £8million after bagging 73 goals in just 124 appearances.
Town started the game brightly with Eastwood saving a header from Mark Hudson in the opening seconds.
Gobern and Conor Coady, who hit the bar with a fluke attempted cross on 23 minutes, had chances before Rovers scored.
Miller and Nahki Wells also went close while Marcus Olsson and Paul Taylor shot wide from distance at the other end.
However Blackburn’s two goals silenced the home crowd.
Huddersfield, seeking a first win over Rovers in 10 matches since 1999, were back in it when Miller was fouled by Tommy Spurr.
Butterfield curled in the resulting free-kick into the near post top corner from the right hand edge of the box on 39 minutes.
Gobern nearly levelled a minute later when he cracked a low effort from 35-yards which flashed just wide.
Wells and Rhodes traded chances before Lolley equalised. Substitute Josh King then nearly won it for Blackburn two minutes from time.
He seemed certain to score from a Spurr cross but Gobern somehow deflected his shot over the bar on the line.