Daniel Cousin grabbed the winner for Hull as the Tigers ended Arsenal's unbeaten run at The Emirates with a shock 2-1 victory.
Hull join West Ham as the only teams to have beaten Arsenal at their new ground - they had gone 17 months without a home loss - with victory also denying the Gunners a return to top spot.
The hosts had taken the lead through Paul McShane's own goal but Geovanni struck a spectacular equaliser before Cousin struck.
The Gunners opened the scoring when Theo Walcott slide the ball into the six-yard box where McShane (51) could only prod into his own goal.
But on 62 Hull were level when Geovanni lashed home a 25-yarder and four minutes later the Tigers were ahead.
Daniel Cousin climbed above William Gallas to direct his header from a flag kick into the corner.
Gallas' header hit the bar late on but Hull hung on.