Wout Brama put the Mariners ahead early with a slotted finish. Conor Pain had far too much space on the left wing and was able to pick out the unmarked run of Brama, who scored his first goal for the club.
The Glory fought their way back into the match, with Adam Taggart fluffing a few chances.
First, a low Keogh cross was sent just wide by Taggart.
Then he just missed turning home a header towards the far post after a corner.
Taggart was again in the action when the ball fell to his feet in the box in the second half, but opted to take a touch rather than shooting immediately.
The former A-League Golden Boot winner came back to form at the end of the match though, a superb first-touch cross made for easy pickings as Andy Keogh headed home to equalise for Perth.
Then, Taggart beat the offside trap late on and slotted home to complete the comeback for a deserving Perth Glory.
A late blooper by Liam Reddy threatened to give the Central Coast Mariners a chance at shot at tying things up, coming off his line and missing the ball, but Josh Bingham was unable to get the ball under control.