Kateregga came off the bench to score a late brace for Maritzburg in a 2-1 league win over Bloemfontein Celtic at Harry Gwala Stadium.
Maritzburg enjoyed the better of the first period and created numerous chances but they lacked conviction in front of goal. At halftime it was goalless.
Two minutes from recess, Menzi Masuku gave the visitors the lead when he struck from close range.
Thabiso Kutumela had a brilliant chance to level matters but his shot was saved by Patrick Tignyemb before striking the woodwork with a cross.
Maritzburg coach Eric Tinkle introduced on Allan Kateregga for Siphesihle Ndlovu a change that inspired his side to victory.
With only 10 minutes to normal time, Ugandan international Kateregga expertly leveled matters with a half volley.
Maritzburg then pushed for the late winner and in the 88th minute, Kateregga won it with a powerful left footed shot.
Despite the win, Maritzburg are bottom placed with 20 points from 25 games on the ABSA Premiership log.