Michael Redd scored 32 of his career-high 40 in the second half in the Bucks' 113-102 victory over the Magic Wednesday night.
Redd had a three-point play with 47 seconds left, made his final 10 shots and was 12-of-15 in the second half.
Desmond Mason added 18 for the Bucks, who bounced back from a 106-99 loss in Orlando on Monday night. Tracy McGrady had 20 points for Orlando, but was scoreless in the fourth quarter.
Juwon Howard tied a season high with 24 points, and rookie Keith Bogans had a career-high 21 for Orlando.
Milwaukee scored 67 in the second half, including nine in a row in the final minute.
The Magic ran off eight consecutive points, capped by a free throw from Drew Gooden, to pull to 102-100 with 1:01 to go.
Redd then drove the baseline for a basket and was fouled to set up the three-point play that made it 105-100 with 47 seconds left.
Shammond Williams missed a jumper for Orlando. Joe Smith was then fouled, and made both free throws for a 107-100 lead with 41 seconds to go. Mason then hit four consecutive free throws to cap the 9-0 run and give the Bucks a 111-100 lead with 26 seconds left.
Orlando has lost nine consecutive road games.