NEW YORK -- Toronto Blue Jays manager John Gibbons sat back in his chair, cracked a smile and a few laughs.

Gibbons had a lot to enjoy. Instead of talking about the two-ton weight known as the Blue Jays' 17-game losing streak at Yankee Stadium, he was discussing a victory.

To get that elusive victory, Toronto had a little luck, a big home run and clutch relief pitching in the late innings.

Dan Johnson had a tie-breaking infield single with one out in the top of the seventh inning, hit a three-run home run in the ninth and Aaron Loup worked out of a jam in the eighth as the Blue Jays ended their skid with a 6-4 win over the New York Yankees Saturday afternoon.

"When you're having a tough year, usually around this place you'd see tire tracks around your neck," Gibbons said. "(I have) Volkswagen tracks. A big, big day. I've never felt so excited about winning a ballgame."

The Blue Jays won at Yankee Stadium for the first time since Aug. 29, 2012. They ended a streak that was two off the team record (19 straight losses at Baltimore's Memorial Stadium 1978-1981) and ended a skid that had seen them lose 12 times by two runs or less while holding a lead 13 times.

Toronto did not lead until getting a few breaks in the seventh.

The Blue Jays had runners on second and third after right fielder Melky Cabrera walked and first baseman Jose Bautista doubled against Shawn Kelley (1-3).

On the next pitch, it looked like the Yankees would record the inning's first out. First baseman Brian McCann fielded a ground ball from catcher Dioner Navarro, looked over to third but was unable to make the out at first.

"We talked about that yesterday," Gibbons said. "You need a screw-up or something to help you win a game in a tough streak and we got some of that."

"I don't even know what happened," Navarro said. "It was such a strange play and I've never seen anything like that and we caught a break."

After Kelley recorded the first out, Matt Thornton gave up the game-winning hit, a bloop single that barely reached the infield going between second baseman Brian Roberts and Thornton. Roberts did not field it cleanly, the ball went under his glove and Cabrera scored.

"Obviously, I faced him many times before and I didn't realize his fastball was really riding and it got so far in," Johnson said. "I was fortunate enough to kind of dump it in there with the second baseman being so far back."

"When you take a full swing, hit the ball and the ball only goes 65 feet, the defense is going to flinch a little bit," Thornton said. "That's just one of those plays that's a tough break. It changes the game."

In his next at-bat, Johnson came up with two on and one out against Jeff Francis and drove a 2-1 pitch into the right-field seats for his first home run since joining the Blue Jays.

"Dan Johnson, what a guy," Loup said. "He's got a lot of big time hits in his career. It was just a good a hit."

Johnson hit his first home run since hitting three Oct. 3, 2012, at Cleveland for the Chicago White Sox. They were sandwiched around a gutsy outing by Loup.

Loup recorded the first two outs in the eighth, getting switch-hitting third baseman Chase Headley to strike out on the 10th pitch and retiring right fielder Ichiro Suzuki on a groundout to the hole in shortstop that required Bautista to sprawl out to field the throw.

After issuing consecutive walks to Roberts and catcher Francisco Cervelli, Loup struck out left fielder Brett Gardner on a full count fastball.

"It feels good," Loup said. "We needed a win, especially against these guys and especially here. You figure sooner or later we'd win one. We get a lead last night and everything seems to go against us. We come in today, get a lead, hold it and it seems like everything was bouncing against them today."

Johnson's big hits and Loup's performance were made even more important when Casey Janssen gave up a one-out two-run home run to Carlos Beltran in the ninth. Janssen recovered and easily finished off Toronto's third win in its last 24 visits to New York.

The Yankees took a 2-0 lead off Toronto right-hander Drew Hutchison on McCann's two-run home run with nobody out in the fourth. The Blue Jays tied it in the fifth against left-hander Chris Capuano on an RBI single by Navarro and a sacrifice fly by third baseman Steve Tolleson.

Hutchison (7-9) ended a three-game losing streak by allowing two runs and five hits in 6 2/3 innings.

Capuano became the 11th player to start a game for the Yankees this year. He survived six innings, allowing two runs and five hits while issuing four walks.

NOTES: Yankees 1B Mark Teixeira missed his sixth straight game with a lower lat strain. Teixeira did some stretching and running Saturday and will do tee and toss Sunday before the Yankees decide to place him on the disabled list. ... Before Friday's game, Toronto manager John Gibbons said he hoped to have 1B Edwin Encarnacion back before July 31. Encarnacion tweaked his quadriceps while swinging at the team's minor league complex in Dunedin, Fla., on Friday and there is not a timetable for his return. ... According to Toronto's game notes, LHP Mark Buehrle is the second pitcher to lose 10 games in a row against the Yankees in the last 50 years. The other was Dennis Martinez, who dropped 13 straight from 1984-98. ... Capuano was the 47th player to appear for the Yankees, who used a team-record 56 players last season.