Janko scored after just six minutes, with Martin Harnik netting soon after as Austria opened up a two-goal lead.
Ermir Lenjani halved the deficit shortly after half-time, but that was as good as it got for Albania who had PAOK midfielder Ergys Kace sent off in the second half as they finished with 10 men.
Poland continued their preparations for EURO 2016 with a thumping 5-0 win over Finland in Krakow with Pawel Wszolek grabbing a brace.
Russia coasted to a 3-0 win over Lithuania at the Otkrytiye Arena in Moscow with goals from Fyodor Smolov, Aleksandr Golovin and Denis Glushakov.
A late goal from Bursaspor winger Balazs Dzsudzsak secured Hungary a 1-1 draw with Croatia at the Ferenc Puskas Stadion, where Juventus forward Mario Mandzukic had put the hosts ahead in the first half.
Elsewhere, an early strike from Maksat Baizhanov gave Kazakhstan a 1-0 win away to Azerbaijan.
