In Batman #25 (August 1944), the Joker and the Penguin team up for the first time to try and foil Batman and Robin. By this time, Batman definitely had the most interesting rogues gallery of villains, so this team-up must have been pretty interesting to see!