Don't connect batteries in reverse. The 6V battery will effectively be trying to charge the 1.5v battery that is reverse connected. Charging a battery that is not designed to be charged and/or at the wrong voltage, can result in failure, leakage, or bursting, and damage to the device. You may never experience this, but if you do you'll be unhappy.
Here's a little blurb from Energizer on reverse polarity protection, related to devices such as boomboxes (remember boomboxes?) that ran on many batteries in series, where I guess consumers inserting one backwards was an issue worth trying to address:
https://data.energizer.com/pdfs/revprotection.pdf