The singer and model wore typically mismatched looks at The Peppermint Club in West Hollywood on Sunday

Hailey and Justin Bieber in West Hollywood on Oct. 29, 2023. Photo:

Justin Bieber is keeping it quirky for Halloween!

The “Intentions” singer was spotted walking hand in hand with wife Hailey Baldwin Bieber outside The Peppermint Club in West Hollywood on Sunday — with Justin, 29, going all out in a pair of black sunglasses, matching Balenciaga cap and an orange and white reindeer onesie.

Justin also wore two chains with gold and blue mushroom pendants, as well as brown and white sneakers.

Dressed in all-black, Hailey, 26, continued the couple’s love of wearing un-coordinated outfits by wearing a latex mini-dress with a matching long leather jacket and pointy heels.

Carrying a clutch bag, the model also sported a single ankle bracelet, a pair of narrow dark sunglasses and a cat-shaped balaclava hat.

Sharing a snap of her outfit on her Instagram story, Hailey closed her eyes and placed one arm behind her back while holding up her other hand, showing off her turquoise nails and “B” finger ring.

Never miss a story — sign up for PEOPLE’s free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human interest stories.

The Biebers’ recent outing comes after they were pictured wearing other Halloween costumes on Saturday night. Attending Vas J. Morgan and Michael Braun’s Halloween Party in Los Angeles, the two channeled Bamm-Bamm Rubble and Pebbles Flintstone from The Flintstones.

While Justin went shirtless, wearing a black and yellow cap with furry animal print wrapped around his waist, Hailey was dressed in a red bobbed wig, a Pebbles-inspired sleeveless top and a blue and coral patent skirt.

On Friday, Bieber also wore a beach outfit with a snorkel mask and slippers as he attended the Casamigos Halloween Party in Beverly Hills.

Hailey Bieber shared a snap of her outfit on Instagram on Oct 29.Hailey Bieber/Instagram

Speaking to GQ Hype earlier this month, the Rhode founder said that she found the public reaction to their mismatched ensembles “so funny because I see so many people talk about this.”

“He may want to wear baggy sweats to dinner, and I might want to wear a tiny little dress just because that’s how I’m feeling,” she added.

“We can’t sit there and be like, ‘So I’m going to wear this and you’re going to wear this,’ ” she continued about Justin, whom she revealed always gets dressed before her.