Walking hand in hand, Bieber, 24 and his model wife, 22, sported matching black beanies for the occasion.
Baldwin paired hers with leather pants and a denim coat while Bieber sported a blue hoodie, sweatpants and Louis Vuitton slippers. The “Love Yourself” singer, who is currently receiving treatment for depression, appeared to be in good spirits as he flashed a wide smile at photographers.
The sighting comes just one day after Bieber stepped out solo on Valentine’s Day to play basketball.
For the sporty outing, Bieber bundled up for the chilly weather in the same blue hoodie he wore Friday, a green beanie and a pair of white Yeezy sneakers as he played basketball by himself on the snowy court.
Although the couple, who wed in a civil ceremony in New York on Sept. 13, was spotted without one another on the most romantic day of the year, Baldwin made sure to celebrate the holiday.
“Happy Valentine’s Day, I’m bringin home the goods,” Baldwin wrote on her Instagram Stories Thursday alongside a boomerang video of her opening a box of festive Tim Horton donuts.
Baldwin also put up a sweet Valentine’s Day post in honor of her husband, which featured a black-and-white photo of the pair kissing.
“I get to be his valentine forevaaa evaaa????” she lovingly captioned the post.
On Tuesday, sources close to the singer confirmed to PEOPLE that Bieber was going through a bit of a rough patch, but was getting the help he needs.
“Justin seems down and tired. He has been struggling a bit,” a source said, adding that the pop star’s difficulties were not related to his recent marriage.
“It has nothing to do with Hailey — he is very happy being married to her. It’s just something else that he struggles with mentally,” the source continued. “He has good help around him and is receiving some treatment. He seems confident he will feel better soon.”
Another source who has spent time with Bieber over the years told PEOPLE that the singer is “emotional and struggles a lot with the idea of fame.”
“He’s emotional and struggles a lot with the idea of fame — being followed, having his every move stalked by fans, cameras in his face. It all sets him off and he often feels like everyone is out to get him,” the source said.
Drugs, including Xanax — and “a legitimate problem with sex” — came with making millions at 20 years old, Bieber admitted. Naturally, these struggles bled into his career. In 2017, he canceled his Purpose world tour with 14 shows left amid rumors about his mental health.
“I got really depressed on tour,” he recalled. “I haven’t talked about this, and I’m still processing so much stuff that I haven’t talked about. I was lonely. I needed some time.”
In order for Bieber to focus on his mental health, the singer and Baldwin have decided to push back their religious wedding.
“They will have a wedding ceremony with family and friends eventually,” said the source. “However, right now, Justin’s focus is getting well mentally.”
The source added: “Justin is doing okay. He is very focused and committed to getting help. Hailey is very supportive — Justin is very open about that Hailey does nothing but help him. He would feel even more lost without Hailey — he is very grateful. They are both focused on having a happy marriage.”
This article originally appeared on PEOPLE.com.