Rihanna is a lady in red!

On Sunday, May 12, the singer, 36, celebrated Mother’s Day by stepping out in New York City with A$AP Rocky in a dramatic red gown and sheer gloves.

The star teamed the Comme des Garçons dress, which also featured a black skirt, with a Gucci clutch bag, black and silver Amina Muaddi heels and a pair of diamond-encrusted sunglasses. Meanwhile, she wore her blonde locks straight and sported a bold red lip to match her ensemble.

Rihanna and the rapper, 35, who wore a navy blue shirt and black pants, were pictured walking hand-in-hand in the Big Apple before getting into a yellow taxi together.

Rihanna asap rocky yellow cab 05 12 24

While in the back of the car, a fan appeared to have handed the “Lift Me Up” singer a vinyl copy of her Rated R album to sign, with her writing seen on the back and front of the cover as she and A$AP Rocky smiled in their seats.

Rihanna asap rocky yellow cab 05 12 24

The couple’s outing comes after they celebrated their son RZA’s second birthday on Saturday, May 11.

The pair hosted a private party at Color Factory in New York City and treated their eldest son to a bash featuring toys, slides and a ball pit.

According to photos and videos shared by two party guests — producer President Hitkidd and his wife, makeup artist Jasmine B. Cook, or “Jazzy B” — their younger son, 9-month-old Riot, was also present.

Rihanna asap rocky yellow cab 05 12 24

Snaps on Jazzy B’s Instagram account also revealed some fun decorations, including a “RZA’s 2ND BIRTHDAY” banner, large cutouts of the toddler’s head and pink confetti, while a video showed Rihanna, Rocky, RZA and Riot smiling and posing together for a family photo in front of a bright pink background.

Earlier this month, a source told PEOPLE that Rihanna is “happiest” with the “L$D” rapper by her side.