Rihanna is a lady in red!

On Sunday, May 12, the singer, 36, celebrated Mother’s Day by stepping out in New York City with A$AP Rocky in a dramatic red gown and sheer gloves.

The star teamed the Comme des Garçons dress, which also featured a black skirt, with a Gucci clutch bag, black and silver Amina Muaddi heels and a pair of diamond-encrusted sunglasses. Meanwhile, she wore her blonde locks straight and sported a bold red lip to match her ensemble.

Rihanna and the rapper, 35, who wore a navy blue shirt and black pants, were pictured walking hand-in-hand in the Big Apple before getting into a yellow taxi together.

While in the back of the car, a fan appeared to have handed the “Lift Me Up” singer a vinyl copy of her Rated R album to sign, with her writing seen on the back and front of the cover as she and A$AP Rocky smiled in their seats.

The couple’s outing comes after they celebrated their son RZA’s second birthday on Saturday, May 11.

The pair hosted a private party at Color Factory in New York City and treated their eldest son to a bash featuring toys, slides and a ball pit.

According to photos and videos shared by two party guests — producer President Hitkidd and his wife, makeup artist Jasmine B. Cook, or “Jazzy B” — their younger son, 9-month-old Riot, was also present.

Snaps on Jazzy B’s Instagram account also revealed some fun decorations, including a “RZA’s 2ND BIRTHDAY” banner, large cutouts of the toddler’s head and pink confetti, while a video showed Rihanna, Rocky, RZA and Riot smiling and posing together for a family photo in front of a bright pink background.

Earlier this month, a source told PEOPLE that Rihanna is “happiest” with the “L$D” rapper by her side.