Travis Kelce was famous long before he met Taylor Swift. By the time the two started dating, he was already a Super Bowl winner, and one of the most popular players in the NFL. Things were taken to the next level when he began associating with the musical superstar, and while there are certainly perks to romancing the most successful artist in the world, there are apparently some real downsides as well.

During a recent appearance on Shaquille O’Neal’s The Big Podcast With Shaq, Kelce’s brother Jason opened up about how dating Swift has negatively impacted his younger sibling. He stated that being involved with the Grammy winner “has its drawbacks, for sure,” adding that, “Travis knows better than I do.”

The elder Kelce brother revealed that Travis recently moved into a new home, but he didn’t get to enjoy the space. “The first day he moved into the new house…a gated community, someone knocks on a window of the house,” the football player shared.

That’s scary enough, but apparently, it was just the beginning for Travis. “People were just staying by his house,” Jason admitted. He added that eventually, his brother “had to completely move out of his house,” seemingly due to intrusions from fans.

The identities of these intruders weren’t revealed, so it’s not fair to say that they were all superfans of Swift. “We’ve always been big in the football world, Travis especially,” Jason confirmed…but it seems that the younger of the two siblings didn’t face these issues until his girlfriend’s fan base fell in love with him as well. “The Taylor world and the pop culture world, that’s a whole different level. It’s a new demographic that wasn’t there before,” Jason opined