Ad hominem applies to arguments. The source of an argument does not affect the soundness of that argument.

But it’s not a fallacy to question an overarching narrative based on the source. If a person keeps selectively choosing facts and twisting words to forward a specific narrative, it’s not fallacious to view what that person says with skepticism.

Edit: Typo. Also changed “valid” to “sound”.