Yes it is possible. It was ransacked and destroyed by an army of the Muslim Mamluk Dynasty under Bakhtiyar Khilji in c. 1197 CE.
So many temples of Hindu's and most famous library situated in Bihar named as Nalanda which contain ancient Hindu's Dharma Granth's (like veda's ) are destroyed and through them in fire as he is against Hinduism, at that time so many books/granth's are not have duplicate copy and that's why as you said is possible.
But there is no any prof about veda's. You get details report about "Nalanda Agnikand" on google. As you mentioned Bhrigus, here are some details about Bhrigu Rishi.
Like any library, Hinduism Stack Exchange shares great information, but does not offer personalized advice, and does not take the place of seeking such advice from any Acharya, Pundit, astrologer, Guru or other trustworthy Counselor.