Yadav had been absconding since February 9 although four of his accomplices had been arrested earlier.
The RJD suspended Yadav from the party a day after his arrest warrant was issued.
A local court on Monday issued arrest warrants against suspended Rashtriya Janata Dal MLA Raj Ballabh Yadav and three others in connection with a rape case involving a minor.
The Bihar government had challenged Patna HC's order granting bail to Yadav.
Emerging from the meeting at 10 Circular Road residence of former Chief Minister Rabri Devi where he met RJD president Lalu Prasad, Raj Ballabh Yadav told reporters it was a courtesy visit to extend greetings of Durga Puja.