Police said security has been tightened at Tappal as a precautionary measure.
The charges against the men include promoting hatred and disrupting harmony, police said.
Two suspects have been arrested and police say the case is a fallout of a monetary dispute.
One of the men held earlier for the crime is an alleged sex offender who targeted children in recent years.
Twelve people, including 8 policemen, were injured on Monday in widespread violence and arson in Varanasi during a procession by seers and other locals.
Teams of army and National Disaster Response Force on Thursday morning rescued the 9-year-old girl and her father from the building's debris. The duo received minor injuries in the incident, a senior official said, adding that total seven persons were killed in the incident and 18 injured.
In Aligarh, District Magistrate Chandra Bhushan Singh told reporters that Kafeel Khan's speech at AMU was instrumental in triggering violent incidents at the university on December 13 and 15.
Scores of Banaras Hindu University students also staged a protest at the Lanka Gate in support of the AMU students.
Director General of Police O P Singh said that two people lost their lives in Bijnor and one each in Meerut, Sambhal and Firozabad. But officials reported a death in Kanpur as well.
Over 260 policemen were also injured, of whom 57 received gunshot wounds, IG (Law and Order) Praveen Kumar said on Saturday.