They broke through the security forces' barricades around 3 pm and entered Ganabhaban.
Earlier, Prime Minister Sheikh Hasina resigned and left the country. The protesters were seen celebrating her resignation.
It is reported that Bangladesh's Prime Minister Sheikh Hasina has left Bangladesh. It is said that her sister Sheikh Rehana and other family members are with her.
BBC has learned that a helicopter carrying her has departed for Agartala, India.
News agency AFP reports that a close associate of Sheikh Hasina has informed AFP of this information.
"She and her sister have left Ganabhaban and moved to a safe shelter. She wanted to record a statement, but was not given that opportunity," the official told AFP.
Reuters reports that Sheikh Hasina and her family members have departed for India in a military helicopter."