Born in Karlin, Byelorussia, he was only a teenager when he succeeded his father as Chazzan in his native Karlin near Pinsk. Later he conducted the Hazamir choir in Lodz (1903-1907), the largest Jewish choral group in that time. Back in Russia he conducted the Central Synagogue choir in Moscow (1907-1914). After another period with Hazamir he emigrated in 1920 to the United States. There he led various synagogue choirs and other choral groups including his own group The Zilberts Choral Society of New York City.

His compositions include a setting for the traditional Havdala for solo, choir and piano or for violin and piano (1923) which has become a classic. Among his other works are a biblical cantata JACOB'S DREAM (1934) and his collection of Music for the Synagogue (1943). He died in New York in 1949.