First of all , I'd like to show that we use" be to + infinitive" when discussing formal or official arrangements or to give formal instructions or orders and your example illustrates these aspects very well. Its passive form is " be+ to be + P.P "Thus, Iguess it's quite right to say in passive :
the lecture was to be taken at seven o'clock