The Ghanaian striker, whose dispute with Zamalek's board has been apparently resolved, last featured in the team's squad in the goalless draw with Tersana last month.
He missed the Cairo giants' league matches against ENPPI, Harras Hodoud and Gaish.
Agogo was expected to return to Zamalek fold ahead of the Olympic encounter, having participated in the U-20 team game against Telecom Egypt on Monday.
But Swiss tactician Decastel opted not to leave him out of the match's squad.
Versatile midfielder Mohamed Aboul-Ella will also miss out due to injury. So will left-back Osama Hassan, who has seen his place occupied by new arrival Sabri Rahil.
Zamalek will have Hani Saied and Amr Al-Safti available after the defensive duo served an automatic one-match suspension.
The White Knights will be looking to build on their convincing 4-2 victory over Gaish whey they face Olympic away from home.
Zamalek, who are gradually regaining their form after a barren run, lie seventh in the 16-team league table on 30 points.