The 24-year-old international couldn't carve out a regular place at Bayern, as he has been living in the shadow of frontline duo Luca Toni and Miroslav Klose.
"It hurts to see a special talent who just stops and does not progress because he cannot deal with the situation of having two players in front of him," Klinsmann told Bayern's official website.
Recently, LA Galaxy's Landon Donovan joined Bayern on a loan basis, and Croatian international Ivica Olic is set to arrive at the same destination by next season.
For this reason, restless striker Podolski doesn't have much of hope to persue a successful career with Klinsmann's men.
"I would have hoped he had some anger, which he would express in his game and he would say to himself: 'I will show them what I have got," the German coach added.
"Bayern is a club where it is either or. Either a player faces the challenge and says 'I will fight my way into the team'… or it is better to change your environment."
Podolski, whose remarkable displays during the 2006 World Cup gave him a head start, joined the Bavarians right after the gigantic competition.
Now he is set to move away from the German champions by the end of the current season, after an offer was accepted from Cologne.