The win is the fourth in a row for Jurgen Klinsmann's team, who are finding their league form after a shaky start of the season.
Miroslav Klose scored first for the home side on 25 minutes before Artur Wichniarek equalized for Bielefeld five minutes later.
In the second half, French winger Franck Ribery stormed through Bielefeld's defense before restoring the lead for Bayern on 76 minutes.
Five minutes from time, Lukas Podolski put the result beyond doubt by converting from the spot.
In another game, Werder Bremen thrashed Hertha Berlin 5-1 at the Weserstadion.
Guy Kascar's own goal gave Bremen the lead on 14 minutes before strikes from Markus Rosenberg and Diego made it 3-0 before half-time.
While Marko Pentelic's goal proved to be a consolation for the visitors, Peruvian striker Claudio Pizzaro scored a second half brace to wrap up Bremen's big win.
The wins lift both Bayern and Bremen to third and eighth respectively.