"Of course I am very happy. Up to the point we went 2-0 down we were not really performing very well but we didn't give up," the Turkish Captain said after the game.
Turkey were two goals down but Kahveci produced an amazing display in the second half scoring twice in the last three minutes to register a storming comeback.
"After the Portugal match only a few people really believed that we could make it, but we continue to make football history," added the 28-year old striker.
"We know that we have to do some things better. But if we can win a match even if we play badly, then we can beat any team if we play well. This victory is a gift to our nation. These were the most important goals I have ever scored."
Turkey will face the group B winners Croatia on Friday.
"We are not afraid of anyone, we can beat Croatia in the quarter-finals."