"Suresh Kalmadi's resignation as secretary of the Congress Parliamentary Party has been accepted with immediate effect," All India Congress Committee general secretary Janardhan Dwivedi said.
Party sources said Kalmadi had been asked to put in his papers as CPP secretary earlier. Congress President Sonia Gandhi is the chairperson of the CPP.
Gandhi's decision came on the opening day of the winter session of Parliament in which the Opposition had threatened to raise the issue of alleged corruption in Games-related projects.
Kalmadi is the Congress member of the Lok Sabha from Pune.
Soon after the Games ended, the Congress party left Kalmadi to fend for himself, declining to give a clean chit to him or others associated with the organisation of the Games.
Sports Minister M S Gill, Urban Development Minister S Jaipal Reddy and Delhi Chief Minister Sheila Dikshit were among the others involved in the preparations for the Games.