Prime Minister's Office on Friday came down heavily on former media adviser Sanjaya Baru accusing him of "misusing" a privileged position for commercial gain in writing a book in which he says Manmohan Singh had been undermined by the Congress party.