Modi will also meet Chinese President Xi on the sidelines of the summit. It would be their fourth meeting in last seven months.
The US president said that there is a lot of "dislike" (between India and Pakistan).
The US has also urged the two South Asian neighbours to avoid further military action.
"It would be wonderful if they (India and Pakistan) get along," Trump said.
The Intermediate-Range Nuclear Forces treaty was one of those agreements and is set to expire in the next two years. The 1987 pact helps protect the security of the US and its allies in Europe and the Far East.
"We want to see it just stop. We are very much involved in that (process)," Trump told reporters at the Oval Office.
The announcement comes days after Trump and his Russian counterpart held their maiden summit in Helsinki on Monday.
Trump disclosed that he was to meet the Afghan President and senior Taliban leaders on Sunday at his Camp David retreat.
The US president was received by Lee at the presidential palace Istana, where they were expected to discuss everything from the summit preparations to America's tariff threats.
Nick Ayers, the 36-year-old chief of staff to the vice-president Mike Pence, is Kelly's likely successor.
A good deal of the 92nd Academy Awards (going hostless second year in a row) was a drag what with a staggeringly dull red carpet, long-winded, lacklustre speeches and uneven live acts following too quickly one after another.
The 2012 Republican presidential nominee and one of Trump's most vocal Republican Party critics during this year's election campaign, met privately with the President-elect for about an hour.
India should do what we can to ensure that our two friends do not get into a confrontation that is meaningless and ultimately damaging to everyone including us.
Gokhale and Pompeo expressed satisfaction over the significant progress and the quality of the India-US Strategic Partnership
India has said that Pakistan created the conditions for cancellation of the talks -- due to issuing of postage stamps glorifying terrorists and brutal killing of its three security personnel.
>Putin's last-minute intervention with PM salvages $5.43 bn pact.
Friends of India in the US hope that New Delhi will receive a presidential waiver, given that Trump Administration has recognised India as a major defence partner and is in advance stage of selling billions of dollars' worth of equipment to India in the next few years.
'We could quibble with each other whether there were 25 terrorists killed or 250 killed.' 'The message is more that India undertook such an aerial attack and this attack has actually changed the paradigm.' 'The change in paradigm is that India has shown by the surgical strike in 2016 and the aerial strike of 2019 that we will not just sit back and tolerate terrorism which killed so many of our people.' 'We will hit back and by hitting back we will raise the costs of such activities.'
'Kim has once again shown astuteness and statesmanship by securing China's support precisely just when it matters most to him,' points out Ambassador M K Bhadrakumar.
Tillerson, is currently on top of the list of Trump's Secretary of State because of his contacts with the world leaders, in particular Russian President Vladimir Putin, media reports said.
As 2018 draws to a close and the white noise of 24-hour news cycles and Twitter storms fade into the background, it is already clear that history will remember only a handful of those people, each of whom has taught us something about ourselves and the rapidly changing world in which we live.
'Traditionally, the US tried to tamp down tensions whenever a crisis situation arose and deputed officials from Washington to travel to Delhi to counsel restraint.' 'This time around, no US envoy flew down to Delhi -- not even when tensions spiked and a flashpoint was reached last week,' points out Ambassador M K Bhadrakumar.
'While US officials understand and accept India's desire for retaliation, they still don't want to encourage steps that would likely lead to war.'
"When we asked the US, to play facilitating role...Why do we ask? Simply because we are not engaging bilaterally," he said.
The summit at Sentosa -- the first between the two countries -- is a turnaround of relations between the US president, 71, and the North Korean leader, 34, after a long-running exchange of threats and insults.
'Washington is telegraphing here is its willingness to support a low-grade, limited use of force meant to send a strong message to Pakistan.' 'Perhaps something along the lines of the surgical strikes in 2016, or perhaps something a bit more -- but not much more.'
'A conventional war is not in fashion today and not seen as being able to deliver the objective.' 'Perhaps surgical strikes that are deeper, this time not on Pakistan's terrorist facilities, but on Pakistan army facilities.' 'The nation has to be prepared for losses.' 'War is not something that can be pussyfooted around.' 'If we go for limited number of posts in Kashmir, these are very difficult posts to capture and very difficult operations.' 'Be prepared for 200 to 300 killed.'
'Trump forgets that Kim is not one who likes to be treated publicly as a pauper; he wants to come to the table as an equal, and from a position of perceived strength, not as a suppliant,' says Dr Rajaram Panda.
Is North Korea really dismantling its nuclear programme? Rajaram Panda explains the many challenges to denuclearise the Korean Peninsula.