"We just rode on the railroads all the time, and I've never forgotten it", Bush said at the time, recalling how he took trains, and often slept on them, during trips as a child with his family.
The tweet further said: "During his presidency, the Cold War ended, Germany reunified, Kuwait liberated from brutal invasion, the Madrid peace process began, and he did much for his nation".
Ordinary Americans, generals, and former Cabinet members paid respects at the US Capitol Rotunda on Tuesday to the late US President George H.W. Bush, who died last week at the age of 94 after a life of service as a World War Two hero, head of the Central Intelligence Agency and wartime president.
The remains of Bush, who died last week in Texas at the age of 94, were flown to Texas on Wednesday evening following a formal state funeral where the World War Two veteran-turned-politician was hailed as a warrior-statesman of uncommon personal kindness.
George W. Bush turned the humour back on the acerbic ex-senator, saying of the late president: "He placed great value on a good joke, so he chose Simpson to speak".
Mr Trump's relationship with the Bush family has been tense.
George HW Bush's Service Dog Sully Pays Respects To The Late President. Credit PA
The St. Martin's Parish Choir performed "This is My Country", which was also sung at Bush's presidential inauguration in 1989.
President Donald Trump, a fellow Republican, planned to visit with the mourning family at Blair House, near the White House.
Instead of honest, balanced tributes which delivered a full picture of Bush's life and legacy, the media seemed to favor hagiography, retelling the former president's life with its blemishes removed. He said that Bush's wish for a "kinder, gentler nation" was genuine, not cynical.
Bush is the 12th U.S. president to lie in state in the Capitol Rotunda. Democratic Rep. Nancy Pelosi, a past House speaker nominated for the post in the new Congress, exchanged a warm hug with George W. Bush and came away dabbing her face. Dole would go on to be the Republican presidential candidate in 1996, but would lose to former President Bill Clinton. He had joined the Navy when he turned 18.
Training service dogs like Sully requires multiple months of classes spread over 10 acres in Smithtown.
On the other side of the pond, the Guardian newspaper sparked some Twitter outrage with its obituary, writing that the former president "did not put a foot wrong" during his devastating 1991 invasion of Iraq, which was described by the paper as an "impressive achievement".