Mr Obama and Cuban leader Raul Castro shook hands as the opening ceremony began, their first encounter since a December detente.
But their historic formal talks due on Saturday could be overshadowed by tensions between Venezuela and the US.
Mr Obama told a forum of civil society leaders in Panama City that "the days in which our agenda in this hemisphere presumed that the United States could meddle with impunity, those days are past".
More about: