He made the comments while at the presidential palace in the French capital, where France signed over the artifacts to Benin.
France's President Emmanuel Macron, who was at the handover, hailed it as "a symbolic, moving and historic moment."
The items are being removed from the Quai Branly museum in Paris.
In Benin, the artifacts will be exhibited at various sites, including a former Portuguese fort in the city of Ouidah, once a slave-trading hub, while awaiting the completion of a museum in Abomey to house them.
Why is France handing over the items now?
African museums have demanded for decades that European former colonial powers restitute stolen cultural artifacts. Experts estimate that 85 to 90% of African cultural artifacts were taken from the continent.
Recently the movement has gained greater traction.
French lawmakers last year passed a bill allowing Paris to return artifacts to both Benin and Senegal, another former French colony in west Africa.
Art treasures wanted back
Nigeria said last month it had agreed with Germany on the return of hundreds of so-called Benin Bronzes.
An advisory committee to the Netherlands' government in 2020 found that the country should return looted art to its former colonies.
More to come?
Talon emphasized that Tuesday's handover was the first step in a large-scale restitution process.
He said he was reserving his enthusiasm until France had returned other key artifacts.
"Beyond this handover, we will continue the work," Macron promised.