The earliest records held by State Records relating to the French are contained in the Colonial Secretary's Papers, 1788-1825.  Included are letters that relate to a number of French vessels visiting Sydney, such as the Surprize asking for permission to go sealing in 1802...