Kayakers took three hour shifts guiding the swimmers, who could often not see the boat