The series has heavily implied that Joy Boy was a giant, and some clues suggest that he may have been a member of the Buccaneer race, which has the blood of giants in their bodies. The Buccaneer race revered the legend of Nika, and there's the giant straw hat.