At the top of the mountain, in an inaccessible cave near Zemara location, lies Panagia Kakaviotissa. According to oral tradition, where the chapel now stands, there once lived six monks (belonging to the Monastery of Megisti Lavra), who had come from the neighboring island of Agios Efstratios. Chased by Ottoman Turks or pirates, they found refuge in the chapel in their effort to protect themselves. An annual mass is held at the chapel on the Tuesday after Easter Sunday, when the icon of Virgin Mary of Kakavia is brought over. 

Source: North Aegean Region - https://www.pvaigaiou.gov.gr