I have been several times recently. When you enter the guard hands you a ticket. On the ticket it says firearms are not allowed anywhere on Avery island. I do not know if that has any legal force. I imagine they would just kick you out if you were somehow caught carrying.