No pool fence, fined by NJ town

[LGG1]

Last year, I applied for a pool permit and installed a below ground pool on my property in NJ. I have not yet put up a fence nor have I applied for the final approval. Last week I received a notice from the town which issued a $2K fine and a $500 fine for each week I do not have a fence installed. My neighbor, who has had his pool for a year longer than mine, also with no fence and no final approval, has not received a notice or fine. When I called the town to explain I intend to install a fence upon completion of the pool landscaping, I was told my plans had no bearing on the matter and the fines hold. As I have not yet applied for my final approval and others in the town have clearly had their permits open longer with no fence, it seems as though I am being singled out. I am wondering if I have any recourse to avoid the fines.