I did not receive a tax bill, or I received it late, do I still have to pay a penalty?

YES. The failure to mail a statement or the failure of a property owner to receive a bill does not affect the validity of the taxes or interest prescribed by law (NYS Tax Law Section 922). Neither the tax collector nor any other official has the authority to waive statutory penalty charges.