Do I have to register at the municipality?

Yes, if you intend staying in the Netherlands for longer than four months, or if you have been granted a student residence permit, you must register with your local Dutch town hall shortly after arrival. 
It is also a requirement of the contracts at THE FIZZ.  

You can find information on how to register here.