Sounds like you put the parts together backwards. Try to spin that little push button around. Make sure you don't loose that little spring either.