Just did a water change in tank to get nitrate levels down,about half the water when...?

I added the fresh tap water to tank,(water was treated for chlorine). Fish started freaking out especially kissing gourami,s and rainbow and neon tetra,s. Was it the Temperature drop that caused this? Have I done any long term damage?