Its good that it is now clearing. Im not sure if you are aware but not changing your water to build up bacteria is a bit of an urban myth. Many believe that doing water changes will disturb the bacteria that are colonizing in the bacterial filter and will make the tank take longer to cycle. In actual fact it is completely the opposite and can delay the cycle. The bacteria you want is not in the water column but on the substrate, rocks, wood, plants and surfaces of your aquarium.
When a tank is cycling elevated ammonia and nitrite levels in the water are not only directly toxic to inhabitants (if any in the tank) but also displace oxygen from the water. The nitrifying bacteria that are trying to populate your bacterial filter require oxygen in addition to ammonia (or nitrite) and water to survive. It is true that you will be taking some of the ammonia (nitrate) out when doing the water change but not enough to effect the cycle. The newly oxygenated water will help with your cycle. By not doing the water changes could elevate ammonia and nitrite levels and depelete oxygen to the point that the bacteria cannot process the waste to grow. The elevated levels in the water can then slow down the cycling process.
I would recommend atleast a 30% change daily in the first week, and every other day the second week, leading to 2 water changes in the third week. If you have some, adding shop bought beneficial bacteria can help, something like Seachem Stability or API quick start but many will argue that it is not necessary.
Edit: typos
Hope this helps