Most of the media sold as "aquatic soil" consist of baked clay, in some sort. When (naturally) breaking down, clay will likely pack, in more or less compact way, around your gravel.
Your regular siphoning have probaply removed a lot of the "decaying" clay..........but this have not happened...