• You are viewing the forum as a Guest, please login (you can use your Facebook, Twitter, Google or Microsoft account to login) or register using this link: Log in or Sign Up

Importance of methodology and controlled environment

M

Marcel G

Guest
Many hobbyists want to know what's going on in their tanks. Many hobbyists experience different kinds of problems and ask here (or on other forums) how to solve it.

I think that the best way to solve any problem is to test is under controlled conditions. Let me discuss this in more detail here.

The strength of scientific methods is in the repeatability of the experiments. Not the interpretation of the results but rather the repeatability of the experiment is what has the biggest value. In other words, the experiment is of any value if anybody can repeat it with the same results elsewhere in the world. And on the contrary, the experiment is useless if you can't repeat it with the same results. Not until we understand this, can we move our hobby any further. The biggest problem with our discussions (seeking answers for our questions) is that we base our findings on non-verifiable results.

A few examples:
1) Let's say I make an experiment with growing few aquarium plants under controlled conditions (light intensity of 100 µmol PAR for 10 hours a day, water temperature of 25°C, hardness of 5°dGH, alkalinity of 3°dKH, nutrient content of 35 ppm CO2, 30 ppm NO3, 3 ppm PO4, 20 ppm K, 0.3 ppm Fe, moderate flow, inert substrate, etc.). I'll find out that these plants grow at different growth rates => some grow faster than others. If I describe the methodology (i.e. the exact parameters of this experiment) well enough, anybody elsewhere can do the same experiment and get the same (or very similar) results.

2) Let's say I make the same experiment but I don't know the exact parameters of my setup => I don't know the exact PAR values of my light intensity. I don't know the exact nutrient content of my aquarium water nor the substrate. I don't know what other factors are in play in my tank. So I can't describe the methodology of my experiment. If someone on the other side of the world tries to repeat this experiment, it's highly probable he will get a different results. Why? Because no one knows the exact parameters of the initial experiment.

Now, why do you expect to find any reasonable solution to your problems in your own tank, if we (nor you yourself) know the exact parameters of your aquarium? I think that this is the core problem of most of our discussions. Without first learning the exact parameters and conditions in our tanks, we are doomed to endless speculations. Without the proper methodology and controlled environment we never ever can be sure what's really going on in our tanks.

This is my main objection to Tom Barr also. He makes a lot of conclusions based just on his own speculations. As far as I know, he never did any trully controlled experiment with well documented methodology. So no one can faithfully repeat his results. He uses a clay-based substrate in his main tank, very high CO2 levels, very low pH, very high light levels, quite high flow, big army of algae-eaters, do frequent water changes ... but in fact, we don't know all the parameters which may be in play in his tank. And this is the reason, why his method can't work universally and under all conditions (i.e. with different kinds of substrate, different water parameters, different plant species, different fish etc.). His method works in his tank under the given (fully unknown) conditions. But we don't know what these conditions really are. We know just what he lets us know or what he thinks is important for the success. But that's not trully scientific method. That's nothing more than speculation based on some experience. Until he is able to controll all the variables in his tank, and tell us what variables are at play there and how they affect the whole, we won't be able to repeat the same results elsewhere in the world. We can be lucky and have the same or similar results, but we will never be sure why. It's never a good idea to do any experiments in fully uncontrolled environment like our tanks. And the main problem with T.Barr is that he did all his experiments right in his tank.

Takashi Amano is a similar example although he seems to know better what he's doing. His system is based on the use of concrete materials with concrete parameters. He doesn't let us know the exact methodology behind his system, but if you use his ADA system there's much higher chance you succeed as the crucial parts will be always the same (light intensity; nutrient content in the substrate and water column; filtration capacity, efficiency and flow; CO2 management). You are also recommended to use water with low hardness and alkalinity. If you follow his advice, you can repeat his success elsewhere in the world with much higher probability than with T.Barr's recommendations. Unfortunately, this know-how (hidden methodology) is very pricey. Even in this case we will never be sure why.

So are we doomed to endless speculations or is there any hope in more hobbyist using proper scientific methods?
 
I am afraid one of the biggest problems will be reliable testing. Only with lab quality testing the parameters will be equal, and sadly that will be out of reach for most.
 
Takashi Amano is a similar example although he seems to know better what he's doing. His system is based on the use of concrete materials with concrete parameters. He doesn't let us know the exact methodology behind his system, but if you use his ADA system there's much higher chance you succeed as the crucial parts will be always the same (light intensity; nutrient content in the substrate and water column; filtration capacity, efficiency and flow; CO2 management). You are also recommended to use water with low hardness and alkalinity. If you follow his advice, you can repeat his success elsewhere in the world with much higher probability than with T.Barr's recommendations. Unfortunately, this know-how (hidden methodology) is very pricey. Even in this case we will never be sure why.

You have a higher chance of success simply because you are buying a ready made pack. I think there is a lot to learn from ADA but not from what they say but from what they dont say which is all in theyr videos.

Also things that T Barr has tested that you never give credit for. Yes its not scientific but nothing in this hobby is and at least its free.
-Content of AS soil
-Effect of CO2 mist compared to dissolved CO2
-Ammount of light used by ADA and theyr followers

just to name a few. This things never get mentioned by companies and I dont know how we'd have a clue otherwise.
 
Last edited:
I think a lot of the problem comes down to time and money. People are not willing/able to spend thousands of pounds on par meters etc and to buy tanks only to set them up as experiements. Nor can people afford a full ADA setup. Most people may only have 1 or 2 tanks and they want these to be beautiful aquascapes not functional scientific experients.

Obviously the ideal is that everyone with a healthy tank can post full data on their tank environment making it repeatable. However this is unachievable because people are often unwillingly to follow scientific rigour and cannot afford (until the technology becomes cheaper) the reliable equipment for accurate testing of parameters.

That leaves us trying to make do with specualtion and educated guesses, as its the best we have.

That said, even just a few well informed scientists who either specialise or have links to those who specialise in these areas, with access to reliable testing equipment, can be of great benefit to the hobby.

Although perhaps not all that efficient, as long as people do not just blindly follow speculation and expect success, but agree to adjust something in their own tank based on the experience of another to see if their is any change, that is not a huge problem, it is not ideal but it is the best we can manage.

Sorry for the long reply and inevitable repetition in what I say...:rolleyes: although I hope I put across some decent points.
 
Obviously the ideal is that everyone with a healthy tank can post full data on their tank environment making it repeatable. However this is unachievable because people are often unwillingly to follow scientific rigour and cannot afford (until the technology becomes cheaper) the reliable equipment for accurate testing of parameters. That leaves us trying to make do with specualtion and educated guesses, as its the best we have.
That's true. I just wanted to point out that without proper scientific methods we are left to speculations (or educated guesses at best as you say). And we should be aware of it. One possible solution to this problem I see in co-operation and teamwork. In the US there is a number of local clubs. Maybe in UK it's the same (or at least you have "UK aquatic plant society"). Is it such a problem for the members to donate some small amount of money for these aquarium experiments? In each club there may be someone willing to do the experiments if you lend him the proper equipment. You provide the equipment and he/she provide his/her time and enthusiasm. This way we can get to far better results than just "educated guesses" in so many areas of our interest. I myself put more than £1000 into the proper equipment for aquarium experiments, and about 15 hobbyists contributed me with some financial amount. So what about some bigger organisations or clubs? If you are not willing to give couple of bucks to your local "researcher", then don't cry here you don't get answers to your questions. Some experiments may be really hard for being done, but many experiments can be done quite well even at home under standard conditions => for example testing whether CO2 mist offers better results than fully dissolved CO2, or if there is any difference in the growth rates of aquarium plants grown under 10 ppm NO3 vs. 30 ppm NO3 ... or 10 vs 30 ppm CO2, or what's the difference between plain sand vs. ADA Aqua Soil (and is this difference substantial), or whether plants grow better in hardwater or soft water if both are supplied with CO2, etc., etc. There are so many experiments that can be performed at home if you have the proper equipment. And I'm sure that everywhere there is at least one hobbyist willing to invest his/her time into it. Are you willing to support it? You can also create some discussion board where people from the local club/society may discuss the main topics/questions they would like to see answered. Why not to go this way? Or do you really believe that from our endless speculative discussions on our forums something really helpful and revealing may arise?
 
That's true. I just wanted to point out that without proper scientific methods we are left to speculations (or educated guesses at best as you say). And we should be aware of it. One possible solution to this problem I see in co-operation and teamwork. In the US there is a number of local clubs. Maybe in UK it's the same (or at least you have "UK aquatic plant society"). Is it such a problem for the members to donate some small amount of money for these aquarium experiments? In each club there may be someone willing to do the experiments if you lend him the proper equipment. You provide the equipment and he/she provide his/her time and enthusiasm. This way we can get to far better results than just "educated guesses" in so many areas of our interest. I myself put more than £1000 into the proper equipment for aquarium experiments, and about 15 hobbyists contributed me with some financial amount. So what about some bigger organisations or clubs? If you are not willing to give couple of bucks to your local "researcher", then don't cry here you don't get answers to your questions. Some experiments may be really hard for being done, but many experiments can be done quite well even at home under standard conditions => for example testing whether CO2 mist offers better results than fully dissolved CO2, or if there is any difference in the growth rates of aquarium plants grown under 10 ppm NO3 vs. 30 ppm NO3 ... or 10 vs 30 ppm CO2, or what's the difference between plain sand vs. ADA Aqua Soil (and is this difference substantial), or whether plants grow better in hardwater or soft water if both are supplied with CO2, etc., etc. There are so many experiments that can be performed at home if you have the proper equipment. And I'm sure that everywhere there is at least one hobbyist willing to invest his/her time into it. Are you willing to support it? You can also create some discussion board where people from the local club/society may discuss the main topics/questions they would like to see answered. Why not to go this way? Or do you really believe that from our endless speculative discussions on our forums something really helpful and revealing may arise?


I am willing to donate some money for the right experiments. Im specially interested in testing hard water and co2 mist. let me know ardjuna if yiu ever do them.
 
Or do you really believe that from our endless speculative discussions on our forums something really helpful and revealing may arise
There is plenty annecdotal evidence about what doesn't work (blasting plants with loads of light melting them into a mush), and in my believes also a lot of evidence of things that can work (indeed things like light driving the need for CO2 and bypassing Liebig's law by giving plenty ferts).This won't solve all problems, and will leave us with seemingly strange findings, but there is truth in numbers.
What you propose is a nice, alas i don't think it will be realised. Only if Tropica, Eheim or Dennerle would help it could be done.
 
How many variables in the term "hard water" alone? (just looking for bears on the road now, and pointing to all the difficulties to expect:confused:)
Just KH which seems to be the important one for some plants. I doubt GH has an effect at all but that can be another experiment.
It would be a really easy experiment with KH. Keep a tank with low KH untill everything is groing great then add hard water and documment the findings. I know this is not scientific. Does anybody know what an experiment must have to qualify as scientific proof?
People get lost in all the variables but all you have to focus is in just changing one variable whilst keeping the tank the same.
The problem I see is precipitation issues.
I think if results are posted along the way on this forum then it might be worth the while.
 
Last edited:
There is ... a lot of evidence of things that can work (indeed things like light driving the need for CO2 and bypassing Liebig's law by giving plenty ferts).
Without the people doing the experiments you won't have any such evidence! This evidence (light driving the need for CO2 or ferts decreasing the demand for light) did not rise from discussions on forums!
So I must repeat my question: Do you really believe that from our endless speculative discussions on our forums something really helpful and revealing may arise?
How many variables in the term "hard water" alone?
I see four variables here:
1) soft (0-3°dGH)
2) moderately hard (3-7°dGH)
3) hard (7-10°dGH)
4) very hard (> 10°dGH)
Each one can be tested.
Only if Tropica, Eheim or Dennerle would help it could be done.
You're right. If you are not willing to become involved, then it can be done only if Tropica, Eheim or Dennerle do it for us and share their results (which is a nice sci-fi).
 
So I must repeat my question: Do you really believe that from our endless speculative discussions on our forums something really helpful and revealing may arise?
Yes, from these forums we debated things like precipitation of nutrients, cation exchange, flow, co2, EI all of which make it easier to keep a planted tank. Are they fact? No, but its all we have for now.
 
I see four variables here:
1) soft (0-3°dGH)
2) moderately hard (3-7°dGH)
3) hard (7-10°dGH)
4) very hard (> 10°dGH)
Each one can be tested.

This is the problem IMHO. Are we asking the right questions? in order to invest our hard earned money.

Is there any interest in knowing all these ranges of GH? I dont think so. Plants have been shown (only on forums) that they can grow perfectly well under any GH if your not limitting nutrients.

What are the actual questions that we can get something out of them?

You can run out of a life time and have not answered one useful question.
 
Last edited:
I see four variables here:
1) soft (0-3°dGH)
2) moderately hard (3-7°dGH)
3) hard (7-10°dGH)
4) very hard (> 10°dGH)
Each one can be tested.
I meant in variables in hardness origin alone, variations between amount of Ca and Mg.
 
Does anybody know what an experiment must have to qualify as scientific proof?
I recommend you to read the following articles:
https://en.wikipedia.org/wiki/Scientific_evidence
https://en.wikipedia.org/wiki/Scientific_method
we debated things like precipitation of nutrients, cation exchange, flow, co2, EI all of which make it easier to keep a planted tank. Are they fact? No, but its all we have for now.
Precipitation of nutrients, cation exchange, flow, CO2 ... these are all things you won't know much about without some scientific research. How do you know about boundary layer? How do you know about CO2 chemistry? How do you know about compensation point, saturation point and half-saturation constant? Did you discovered all these things by means of some theoretical discussion? Of course not! First some researches have to discover it, then publish it, then someone read it and shared it with you. In the same way, by simple discussion on forum you will hardly find any meaningful answers to your questions. You (or someone else) have to do the scientific experiments.

Are we asking the right questions? in order to invest our hard earned money.
When you are buying some expensive piece of hardware for your tank, do you ask the right questions also before you buy it? What are you buying decisions bases upon?
 
Well, I don't want to disappoint you but the truth is that very few people are interested in knowing more, or at least to know that much.

On the business side (ADA approach) it would be their end, but honestly I don't think this is the real problem. On the hobbyist side, I'm not really sure if people want to squeeze their brains or just have something cool in their living room. Just think on the following situation you have probably seen in your LFS: someone ask the manager to give him a solution to get rid of "some little treads attached to the plants"... Do you think that in 5 minutes the shop manager is going to explain "all you need to know about planted tanks that you did not read in the last years"? Does the customer really wants to hear all this? Or do he prefer to pay for a magic solution?

IMO all the brands are selling more and more "complete packs" following the ADA approach. The intention is to deliver a kind of foolproof recipe for success: if you use my tank, my light, my substrate, my ferts, etc. you won't fail. You don't need to know why, but it works. An application will tell you what, how and when to do it.

Let's admit it, this is the trend and brands will only support their how research for developing their own products. My guess is that they focus on new products and gadgets (Twinstar is a very good example) you don't probably need but that can produce good benefits.

We are weird people :)

Jordi
 
I meant in variables in hardness origin alone, variations between amount of Ca and Mg.
You're right again. It's all so complicated that there is no way to find anything. Actually I don't know why scientists even try to find something. They are doomed to darkness. There is no way to test even such a simple relationships like Ca and Mg ratio ... Stop all experiments and keep discussing. That's all we can (and should) do. Experiments belong to scientists, and speculations and discussions belong to hobbyists. That's our final destiny.
 
When you are buying some expensive piece of hardware for your tank, do you ask the right questions also before you buy it? What are you buying decisions bases upon?
Oh yes. I buy cheap but if I buy a tank I want to know its capacity, the watts/lumens of a light, the flow a pump can deliver the concentrations of ferts etc etc.

Precipitation of nutrients, cation exchange, flow, CO2 ... these are all things you won't know much about without some scientific research. How do you know about boundary layer? How do you know about CO2 chemistry? How do you know about compensation point, saturation point and half-saturation constant? Did you discovered all these things by means of some theoretical discussion? Of course not! First some researches have to discover it, then publish it, then someone read it and shared it with you. In the same way, by simple discussion on forum you will hardly find any meaningful answers to your questions. You (or someone else) have to do the scientific experiments.

How would you know
30 ppm is normally safe for our fish?
That the more O2 you have the more co2 you can inject?
If a certain soil is adsorbing nutrients or the amount of time you should be doing water changes until its safe for your fish because its not releasing ammonia anymore?
How would you know which co2 diffussion method is more efficient?
How would you know that in hard water you will probably need to add more phosphates because they are precipitating?
How would you know what size of filter to use or the ammount of T5s you need?

Yes you might find some scientific evidence for some of this but not applied to planted tanks.
 
Last edited:
Here is an extrat from the link you added Ardjuna.

While the phrase "scientific proof" is often used in the popular media,[13] many scientists have argued that there is really no such thing. For example, Karl Popper once wrote that "In the empirical sciences, which alone can furnish us with information about the world we live in, proofs do not occur, if we mean by 'proof' an argument which establishes once and for ever the truth of a theory,".[14]

This only proves that if you do an experiment now showing T Barr is wrong it will have the same weight as T Barrs theories. not more, not less (unless its obviously wrong).
 
Back
Top