The fence will begin to buckle under the weight – moist soil is incredibly heavy, even if just 20cm thick, and even good close-board fencing, such as yours, isn’t strong enough. Furthermore, any water that gets between the liner and the fence panels would damage them very rapidly – it’s simply not worth the risk.