it should work. after you complete the action does an icon appear like this?----->
depending on what level the enemies wall is, a level 2 wall typically takes about 18 minutes or so to destroy. Dont forget a level 2 wall has 2,500 hit points so its just like killing an army with 2,500 health that does not attack back. Be careful though, watch the enemy doesnt attack you while your attacking the wall. Make sure they dont make it to the top of the wall with archers or anything bc they get a defense bonus while there. They can be peppering you with arrows on the wall while your trying to kill their wall and your army will quickly be disintegrated. I suggest to have an army upwards to about 4,000 if they are heavily guarded by walls, preferably with lots and lots of swordsmen for meat shields passing walls. This situation is either fight, or flee as soon as you arrive.