Video heads, although very nice to use, are a pain to carry around unless you remove it from the tripod. A ball head is much smaller. A carbon fiber tripod attached to your pack works much better when teamed up with a ball head. So use whatever head works for the current job.
I have a good solid arca swiss clamp on the tripod, and 3 good arca swiss plates attached to a ball head, a gimbal and a video head. I can quickly swap between which ever is the best for the job. Works at home and when car based. When tramping only the ball head goes. There is no good reason to lock yourself into one specific head.
In passing I do have quite a good Manfrotto video head but did find that some combinations of hardware caused it to be less than stable (it sagged because of the weight) whereas a ball head didn't. This particular video head might have been better if it had provision to allow the camera to be rebalanced on the head but that means even more hardware.
Another problem with video heads is some of them can be harder to make into universal mounts. Not impossible but harder. I had to machine the top of the Manfrotto to allow adding an arca swiss clamp on top instead of a QR Manfrotto plate. But it worked. Also possible to add an arca swiss clamp onto the QR plate as an adapter but the permanent change is better.
Another disadvantage of a video head (mine anyway) is you use your right hand to adjust the horizontal movement but your left hand to adjust the vertical movement. This can be annoying.
So depending on what you are photographing, where you are photographing it, weight limitations etc make sure you can use any of the head types and can swap them quickly. Then you are using the best tool for the job.