Please note that you CAN actually control the aperture and shutter speed with the control wheels during filming. However, it requires that you click the "OK" button first and then you still have to use the menu for some adjustments.
The manual controls for filming are not as bad as I initially thought. However, they definitely are not intuitive and could still be improved with a firmware update. I still stand by the fact that the GH4 and especially the LX100 are much better for their manual controls.