You are not alone. It works with some headphones and doesn’t work with others. Super annoying. I’ve posted about it awhile ago here:
Never got any answer from Mudita team regarding this issue unfortunately.
And no, there is nothing special about either of the headphones I tested with, both are widely popular models of a well known brands neither of which ever faild to work with any other device I used it with