Maybe failing because the cert is a *server* cert, not valid for verifying clients. Certs contain a set of flags that specify what they can be used for, might be worth checking whether your cert is valid for both verifying server identity *and* for verifying client identity.
- Mike S