What's hard about being non-binary?

Previous topics in the series (which are still open should anyone want to add to them):

What's hard about being a man?
What's hard about being a woman?

This topic is for people who do not fit into the roles of "male" or "female": what is hard about being non-binary?

As before, please be mindful of the atmosphere of the post and the lived experiences of the individuals posting and try to keep things not only civil but welcoming to them. Furthermore, please be aware that majority voices can easily override a thread like this. As such, please make room for and elevate the voices of the non-binary people who choose to participate.