Very subjective question. On average, the pass rate is 83% according to this
source.
However, there will definitely be within group differences. For example, one would expect the pass rate to decrease amongst individuals who struggle with English. It would further be expected to decrease for individuals with a low-level of education. Of course, how much the individual studied for the test is a major factor.
Therefore, I would personally expect individuals with low-level of education, who struggle with English and who did not prepare well for the test to explain most of the citizenship test failing rate. Are you in this group? Then yes, the citizenship will be hard. If you are not in this group, especially because you prepared well, then no, it's the stupidest test to exist on the face of this planet which makes it really bloody irritating that IRCC is not finding an alternative for it!
Hope that answered your question.