At the very least, the problem is "hard for the polynomial hierarchy" in the following sense.
Let $PermVerify$ be the problem specified. Then
$$PH \subseteq P^{\#P} \subseteq NP^{PermVerify}$$
The first containment is Toda's theorem. The second follows because for every query to a $\#P$ oracle, we can transform it to a 0,1 permanent instance, guess the value of that permanent, then call $PermVerify$ to check the guess is correct.
Therefore if $PermVerify$ is in $PH$, it is in $\Sigma_k P$ for some fixed $k$, and so $PH$ collapses to $\Sigma_{k+1} P$. In other words, your problem is not in $PH$, unless $PH$ collapses to some finite level (considered unlikely). Thus it's probably not in P, BPP, NP, coNP, etc.
Intuitively $PermVerify$ should also be hard for classes like $C_{=}P$ but as the comments indicate, this doesn't appear to follow directly from the standard references.