Now that we know you have had it apart, you most likely are missing a Washer/ spacer that locks the inner race to the aluminum carrier while allowing the outer race of the bearing to rotate.
You probably now know you did not need to disassemble that pulley assembly, you simply loosen the nut (that you removed) and adjust with the Allen head slider mechanism at the top of the aluminum carrier, then tighten the nut again to lock it in the correct location for your new belt.
Three bolts removes the carrier housing, where you can then fiddle around and get some combination of washers to work (bolts are different lengths so mark them) or, you can get the entire assembly by placing an ad on this forum.
This all is predicated by the fact your pulley still spins while the inner race is held firm. If not, that is your problem and ignore everything above.
I had one where the allen head adjuster would not move, and it had to come off, to soak the threads and get it moving. I would take it off and put "never seize" on the threads.