Refactor transform code to simplify categorical

[marcosfelt]

Right now the code for transforms is complicated and also uses deprecated features in pandas like setting multi-index code in place. The code should be refactored to be simpler and use the proper pandas APIs.