Usually tileset spriters themselves will make a project file you can download so you can copy and paste the tilesets from one game to the other.

If all they have is an image, then I'm sorry, but you have to set it up for every tile.

On RMXP each tile is 32x32