The orange with the peel floats because the rind is porous and filled with tiny air pockets. These pockets of air make the orange less dense than water and cause it to float. When you remove the rind from the orange, you are also removing those tiny air pockets. Therefore, the orange without the peel is more dense than water and it sinks.
Hope this helps!
