La piedra esta pesada means its heavy and caja esta pesada ?

I am from South Texas im chicano and whenever I say a rock is heavy When I lift it I say la piedra esta muy pesada, is this wrong? I was taught to say it like this and la caja esta pesada means the box is heavy, that is the way I say it,