The safest way for a baby to travel is to be tightly harnessed into an infant car seat, which is in a rearward facing position, secured on the back middle seat of the car. Or behind passenger if the car doesn't allow for this.
The handle should be positioned forward towards the baby's feet when driving. This is because your child's seat can rebound in a collision, and having the handle in the correct position prevents this from happening.