Luke 2:5

to be registered with Mary , his betrothed , who was with child .

He went there to register with Mary, who was pledged to be married to him and was expecting a child.

To be taxed with Mary his espoused wife, being great with child.