Congenital malformations represent approximately 3 in 100 live births within the human population. Understanding their pathogenesis and ultimately formulating effective treatments are underpinned by knowledge of the events and factors that regulate normal embryonic development. Studies in model organisms, primarily in the mouse, the most prominent genetically tractable mammalian model, have equipped us with a rudimentary understanding of mammalian development from early lineage commitment to morphogenetic processes. In this way, information provided by studies in the mouse can, in some cases, be used to draw parallels with other mammals, including human. Here, we provide an overview of our current understanding of the general sequence of developmental events from early cell cleavages to gastrulation and axis extension occurring in human embryos. We will also review some of the rare birth defects occurring at these stages, in particular those resulting in conjoined twinning or caudal dysgenesis.