Matthew Scully-Hicks, 31, of Delabole, Cornwall denies the murder of 18-month-old Elsie, who died in May 2016 after suffering catastrophic injuries.
Neighbour James Bevan told Cardiff Crown Court he heard offensive swear words being shouted at the infant.
Mr Bevan, who lived in the semi-detached house next door to Matthew Scully-Hicks in Cardiff, said: "The first initial time I heard anything (unusual), I heard like a tantrum, like a 'argh', an adult's voice, a baby crying, and as the baby was crying I heard a door slam… I identified the crying as being that of a baby.
"I would normally hear similar occasions happening once a week. Shouting, babies crying, tantrums."
Passengers angry after last minute flight cancellation