Danny Kedwell scored twice from the spot as Gillingham left it late to beat 10-man Plymouth.
The game was goalless 15 minutes from time when Ben Gibson was given a second yellow card for handling in the box and Kedwell converted the penalty.
Substitute Luke Rooney lashed home to make it 2-0 before Kedwell scored his second spot kick in injury time after Simon Walton brought down Dennis Oli.
Winless Plymouth's best chance came from Luke Daley's deflected shot.
VIEWS FROM THE DRESSING ROOM
Gillingham boss Andy Hessenthaler told BBC Radio Kent:
"I said at half time we are going to have to be patient with this one. They played one up front and five across the midfield and stopped us from creating and you have got to give them credit.
"There was a turning point in there and it went in our favour. We got the penalty, Keds got his first goal which I am delighted with.
"We got the second goal, we then looked comfortable. A good win, it keeps the run going so we're delighted with the start so far."
Plymouth Argyle boss Peter Reid told BBC Radio Devon:
"The first goal changed the game with the sending off and then we had to change shape.
"A big striker or a bit of pace and stature up front, we haven't got it at the moment.
"No use feeling sorry for ourselves."
Gillingham 01 Flitney 02 Fuller 03 Frampton 12 Martin 15 Lawrence 04 Lee 08 Payne 10 Weston (Jackman - 88' ) 17 Spiller Booked (Oli - 60' ) 19 Montrose (Rooney - 60' Booked ) 09 Kedwell Substitutes 28 Gazzaniga 06 Richards 18 Jackman 14 Rooney 11 Oli Plymouth Argyle 01 Larrieu 02 Berry 05 Zubar Booked 13 Soukouna 19 Gibson Dismissed after an earlier booking 06 Nelson 07 Daley (Lecointe - 78' ) 08 Walton 20 Hourihane 21 Atkinson 11 Feeney Substitutes 23 Cole 15 Young 18 Copp 27 Lecointe 10 Hitchcock