Yep, that's aphids. Spraying with soap and water usually works for me, but you might have to repeat it a few times. Make sure to check your other plants too; at the end of summer the aphids produce a winged generation that easily spreads everywhere. If you have a large outbreak on your hands then buying some parasitic wasps might be the easy way, otherwise quarantine and spraying/manual removal is generally enough.