Tristan da Cunha is a veritable metropolis next to South Georgia Island, which has no permenant residents but a museum and research station, yet more tourists, and countless penguins. The only settlement -- if you can call it that -- is Grytviken.
It has a little church of Norwegian origins, and remarkably enough, witnessed its first wedding just a couple of months ago. The bride was named Georgia; her father visted the remote outpost years before. The church has at least once service a year: Christmas, which at least would be in austral summer!
News from South Georgia Island (includes stories about the wedding, a visit from the Falkland's Catholic priest, and a concert in the church)
Image: Wikipedia. Released into public domain. See first two links above for source.