I’ll describe what I did to make this happen:

Notes, quotes, credits all from: http://notahat.com/posts/25

This is a great post to follow, and accounts for most everything I did here.
The difference is that I’m using svn2git, instead of doing manual git clone commands.
The above post will only set up remote branches, and what I wanted was to have all branches and tags local to my new Git repository.
Svn2git will copy all of your branches / tags from the original SVN repository into your new Git repository as well.
(Check it out here [thanks to nirvdrum]: http://github.com/nirvdrum/svn2git/tree/master)

Let’s say I have an SVN repository structured as:

trunk
...
branches
1.x
2.x
tags
1.0.0
1.0.1
1.0.2
1.1.0
2.0.0

Our goal is to have a git repository with native tags/branches taken from our SVN repository.
At the end of my migration, I want my Git repo to look like:

$ git branch
* master
1.x
2.x
$ git tag -l
1.0.0
1.0.1
1.0.2
1.1.0
2.0.0

#Make sure Git is installed:
#If you don’t have the epel yum repository enabled by default, you must specify to enable it at the command line:
#For other distributions, you know the drill (apt-get, port, etc.)

yum --enablerepo epel install 'git'
yum --enablerepo epel install 'git-svn'

#Now, create a system git user and group

sudo adduser git

#Now edit /etc/group, and add any users who’ll need to access the Git repository to the git group:

...
git:x:100:james,paul
...

#Make a directory for Git repositories
#We chose: /usr/local/git_root

sudo mkdir /usr/local/git_root
sudo chown git.git /usr/local/git_root
sudo chmod 2770 /usr/local/git_root

#Create your svn-authors.txt in /usr/local/git_root/svn-authors.txt to tell Git how to convert SVN usernames in the logs:
#Place *ALL* SVN authors in this file so that git doesn’t complain when it cannot find a particular user to convert.

pbunyan = Paul Bunyan <pbunyan@example.com>
jbond = James Bond <jbond@example.com>

On the left are the Subversion user names; on the right are the Git equivalents.

#Make sure your gem sources include github.com (if necessary)

sudo gem sources -a http://gems.github.com

#Install the svn2git gem

sudo gem install nirvdrum-svn2git

#Verify that you have svn2git in your PATH

which svn2git

#We will create a temporary directory in /tmp/
#This is where we will fetch the SVN repo into a git repo.
#We’ll then use this temporary repo to create our bare repository.

mkdir /tmp/foo-project
cd /tmp/foo-project

#I’m assuming you have the standard SVN setup of

-root
---trunk
---branches
---tags

If not, you can look into the options of svn2git to match your SVN repo structure.

#Run the command given your svn-authors file:

svn2git https://svn-repo/foo-project --authors /usr/local/git_root/svn-authors.txt

#You can go into this folder and verify that you see all your local branches and tags by running:

git branch
and
git tag -l

This should print out the lists of your branches and tags if everything is working right so far!

Next, we want to create our bare repository in /usr/local/git_root.

#Become git user and set permissions

sudo su - git
cd /usr/local/git_root/
umask 007

#Clone the temporary repository created by svn2git to a bare repository.
#<project>.git is a local convention.

git clone --bare /tmp/foo-project foo-project.git
cd foo-project.git/

#Make sure permissions are set properly

git config core.sharedrepository 1
git config receive.denyNonFastforwards true
find objects -type d -exec chmod 02770 {} \;

The core.sharedrepository flag tells git to keep everything group readable and writable.
The receive.denyNonFastforwards flag makes sure that merges can’t happen when you push to the repo. You have to do the merges on your local machine, and then push the result.

#Try to do a git clone from your workstation (another computer)

git clone ssh://git-repo:22/usr/local/git_root/foo-project.git

#Clean up
Once you’re happy that everything is working, delete the temporary repo that you created in /tmp, and you’re done!