This was surprisingly easy to do, but difficult to find, so I figured I would do a quick write-up to help others who might find themselves in the same boat. All you need to do is specify the revision number you want to build using the @ symbol at the end of the SVN URL, for example:
http://svn-repo/project/trunk@12345
12345 would be the revision number you want to build. There are also a number of SVN plugins you could install to do this as well, but if all you want to do is test a specific revision, this is an extremely easy way to do it. In my case, I was hunting down an issue that I could reproduce locally so I was going through the trac history revision by revision to find the culprit behind the issue. It luckily took less than 10 tries and the builds were relatively quick, so I didn’t waste too much of my night finding the issue. And luckily, when I found the bad commit, it was a one-line change, so it was easy to figure out what went wrong and make a fix. Here’s a screenshot to help you if you’re more a visual learner: