I hadn't actually used the system config page -- I was just doing it by hand.

Be careful with that. If you edit anything in the existing configuration files you'll lose your changes in the next OTRS opgrade. By using SysConfig, OTRS will place your changes in a separate file that can easily be applied after an upgrade. -- Lars