Yes, of course, but some duplexers like the UHF PD/Celwave 526 series will usually meet full specs after carefully tuning each individual cavity and just connecting them all back up.
I've never been lucky enough to get a set of cans to cooperate that well, on any duplexer (including a 526). No matter how carefully I tune each can individually, there's always some improvement to be found once you get all the cans connected together. A lot of duplexers I've worked with worked fine doing it the way you describe (especially if I was out at a site and had to tune "by ear" in a pinch), but I'm kind of picky about duplexer tuning.
Another thing on the Telewave 1444, its only got about 70dB isolation when everything is perfect and that's not going to be adequate for some repeaters like a couple of wide band mobiles cobbled together as a repeater with a 150 watt amplifier attached. A good repeater with sharp tunable front end and 50 watts should be ok.
Concur on the limited isolation. The FD I used to work for had an MSR2000, with input and output frequencies only about 1.5 MHz apart, and the PA running full-bore 120 watts. Duplexer was rated for 1 MHz separation but only about 70dB isolation, and we had awful problems with desense; when the incoming carrier dropped the repeater stayed keyed for several seconds making the most obnoxious crackling noise due to the TX getting into the RX. Drove me nuts, as I knew exactly what was going on. We had to put up with it until I was finally able to convince the nitwits from the shop we did business with to crank the power down by about 30 watts (fire chief wouldn't let me do it). We noticed no reduction in coverage and the problem went away.
I usually generate into the antenna port of the duplexer and measure out of the transmit and receive ports and don't forget to put a good 50 ohm load on the unused port while measuring.
Ditto, especially on the 50 ohm load. I forgot that once and the wonky readings I was getting drove me batty until I took another look at the connections, and there it was right in front of my face: the TX port just sitting there all nice and empty. D'oh!