The nature of stats in the game seems to favor putting large amounts in a primary for a highly noticeable benefit and then some in a secondary for a less noticeable but still present benefit.
That being said, if I were you I'd perhaps put points in Speed till I reach the attack speed cap and then put the rest in Damage. The Speed helps your attack speed which is too good on Duelist (imo), and it also helps with cooldowns to use your skills more often. The cooldown reduction also benefits your Ravager Sub since moar skill spam = moar AOE damage.
For defense I'd go with either defense or evasion. Defense is more reliable, while Evasion is chance based. I'd recommend Evasion since Duelists are suited towards it naturally. I can understand grabbing a little Defense to beef up a little, but now its best to pump Evasion and let gear provide for your defense.
Betas are the time to test out junk before the wipe, so that you're educated before ya head into OBT. Overall, its a pretty decent setup already, so you're still free to do as you please.