Truly UI straddles both lines, so I'd say both - I think UI Designer is a term that encompasses knowledge of art and graphic design, whilst understanding the intricacies of game design and user flow. To accel in this field you need a knowledge of both.