Lavender is the color of indulgence and is used mainly in reference to Gatsby. The rooms of Gatsby's mansion are decorated in lavender, and he wears lavender shirts.
One of the twins in yellow also mentions that he sent her a new dress with lavender beads after hers was ruined.
Lavender represents things which were done that were not necessary, things that the rich characteristically do.