The purpose of using an image data generator in building an image classifier using TensorFlow is to enhance the training process by generating augmented versions of the original images. This technique helps to increase the diversity and quantity of the training data, which in turn improves the performance and generalization capabilities of the image classifier.