Point is casteim is true and will prevail. However, that doesnt mean son of fisher woman cannot be a Brahmin.
Children born in pious Brahmin family naturally have access to spirituality and austerity. So instead of abolishing caste-system (BG: Chapter 4 - Chatur Varnam Maya Sristam...) one should understand his swa-Dharma and try to follow it.