Scots speakers have hit back after a former member of the Scottish Labour party claimed the language facilitated racism.